* First draft on task system usage, still missing job system
* Scan location roughly working, a ton of stuff to fix yet
* Updating some deps due to crashes and bugs
* Exposing non critical errors to frontend
* Getting active job reports from job system
* Using boxed opaque type to avoid a downcast issue with generics
* Task system issues discovered on race conditions
* Enable debug
* Fix job report in the job manager
* Fix race condition on steal tasks
* Fixed race condition on task suspend
* Some fixes on job progress reporting and save
* Fixed many race conditions and a hard deadlock
Also some progress report polishing
* Ignore .ts and .mts video files for now
* Some better logs
* bruh
* Internal deadlocks and excess of communication in the task system
- Also better logs
* Bunch of fixes and optimizations
* WIP at fixing file identifier
* Fixed file identifier job
- still need to work on its progress report frontend
* A bunch of polishing
* Fixed some bugs and did more polishing
* Cleanup
* Bridging old and new job systems
* A ton of fixes
* A bunch of bugs related to shutdown and resume
* Indexer and watcher bugs
* Log normalizing
* Fixing CI
* Change error! to warn! on non critical errors log
* Fix redirect to new location
* Type annotation
* Bogus merge resolution on cargo lock
* Workaround nvidia on linux segfault
* Fixes
* Don't vendor dbus
* Make dbus and opener linux exclusive dependencies
* opener is a generic dependency
* Add dbus as a dependency for deb and setup.sh
* Clippy fixes
* Replace gl and glfw with glutin for querying nvidia card
* Replace glutin with wgpu
* Update icrate to fix 'multiple applicable items in scope'
- Fix humanizeSize returning value as original (which was simply plain wrong), replace it with the original bytes
- Restore plural to humanizeSize, but only when converting object to string
- Fix float number to BigInt conversion in humanizeSize possibly causing an error (now it truncates the value)
- Remove unused profile.release from `apps/desktop/src-tauri/Cargo.toml`, repo's main Cargo.toml profile overrides it
- Update `packageManager` and remove conflicting `engineStrict` entry from package.json
- Remove `prefer-symlinked-executables` from `.npmrc`, linked bug was fixed
* Moving stuff around
* Media data extraction task
* New thumbnailer task
* Taking more metrics on thumbnailer
* First drafts on media processor job
* Better interruption latency on thumbnailer task
* Also solve the latency on interrupt at media data extraction
* Media processor job
* Shallow media processor
* Better prioritize files identification
* Integrate ffmpeg media data extraction
- Thumbnail quality improvements parameters
Greatly improve production build size, now prod builds are 1/3 of the size
- Main spacedrive binary went from ~120M to ~40M
- Add more optimize options for rust prod build
- Improve vite settings for front-end prod build
- Improve lossless compression of PNGs
- Don't include videos in bundles when they are not used
- Don't generate/bundle sourcemap for prod builds
* Most of it
* Cleanup menu
* fixes
* Fixed linux compilation, still not working though, as the app panic on start
* Add dialog permissions
* fix search keybind
* Fix linux
∙ - Disable linux-ipc-protocol feature, as that is causing panics due to trying to access some WebKit internal structures outside the main thread
* Update to Ubuntu 22.04, new tauri doesn't support ubuntu 20.04
> - Add note to download page about deb's distro support
* Remove gen/schemas
* Update linux dependencies in setup.sh
* Fix linux deps again
- Enable rt-tokio-crypto-rust feature in secret-service so clippy stops complaining
* Clippy + auto fmt
* Fix cache-factory
- Create a devtools feature for desktop app, which is enabled by default on dev builds
* Fix minor error in patchTauri.mjs
* Fix some envvars that have been renamed on tauri v2
* Dont change the secrets
* Add missing linux dependency
---------
Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
Couple of fixes
- Increase `pnpm prep` connection timeout to 5min, to better handle downloading native deps under flaky network conditions
- Fix `cargo test` and cache-factory CI
- Clippy and fmt
* Open Trash from the application
* Working Trash Sidebar Button
* Small UI fixes
* Update common.json
* Move openTrash to Tauri Command instead of RSPC
* format and remove type assertion
---------
Co-authored-by: Utku Bakir <74243531+utkubakir@users.noreply.github.com>
* Moving file-path-helper to a sub-crate on core
* Parallel walker tested and working
* Change inner core crate names to sd-core-* naming scheme
* Moving stuff around
* Save and Update tasks for the new indexer job
* Some initial drafts on the new job system
* More drafts on job system
* Changing walker task to a more explicit state machine
Also drafting more of job system
* More drafting on job resume
* Completed the draft on job system inner workings
* New job context abstraction to decouple library stuff from job system
* Properly use composition on task dispatcher
* First draft on indexer job
* Job serialization
* Handling ancestors in the distributed walker for indexer
* Saving computed directories sizes on a location to db
* Enable a way to check if jobs are running in a location
* Progress reporting on indexer job
* Reorganizing modules
* Shallow indexer
* Rust fmt
* Attempting windows CI fix
* Attempting windows CI fix again
* Attempting windows CI fix again
* Disable Labeler
* Auto format and lint
* Comment out regen labels context menu entry
* Comment out some more labels references
---------
Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
* Revert "Revert "remove fixed filters" (#2261)"
This reverts commit 5b40cefe37.
* search sources
* only set default filters if no filters
* key saved search page on id and use raw search as searchbar default
* fix crate versions
* put media view filters in a dedicated hook
* remove ts-reset
* add comment about <Inner>
* generics!
* cleanup
* search paths/objects switch (#2278)
* feature flag target switcher
* use useZodParams in saved search route
* feat: cmd+r to quick rescan the current location, and change reload webview keybind
* chore: lockfile update
* fix: provide a location id to quick rescan in keybind event handler
* fix: add cooldown to quick rescan to prevent double-rescans
* refactor: use `explorerStore` instead
* Working External Storage Locked Locations
We can now add Downloads (A location locked by MANGE_EXTERNAL_STORAGE) on Android.
* Navigate to added page
Adding location now navigates to the added location explorer.
* Way simpler solution
Found a way simpler solution, that doesn't require query calls.
* Clean up
Remove unused import calls.
* Attempt to get Location Watcher working
Well, Location watcher doesn't want to run. But I wanted to push the `xcrun` command to the README.
Also, locations now actually show files, but break on displaying recursive folders (folder content in a folder).
* Quick clean up + Working full rescan
locations.fullRescan works now on mobile with 0 issues. It can recognize orphan paths and when new files are added.
But, Location-Watcher for some reason doesn't want to run automatically when the file system change occurs.
* Working iOS Watcher
Location Watcher now works for iOS when files are created. However, it can't understand the file delete event yet.
* Functional watcher for iOS
The watcher system is now fully functional on iOS, with a few bugs to patch regarding the delete function freezing the system up.
* Update ios.rs
* See Logs on Android
Finally figured out how to see the logs from Android.
* Update CONTRIBUTING.md
* Updated to Stable & Working
* Working Android Build + Explorer working again
* wip
* wip
* Squashed commit of the following:
commit a7bc3b908d
Merge: 201913a12899aa3f
Author: Arnab Chakraborty <11457760+Rocky43007@users.noreply.github.com>
Date: Tue Feb 6 16:18:42 2024 -0500
Merge branch 'main' of https://github.com/Rocky43007/spacedrive
commit 2899aa3fa5
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Tue Feb 6 19:30:53 2024 +0300
[ENG-1594] Change online to connected (#2060)
: This is a combination of 3 commits.
Change online to connected
remove offline
json
commit 48634c22aa
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Tue Feb 6 17:49:16 2024 +0300
[MOB-54] UI Fixes (#2059)
* UI fixes - rive animation - SD version in settings - and more
* twStyle
commit 4e70246467
Author: Jesse Rodrigo <39565615+JSSRDRG@users.noreply.github.com>
Date: Tue Feb 6 11:41:05 2024 +0100
Dutch locale (#2054)
* nl locale
* add nl entry
* improve some wording
commit bb0d0af6a0
Author: Brendan Allan <brendonovich@outlook.com>
Date: Tue Feb 6 17:13:47 2024 +0800
[ENG-1548] use in-memory instances when sending messages to cloud (#2057)
* use in-memory instances when sending messages to cloud
* comments
commit 2d0c340e58
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Tue Feb 6 06:03:33 2024 +0300
[MOB-47] Location screen and header updates (#2056)
* Location screen and header updates
* use tw sizing
* remove un-necessary prop
* Nit: change name
commit 58f9305965
Author: Arnab Chakraborty <11457760+Rocky43007@users.noreply.github.com>
Date: Mon Feb 5 07:06:47 2024 -0500
Update to Expo 50 and Fix to Rive Crashing (#2049)
* Update Mobile App to Expo SDK 50
+ Fix to Rive Crashing
* Added `metro-react-native-babel-transformer` to fix CI
commit 2ff1ffcb9c
Author: Utku <74243531+utkubakir@users.noreply.github.com>
Date: Sun Feb 4 23:52:26 2024 +0300
Fix Chinese language (#2050)
* fix chinese
* remove console.log
* Squashed commit of the following:
commit bda9a1b6ee
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Wed Feb 7 20:25:04 2024 +0300
[MOB-55] Video animation for onboarding on mobile and desktop (#2065)
* video animation for onboarding on mobile and desktop
run assets gen
cleanup
declare mp4 type
* update metro config to transform video files from sd assets
* test ci without native video exclude
* casing?
* remove to add back again due to github
* add videos back
* versions
* no need to transform
---------
Co-authored-by: Utku Bakir <74243531+utkubakir@users.noreply.github.com>
commit da2841b37a
Author: Utku <74243531+utkubakir@users.noreply.github.com>
Date: Wed Feb 7 16:47:55 2024 +0300
More translations (#2051)
* translations
* more translation keys
* all the translations
* Added Cleaning Script
* Prep for PR
* Clean up + `cargo fmt`
* Update mod.rs
* Squashed commit of the following:
commit 2dc233f1b4
Author: Utku <74243531+utkubakir@users.noreply.github.com>
Date: Fri Feb 9 18:42:42 2024 +0300
Update readme & contributing guide & language stuff (#2071)
* updates
* keep common errors
* fix selector being empty for english
* sort by label
* update contributing
* update ndk and docs
* Update CONTRIBUTING.md
commit 177b2a23d6
Author: Brendan Allan <brendonovich@outlook.com>
Date: Fri Feb 9 21:20:51 2024 +0800
sync support for labels (#2070)
* more sync support for file paths + saved searches
* sync support for labels
* update sync prisma generator to support more than tags
* workey
* don't do illegal db migration
* use name as label id in explorer
commit 6f28d8ec28
Author: Brendan Allan <brendonovich@outlook.com>
Date: Fri Feb 9 16:17:04 2024 +0800
More sync support for file paths + saved searches (#2067)
more sync support for file paths + saved searches
* Update build-rust.sh
Fix script so it doesn't build debug apps always now.
* Add Tests for iOS
* Update android.rs
PR 1812 was closed, therefore changing the message to mention the branch instead.
* Change `--debug` to `--release`
Oops
* Remove debug cargo crate for `notify-rs`
* Spelling Fix on `android.rs`
* Squashed commit of the following:
commit dba85ebac3
Author: Ericson "Fogo" Soares <ericson.ds999@gmail.com>
Date: Mon Feb 26 16:45:58 2024 -0300
[ENG-1513] Better integration between Jobs and processing Actors (#1974)
* First draft on new task system
* Removing save to disk from task system
* Bunch of concurrency issues
* Solving Future impl issue when pausing tasks
* Fix cancel and abort
* Bunch of fixes on pause, suspend, resume, cancel and abort
Also better error handling on task completion for the user
* New capabilities to return an output on a task
* Introducing a simple way to linear backoff on failed steal
* Sample actor where tasks can dispatch more tasks
* Rustfmt
* Steal test to make sure
* Stale deps cleanup
* Removing unused utils
* Initial lib docs
* Docs ok
* Memory cleanup on idle
---------
Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
commit 53713a9f59
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Mon Feb 26 18:53:37 2024 +0300
[ENG-1625] Spacedrop UI correct hover condition & spacing (#2127)
* improve spacedrop ui with correct hover & spacing
* remove
commit 6f27504e5f
Author: Matteo Galiazzo <50683509+gekoxyz@users.noreply.github.com>
Date: Mon Feb 26 16:20:41 2024 +0100
added it locale, added it entry (#2066)
* added it locale, added it entry
* Apply suggestions from code review
Co-authored-by: Matteo Martellini <matteo@mercxry.me>
* add missing keys and a readme about the script
---------
Co-authored-by: Utku <74243531+utkubakir@users.noreply.github.com>
Co-authored-by: Matteo Martellini <matteo@mercxry.me>
commit 28328034f0
Author: jake <77554505+brxken128@users.noreply.github.com>
Date: Mon Feb 26 15:17:28 2024 +0000
Clean-up MacOS window closing behaviour code (#2124)
* fix: delete dead/unused file
* refactor: add the window event handler with the rest of them
* refactor: formatting
commit aa0b4abf85
Author: Oscar Beaumont <oscar@otbeaumont.me>
Date: Mon Feb 26 15:23:48 2024 +0800
rspc over P2P (#2112)
* wip: rspc over p2p
* wip
* rspc over P2P
* Cleanup + error handling
* slight cleanup
* Using Hyper for HTTP streaming + websockets
commit f7a7b00e37
Author: Utku <74243531+utkubakir@users.noreply.github.com>
Date: Fri Feb 23 11:26:58 2024 -0500
Fix android thumbs (#2121)
* replace react-native-fs with an active fork
* time sink
* fix
commit 6358c574c9
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Fri Feb 23 00:28:35 2024 +0300
Mob: cleanup warning (#2122)
Update Categories.tsx
commit a4b7296b45
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Thu Feb 22 16:08:41 2024 +0300
MOB: Settings paddings (#2120)
padding tweaks
commit d007b55763
Author: nikec <43032218+niikeec@users.noreply.github.com>
Date: Thu Feb 22 13:53:02 2024 +0100
[ENG-1619] Add spacedrop to the context menu (#2119)
add spacedrop to context menu
commit dd0acad2e7
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Thu Feb 22 15:47:08 2024 +0300
[ENG-1618] Spacedrop UI (#2118)
* spacedrop ui update
* i18n and description
* glitch: remove !
* already in progress i18n
* more i18n
commit a17fb910ed
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Thu Feb 22 15:20:31 2024 +0300
[MOB-62] Spacing & padding tweaks (#2117)
Spacing & padding tweaks
commit 6a32752243
Author: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
Date: Thu Feb 22 03:15:36 2024 -0300
Fix core test and CI breaking (#2116)
Fix core test passing inverted arguments to sync_db_entry macro
commit da4f038669
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Wed Feb 21 17:19:40 2024 +0300
Mob: better visually width fitting for categories (#2114)
* Visually width fitting for categories
* remove padding
commit 3bdcc05c2d
Author: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
Date: Wed Feb 21 11:18:15 2024 -0300
Fix mobile CI + Some small CI improvements (#2113)
Fix mobile CI
- Use rust envvars in all workflows
- Use rust envvars and mold when build sd-server docker
commit b638fc2177
Author: Utku <74243531+utkubakir@users.noreply.github.com>
Date: Wed Feb 21 08:26:05 2024 -0500
[MOB-37, MOB-38, MOB-39] Preview for PDF, Text and Media files (#2098)
* version & microphonePermission text & eslint
* remove polyfill as hermes supports intl now
* why do we have solid on mobile?
* cleanup
* add solid back =_=
* pnpm lock
* we hate relative paths here
* android config
* open file logic
* visual tweaks
---------
Co-authored-by: ameer2468 <33054370+ameer2468@users.noreply.github.com>
commit c533d12df0
Author: Brendan Allan <brendonovich@outlook.com>
Date: Wed Feb 21 22:42:10 2024 +1100
media data sync (#2102)
* basic sync operation backfill
* media data sync
* sync entry helpers
* fix sync generator
* nicer
* re-add key_id
commit 393a907b57
Author: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
Date: Wed Feb 21 06:27:40 2024 -0300
Update github actions due to nodejs 16 deprecation (#2107)
* Update github actions due to nodejs 16 deprecation
- Replace archived actions-rs/clippy-check with maintained fork actions-rs-plus/clippy-check
- Replace redhat-actions/push-to-registry with updated fork Eusebiotrigo/push-to-registry
- Point redhat-actions/buildah-build and softprops/action-gh-release to current master to fix nodejs deprecation
* Build the correct ios core rust arch for CI runs
* Build ios app for the same arch as the host in Mobile CI
* Some changes to try and make cache-factory faster and avoid failing so much
* Add trigger to run cache-factory on pull requests when there are changes to itself
* Attempt to fix sed usage on macOS
* Don't treat warning as errors
* Fix windows
* Fix windows 2
* Use target ad cache key for rust to differentiate between macOS x86_64 and arm64
* Use faster/better linkers to compile for macOS, Linux and Windows
* Fix missing shell in action
* Fix typo
* Fix missing shell in action 2
* Fix mold download
- Replace bsdtar with plain tar
* Fix permission denied when extracting mold
* Remove zld
* Don't restore cache for rustfmt
- Remove target symlink to C:/ in an attempt to speed-up windows CI
* Fix typo
* Restore target symlink on windows
- Removing it didn't make CI faster
* Run Mobile on macos-14
commit 519b1b6c46
Author: Oscar Beaumont <oscar@otbeaumont.me>
Date: Wed Feb 21 16:13:40 2024 +0800
Fix P2P not working for libraries (#2031)
* P2P Debug route
* Remove legacy peer to peer pairing process
* Fix error typo
* Sync instances with cloud
* Upgrade deps + extended instance data
* Create instance with extended metadata
* Auto sync instances
* Actually `.await`
* bruh
* sync library info
* this isn't gonna work
* only sleep cloud receiver when no more messages (#1985)
* [ENG-1567] Fix renaming (#1986)
fix rename
* only sleep cloud receiver when no more messages
* use in memory instances during cloud receive (#1995)
* use in memory instances during cloud receive
* is_empty
---------
Co-authored-by: nikec <43032218+niikeec@users.noreply.github.com>
* fix type error
* wip
* make mdns mdns better
* rebuild state
* Add hooks + listeners + discovered state
* Split into crates
* wip fixing core + wip merging Spacetime into `sd-p2p2`
* `SmartLockGuard` + `Listener`
* Make `sd-core` compile
* Reenable all operation receivers
* Fix all broken code within `sd-core`
* minor fixes found in review
* Bring in `libp2p` + restructure `sd-p2p` for the gazillion-th time
* whoops
* Compile no matter the (runtime) cost
* fixing merge issues
* wip
* a
* b
* C
* Handle port betterer
* c
* Migrate node config
* a
* no crash on startup
* wip
* a
* jdfhskjfsg
* a
* fix discovery
* a bunch of fixes
* getting Spacedrop working
* I don't get why it no worky
* debug example
* a
* wip
* wip
* removing logging from stream impl
* wip: shit is fucked
* Redo quic integration + Spacedrop working
* Fix shutdown - deadlocks + shutdown peers
* Add Prisma migrations
* Fix shutdown
* a
* fix
* cleanup
* The lord clippy hath spoken
* disable P2P settings for now
---------
Co-authored-by: Brendan Allan <brendonovich@outlook.com>
Co-authored-by: nikec <43032218+niikeec@users.noreply.github.com>
commit af8dbf7789
Author: Julian Braha <julianbraha@gmail.com>
Date: Tue Feb 20 20:06:05 2024 +0000
Improve error handling by using decode::Error instead of io::Result (#2078)
Use decode::Error instead of io::Result
commit 84dadffa81
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Tue Feb 20 22:59:11 2024 +0300
[MOB-59] Empty UI for locations and tags screen (#2110)
Empty UI for locations and tags screen
commit 9fc38d866a
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Tue Feb 20 22:47:14 2024 +0300
[MOB-60] locations & tags query invalidation on updates (#2111)
Trigger UI updates on location adding/delete and tags
lint
name
commit abd5ecbe8d
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Tue Feb 20 13:05:53 2024 +0300
mousedown fix (#2108)
quick mistake fix
commit 9bc1a472a8
Author: Brendan Allan <brendonovich@outlook.com>
Date: Tue Feb 20 20:22:34 2024 +1100
Basic sync operation backfill (#2101)
* basic sync operation backfill
* no changes
commit 2a283479e6
Author: Arnab Chakraborty <11457760+Rocky43007@users.noreply.github.com>
Date: Tue Feb 20 01:33:52 2024 -0500
New Android Build Script (#2096)
* New Android Build Script
* Clean up + Works for CI now
* Simplify android build.sh
- Fix /var/home/vitor fallback for Linux systems
- Run a single cargo ndk for all targets (not parallel build, but a bit faster)
- Fix android target s/x86/x86_64/
- Format setup.sh
- Minor improvements to rust mobile targets installation step in setup.sh
* Add notice to CONTRIBUTING that only Java <= 17 is supported for building android
- Make prettier ignore some mobile build artifacts
* When in CI, Fix build android core for host architecture
---------
Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
commit 19b224370e
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Mon Feb 19 23:45:29 2024 +0300
[ENG-1615] bg intro video fixed (#2104)
* video intro bg
* test hsl
* test video bg
* run tests
* comment
* mob intro
* git glitch
* git
* webm type
commit 43360601da
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Mon Feb 19 19:12:11 2024 +0300
[MOB-58] Settings routes new design & more (#2103)
* wip: redesigning settings pages
* Edit location redesign & more
* right actions
* cleanup
commit e8450821df
Author: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Date: Mon Feb 19 18:23:20 2024 +0300
[ENG-1612] Fix mouse nav forwards and backwards (#2105)
Fix mouse nav forwards and backwards
* Clean up commented code
* Clean up + Remove `LocationOnboarding.tsx`
* Fix some problems with the AI system
- Fix downloading model using an internal rust string representation as path for the model file
- Fix Linux loading onnx shared lib from a hardcoded path
- Fix App should not crash when the AI system fails to start
- Fix sd-server failing to start due to onnxruntime incorrect linking
- Some extra clippy auto fixes
* Use latest ort
* Fix dangling sd_ai reference
- Use entrypoint.sh to initilize container
* Fix server Dockerfile
- Fix cargo warning
* Workaround intro video breaking onboarding for the web version
* Fix rebase
