Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.
Go to file
Vítor Vasconcellos 2e6e00bc6d
[ENG-1184, ENG-1286, ENG-1330] Rework native dependencies (+ deb fixes) (#1685)
* Almost working

* Downgrade libplacebo
 - FFMpeg 6.0 uses some now removed deprecated functions

* Use -Oz for zimg

* Fix CI script to run the new ffmpeg build script

* Fix heif step name + Ignore docker cache while building in CI

* Fix Opencl build on linux

* Fix adding incorrect -target argument to linker
 - Update zig for windows target

* Disable opengl for ffmpeg, it only uses it as an outdev, not for processing
 - Disable opengl and directx for libplacebo, ffmpeg only supports vulkan when using it
 - Add WIN32_LEAN_AND_MEAN to global cflags to optimize windows api usage
 - Fix 99-heif.sh incorrect bsdtar flag

* Remove WIN32_LEAN_AND_MEAN from global CFLAGS as that was breaking OpenCL build
 - Fix Dockerfile step for cleaning up the out dir
 - Improve licensing handling

* x86_64 windows and linux builds are working

* Fix aarch64 build for windows and linux

* Fix symbol visibility in linux builds
 - Fix soxr failing to download due to sourcefourge
 - Only patch zimg on windows targets
 - Tell cmake to hide libheif symbols

* Fix Linux .so rpath
 - Add lzo dependency
 - Publish source for the built libs
 - Add warning for missing nasm in tauri.mjs
 - Remove ffmpeg install from setup.sh
 - Add download logic for our linux ffmpeg bundle in preprep.mjs

* Remove jobs, docker doesn't support this

* Fix typing

* Change ffmpeg references to native deps
 - Rename FFMpeg.framework to Spacedrive.framework
 - Centralize the macOS native deps build with the windows and linux one
 - Change the preprep script to only download our native deps
 - Remove old macOS ffmpeg build scripts

* Compress native deps before creating github artifact
 - The zip implementation for github artifact does not mantain symlinks and permissions
 - Remove conditional protoc, it is now always included

* Don't strip dylibs, it was breaking them
 - Only download macOS Framework for darwin targets
 - Fix preprep script
 - Improve README.md for native-deps
 - Fix not finding native-deps src

* Attempt to fix macOS dylib

* Fix macOS dylibs
 - Replace lld.ld64 with apple's own linker
 - Add stages for building apple's compiler tools to use instead of LLVM ones

* Ensure sourced file exists

* All targets should build now
 - Fix environment sourcing in build.sh
 - Some minor improvements to cc.sh
 - Fix incorrect flag in zlib.sh
 - Improve how -f[...] flags are passed to compiler and linker
 - Add more stack hardening flags

* We now can support macOS 11.0 on arm64

* Improve macOS Framework generation
 - Remove installed unused deps
 - Improve cleanup and organization logic in Dockerfile last step
 - Move libav* .dll.a to .lib to fix missing files in windows target
 - Remove apple tools from /srv folder after installation to prevent their files from being copied by other stage steps
 - Create all the necessary symlinks for the macOS targets while building
 - Remove symlink logic for macOS target from preprep.mjs

* Remove native-deps from spacedrive repo
 - It now resides in https://github.com/spacedriveapp/native-deps
 - Modify preprep script to dowload native-deps from new location
 - Remove Github API code from scripts (not needed anymore)
 - Add flock.mjs to allow running tauri.mjs cleanup as soon as cargo finishes building in linux

* Handle flock not present in system
 - Allow macOS to try using flock

* Fix preprep on macOS

* Add script that patch deb to fix errors and warnings raised by lintian

* Fix ctrl+c/ctrl+v typo

* Remove gstreamer1.0-gtk3 from deb dependencies

* eval is evil

* Handle tauri build release with an explicit target in fix-deb.sh

* Preserve environment variables when re-executing fix-deb with sudo

* Only execute fix-deb.sh when building a deb bundle

* Improvements fix-deb.sh

* Improve setup.sh (Add experiemental alpine support)
2023-11-17 19:20:14 +00:00
.cargo [ENG-1184, ENG-1286, ENG-1330] Rework native dependencies (+ deb fixes) (#1685) 2023-11-17 19:20:14 +00:00
.cspell Release landing page (#1464) 2023-10-11 04:05:40 +00:00
.github [ENG-1184, ENG-1286, ENG-1330] Rework native dependencies (+ deb fixes) (#1685) 2023-11-17 19:20:14 +00:00
.vscode Frontend misc fixes and deps update (#1650) 2023-10-24 07:51:58 +00:00
apps [ENG-1184, ENG-1286, ENG-1330] Rework native dependencies (+ deb fixes) (#1685) 2023-11-17 19:20:14 +00:00
core [ENG-1269] Search options (#1561) 2023-11-17 06:58:44 +00:00
crates [ENG-1184, ENG-1286, ENG-1330] Rework native dependencies (+ deb fixes) (#1685) 2023-11-17 19:20:14 +00:00
docs [ENG-1269] Search options (#1561) 2023-11-17 06:58:44 +00:00
extensions Linted Files according to the .prettierrc. 2022-04-24 21:16:55 +01:00
interface [ENG-1444] Fix list view observer (#1793) 2023-11-17 18:17:18 +00:00
packages [ENG-1269] Search options (#1561) 2023-11-17 06:58:44 +00:00
scripts [ENG-1184, ENG-1286, ENG-1330] Rework native dependencies (+ deb fixes) (#1685) 2023-11-17 19:20:14 +00:00
.clippy.toml [ENG-835] Duplicating an empty directory doesn't duplicate nested empty directories (#1213) 2023-08-13 18:34:46 +00:00
.editorconfig [ENG-767, ENG-916] Improvements and fixes for Open/Open With (#1082) 2023-07-24 17:36:00 +00:00
.eslintignore Fix Windows CI + format (#767) 2023-04-27 07:32:15 +00:00
.gitattributes [ENG-469] Make Prettier and ESLint work together (#706) 2023-04-14 21:21:21 +00:00
.gitignore [ENG-927, ENG-735, ENG-766] Fix Updater & Tauri 1.5 (#1361) 2023-10-10 07:30:56 +00:00
.npmrc [ENG-265] Improve setup scripts (#1368) 2023-09-28 10:03:46 +00:00
.nvmrc Bump .nvmrc version (#1605) 2023-10-17 03:58:50 +00:00
.prettierignore Fix adding locations to mobile application (#1681) 2023-11-01 14:28:23 +00:00
.prettierrc.js [ENG-1067] Update phosphor to new package & update sort imports (#1330) 2023-09-11 15:26:44 +00:00
.rustfmt.toml Added crates folder (#389) 2022-09-29 21:02:29 -07:00
Cargo.lock [ENG-1269] Search options (#1561) 2023-11-17 06:58:44 +00:00
Cargo.toml Update tokio's version (#1761) 2023-11-10 20:37:21 +00:00
CODE_OF_CONDUCT.md New team page (#229) 2022-06-14 13:13:09 -07:00
CONTRIBUTING.md fix: dev tools shortcut (#1450) 2023-10-10 17:16:47 +00:00
cspell.config.yaml cleanup(don't hate me): prettier format everything 2023-01-19 19:32:35 -08:00
LICENSE Switch license to AGPL (#307) 2022-07-02 14:26:00 -07:00
package.json Remove < 21 node restriction (#1728) 2023-11-04 03:44:07 +00:00
pnpm-lock.yaml [ENG-1269] Search options (#1561) 2023-11-17 06:58:44 +00:00
pnpm-workspace.yaml Tauri 1.5.2 + normalize and update frontend dev deps (#1579) 2023-10-14 04:27:09 +00:00
README.md fix: changed "Twitter" Logo "𝕏" in README.md (#1692) 2023-10-28 19:31:09 +00:00
SECURITY.md [ENG-1165] Add a security policy and notices to the appropriate READMEs (#1409) 2023-09-30 08:31:38 +00:00
tsconfig.json [ENG-380] Interface code structure improvement (#581) 2023-02-27 21:29:48 -08:00
turbo.json [ENG-927, ENG-735, ENG-766] Fix Updater & Tauri 1.5 (#1361) 2023-10-10 07:30:56 +00:00

Logo

Spacedrive

A file explorer from the future.
spacedrive.com »

Download for macOS (Apple Silicon | Intel) · Windows · Linux · iOS · Android
~ Links for iOS & Android will be added once a release is available. ~

Spacedrive is an open source cross-platform file manager, powered by a virtual distributed filesystem (VDFS) written in Rust.

UPDATE: Spacedrive is under active development, we are in the alpha stage and some features might be missing or disabled in the official release downloads.

Organize files across many devices in one place. From cloud services to offline hard drives, Spacedrive combines the storage capacity and processing power of your devices into one personal distributed cloud, that is both secure and intuitive to use.

For independent creatives, hoarders and those that want to own their digital footprint, Spacedrive provides a free file management experience like no other.

App screenshot


What is a VDFS?

A VDFS (virtual distributed filesystem) is a filesystem designed to work across a variety of storage layers. With a uniform API to manipulate and access content across many devices, VDFS is not restricted to a single machine. It achieves this by maintaining a virtual index of all storage locations, synchronizing the database between clients in realtime. This implementation also uses CAS (Content-addressable storage) to uniquely identify files, while keeping record of logical file paths relative to the storage locations.

The first implementation of a VDFS can be found in this UC Berkeley paper by Haoyuan Li. This paper describes its use for cloud computing, however the underlying concepts can be translated to open consumer software.

Motivation

Many of us have multiple cloud accounts, drives that arent backed up and data at risk of loss. We depend on cloud services like Google Photos and iCloud, but are locked in with limited capacity and almost zero interoperability between services and operating systems. Photo albums shouldnt be stuck in a device ecosystem, or harvested for advertising data. They should be OS agnostic, permanent and personally owned. Data we create is our legacy, that will long outlive us—open source technology is the only way to ensure we retain absolute control over the data that defines our lives, at unlimited scale.

Roadmap

View a list of our planned features here: spacedrive.com/roadmap

Developer Guide

Please refer to the contributing guide for how to install Spacedrive from sources.

Security Policy

Please refer to the security policy for details and information on how to responsibly report a security vulnerability or issue.

Architecture

This project is using what I'm calling the "PRRTT" stack (Prisma, Rust, React, TypeScript, Tauri).

  • Prisma on the front-end? 🤯 Made possible thanks to prisma-client-rust, developed by Brendonovich. Gives us access to the powerful migration CLI in development, along with the Prisma syntax for our schema. The application bundles with the Prisma query engine and codegen for a beautiful Rust API. Our lightweight migration runner is custom built for a desktop app context.
  • Tauri allows us to create a pure Rust native OS webview, without the overhead of your average Electron app. This brings the bundle size and average memory usage down dramatically. It also contributes to a more native feel, especially on macOS due to Safari's close integration with the OS.
  • We also use rspc which allows us to define functions in Rust and call them on the Typescript frontend in a completely typesafe manner, so no unnecessary bugs make it into production!
  • The core (sdcore) is written in pure Rust.

Monorepo structure:

Apps:

Core:

  • core: The Rust core, referred to internally as sdcore. Contains filesystem, database and networking logic. Can be deployed in a variety of host applications.

Packages:

  • client: A TypeScript client library to handle dataflow via RPC between UI and the Rust core.
  • ui: A React Shared component library.
  • interface: The complete user interface in React (used by apps desktop, web and landing)
  • config: eslint configurations (includes eslint-config-next, eslint-config-prettier and all tsconfig.json configs used throughout the monorepo.
  • macos: A Swift Native binary for MacOS system extensions.
  • ios: A Swift Native binary (planned).
  • windows: A C# Native binary (planned).
  • android: A Kotlin Native binary (planned).