Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.
Go to file
Vítor Vasconcellos 1c7855ded6
[ENG-630] Windows ffmpeg + libheif custom build (#871)
* Initial Windows ffmpeg + libheif custom build

* Add build steps for most of ffmpeg deps

* FFmpeg deps and libheif

* Fix libheif build

* Fix libvpx and dlfcn + attempt to fix rav1e

* Rework the whole ffmpeg-windows build system
 - New system based on https://github.com/BtbN/FFmpeg-Builds
 - Add new ffmpeg-windows workflow
 - Rename macos ffmpeg workflow
 - Adapt macos setupt script due to above name change

* Forgot to update update the workflow name

* Strip all libs from debug symbols

* Add docs

* Add libde265 deps, required by libheif
 - Make x265, svtav1 and dav1d as shared deps (used by both ffmpeg and libheif)

* Add missing libheif to Linux setup script

* Fix libx265 build script

* Forgot to point x265 ninja install to the correct directory

* Remove libaom and libsvt-av1
 - dav1d and rav1d are our default AV1 decoders/encoders
 - Quote subshell executions
 - Make libweb shared

* Forgot to remove libaom and libsvt-av1 build steps

* Fix typo

* Try force webp to link against static libs

* Revert libwebp to a static build

* Dumb typo

* Modify windows script to download our ffmpeg build (WIP)

* Fix dlls output folder structure

* Fix dumb mistake

* Remove unused ffbuild_enabled

* Enable core's heif feature on Windows
 - Fix windows ffmpeg build not including the headers
 - Fix windows setupt script incorrect download loagic
 - Implement build_arg to pass which repo ref to use when cloning

* Fix windows setup script

* Fix workflow artifact path
 - Make ffmpeg-windows dockerfile respect the FFMPEG_VERSION env

* Fix Windows setup script incorrect logic for downloading ffmpeg builds

* Error out when workflow_runs is empty

* Fix dumb mistake

* Manually define ffmpeg version for windows script

* Fix ffmpeg windows build extract logic

* Fix prop access in windows setup script

* Revert back to a web request because nightly.link does a redirect before serving the artifact content

* Fix windows setup script

* Do not use nightly.link in Github CI

* Fix windows setup script

* Should finally fix window setup script
 - Update ffmpeg-windows deps
 - Should fix ffmpeg-windows failing to build due to mingw changes in new base image

* Fix libxz failing to build due to doxygen

* Fix windows setup-script not executing till the end

* Fix LASTEXITCODE not defined

* Remove libjxl, deps are not being compiled

* Fix dll and lib copy logic

* Move final copy dll logic to external script

* Use main for libjxl

* Change brotli from stable to main
 - Attempt to fix libjxl

* Attempt fix lib copy again

* Split copy_dll logic to avoid cache burst in docker

* Missing file

* Change how to export build files from shared deps

* Replace rsync with cp

* Fix copy

* Fix dir not existing

* Fix pkgconfig

* Remove superflous files from exported ffmpeg for windows
 - Adjust dav1d to not build tools and examples
 - Adjust windows setup-script to point linker to the libs directory

* Fix dav1d meson config args

* Fix dumb mistake

* WORK PLZ

* Fix .lib file location
 - Strip all dlls

* Formatter
2023-06-10 15:23:37 +00:00
.cargo [ENG-603] Support HEIC images (#834) 2023-05-20 06:40:37 +00:00
.cspell [ENG-581, ENG-597, ENG-600] Overview categories (#779) 2023-05-17 20:34:05 +00:00
.github [ENG-630] Windows ffmpeg + libheif custom build (#871) 2023-06-10 15:23:37 +00:00
.vscode [MOB-3] Small fixes and improvements (#813) 2023-06-08 16:06:17 +00:00
apps [ENG-630] Windows ffmpeg + libheif custom build (#871) 2023-06-10 15:23:37 +00:00
core [ENG-630] Windows ffmpeg + libheif custom build (#871) 2023-06-10 15:23:37 +00:00
crates [ENG-674] fix invalidation (#891) 2023-05-31 08:55:46 +00:00
docs fix icon & run pnpm format and lint fix (#859) 2023-05-25 14:49:54 +00:00
extensions Linted Files according to the .prettierrc. 2022-04-24 21:16:55 +01:00
interface [ENG-640, ENG-695, ENG-705, ENG-693] Categories arrow buttons + others (#851) 2023-06-10 12:25:46 +00:00
packages [ENG-640, ENG-695, ENG-705, ENG-693] Categories arrow buttons + others (#851) 2023-06-10 12:25:46 +00:00
.editorconfig [ENG-640, ENG-695, ENG-705, ENG-693] Categories arrow buttons + others (#851) 2023-06-10 12:25:46 +00:00
.eslintignore Fix Windows CI + format (#767) 2023-04-27 07:32:15 +00:00
.gitattributes [ENG-469] Make Prettier and ESLint work together (#706) 2023-04-14 21:21:21 +00:00
.gitignore [ENG-659] Spacedrive On Jamie's NAS (#866) 2023-05-29 10:47:59 +00:00
.gitmodules tests for magic bytes 2022-10-06 09:48:55 -07:00
.npmrc Fix pnpm format command failing with some files (#622) 2023-03-19 16:47:10 +00:00
.nvmrc Bump node to lts (v18) 2022-12-14 12:43:02 +03:00
.prettierignore fix icon & run pnpm format and lint fix (#859) 2023-05-25 14:49:54 +00:00
.prettierrc.js Prettier & Format (#668) 2023-04-04 05:39:07 +00:00
.rustfmt.toml Added crates folder (#389) 2022-09-29 21:02:29 -07:00
Cargo.lock [ENG-708] Thumbnail sharding (#925) 2023-06-08 07:13:45 +00:00
Cargo.toml [ENG-679] Reserve ids for built in indexer rules (#909) 2023-06-06 14:42:52 +00:00
CODE_OF_CONDUCT.md New team page (#229) 2022-06-14 13:13:09 -07:00
CONTRIBUTING.md [ENG-270, ENG-213] Stabilize release pipeline (#768) 2023-05-15 18:02:56 +00:00
cspell.config.yaml cleanup(don't hate me): prettier format everything 2023-01-19 19:32:35 -08:00
LICENSE Switch license to AGPL (#307) 2022-07-02 14:26:00 -07:00
package.json [ENG-640, ENG-695, ENG-705, ENG-693] Categories arrow buttons + others (#851) 2023-06-10 12:25:46 +00:00
pnpm-lock.yaml [ENG-640, ENG-695, ENG-705, ENG-693] Categories arrow buttons + others (#851) 2023-06-10 12:25:46 +00:00
pnpm-workspace.yaml [ENG-380] Interface code structure improvement (#581) 2023-02-27 21:29:48 -08:00
README.md rspc 0.1.3 prep (#756) 2023-04-25 15:14:52 +08:00
tsconfig.json [ENG-380] Interface code structure improvement (#581) 2023-02-27 21:29:48 -08:00
turbo.json [ENG-469] Make Prettier and ESLint work together (#706) 2023-04-14 21:21:21 +00:00

Logo

Spacedrive

A file explorer from the future.
spacedrive.com »

Download for macOS · Windows · Linux · iOS · watchOS · Android
~ Links will be added once a release is available. ~

Spacedrive is an open source cross-platform file manager, powered by a virtual distributed filesystem (VDFS) written in Rust.

NOTE: Spacedrive is under active development, most of the listed features are still experimental and subject to change.

Organize files across many devices in one place. From cloud services to offline hard drives, Spacedrive combines the storage capacity and processing power of your devices into one personal distributed cloud, that is both secure and intuitive to use.

For independent creatives, hoarders and those that want to own their digital footprint, Spacedrive provides a free file management experience like no other.

App screenshot


What is a VDFS?

A VDFS (virtual distributed filesystem) is a filesystem designed to work across a variety of storage layers. With a uniform API to manipulate and access content across many devices, VDFS is not restricted to a single machine. It achieves this by maintaining a virtual index of all storage locations, synchronizing the database between clients in realtime. This implementation also uses CAS (Content-addressable storage) to uniquely identify files, while keeping record of logical file paths relative to the storage locations.

The first implementation of a VDFS can be found in this UC Berkeley paper by Haoyuan Li. This paper describes its use for cloud computing, however the underlying concepts can be translated to open consumer software.

Motivation

Many of us have multiple cloud accounts, drives that arent backed up and data at risk of loss. We depend on cloud services like Google Photos and iCloud, but are locked in with limited capacity and almost zero interoperability between services and operating systems. Photo albums shouldnt be stuck in a device ecosystem, or harvested for advertising data. They should be OS agnostic, permanent and personally owned. Data we create is our legacy, that will long outlive us—open source technology is the only way to ensure we retain absolute control over the data that defines our lives, at unlimited scale.

Roadmap

View a list of our planned features here: spacedrive.com/roadmap

Developer Guide

Please refer to the contributing guide for how to install Spacedrive from sources.

Architecture

This project is using what I'm calling the "PRRTT" stack (Prisma, Rust, React, TypeScript, Tauri).

  • Prisma on the front-end? 🤯 Made possible thanks to prisma-client-rust, developed by Brendonovich. Gives us access to the powerful migration CLI in development, along with the Prisma syntax for our schema. The application bundles with the Prisma query engine and codegen for a beautiful Rust API. Our lightweight migration runner is custom built for a desktop app context.
  • Tauri allows us to create a pure Rust native OS webview, without the overhead of your average Electron app. This brings the bundle size and average memory usage down dramatically. It also contributes to a more native feel, especially on macOS due to Safari's close integration with the OS.
  • We also use rspc which allows us to define functions in Rust and call them on the Typescript frontend in a completely typesafe manner, so no unnecessary bugs make it into production!
  • The core (sdcore) is written in pure Rust.

Monorepo structure:

Apps:

Core:

  • core: The Rust core, referred to internally as sdcore. Contains filesystem, database and networking logic. Can be deployed in a variety of host applications.

Packages:

  • client: A TypeScript client library to handle dataflow via RPC between UI and the Rust core.
  • ui: A React Shared component library.
  • interface: The complete user interface in React (used by apps desktop, web and landing)
  • config: eslint configurations (includes eslint-config-next, eslint-config-prettier and all tsconfig.json configs used throughout the monorepo.
  • macos: A Swift Native binary for MacOS system extensions.
  • ios: A Swift Native binary (planned).
  • windows: A C# Native binary (planned).
  • android: A Kotlin Native binary (planned).