spacedrive/README.md

162 lines
9.4 KiB
Markdown
Raw Normal View History

2021-12-29 07:26:48 +00:00
<p align="center">
2021-12-29 07:35:45 +00:00
<a href="#">
</a>
<p align="center">
2022-04-23 04:52:19 +00:00
<img width="150" height="150" src="https://raw.githubusercontent.com/spacedriveapp/.github/main/profile/spacedrive_icon.png" alt="Logo">
</p>
2022-03-11 18:54:28 +00:00
<h1 align="center"><b>Spacedrive</b></h1>
2021-12-29 07:26:48 +00:00
<p align="center">
The universal file manager.
2021-12-29 07:26:48 +00:00
<br />
2022-04-22 23:02:40 +00:00
<a href="https://spacedrive.app"><strong>spacedrive.app »</strong></a>
2021-12-29 07:26:48 +00:00
<br />
<br />
2021-12-29 11:25:13 +00:00
<b>Download for </b>
2022-04-23 12:29:04 +00:00
macOS
2021-12-29 07:26:48 +00:00
·
2022-04-23 12:29:04 +00:00
Windows
2021-12-29 07:26:48 +00:00
·
2022-04-23 12:29:04 +00:00
Linux
2021-12-29 11:25:13 +00:00
·
2021-12-29 16:33:42 +00:00
iOS
2021-12-29 11:25:13 +00:00
·
2021-12-29 16:33:42 +00:00
watchOS
2021-12-29 11:25:13 +00:00
·
2021-12-29 16:33:42 +00:00
Android
2022-04-23 12:29:04 +00:00
<br />
<i>~ links will be added once release available ~</i>
2021-12-29 07:26:48 +00:00
</p>
</p>
Spacedrive is an open source cross-platform file manager, powered by a virtual distributed filesystem (<a href="#what-is-a-vdfs">VDFS</a>) written in Rust.
<!-- <a href="https://spacedrive.app"><strong>Learn more »</strong></a> -->
2022-03-14 16:51:36 +00:00
<br/>
<br/>
2022-03-25 08:39:16 +00:00
Organize files across many devices in one place. From cloud services to offline hard drives, Spacedrive combines the storage capacity and processing power of your devices into one personal distributed cloud, that is both secure and intuitive to use.
2022-03-10 07:08:17 +00:00
<br />
<br />
2022-03-25 08:39:16 +00:00
For independent creatives, hoarders and those that want to own their digital footprint. Spacedrive provides a file management experience like no other, and its completely free.
2022-03-10 07:08:17 +00:00
<br />
<br />
2022-04-22 04:34:27 +00:00
<p align="center">
<img src="https://raw.githubusercontent.com/spacedriveapp/.github/main/profile/spacedrive_screenshot.jpg" alt="Logo">
<br />
<br />
2022-04-23 12:21:01 +00:00
<a href="https://discord.gg/gTaF2Z44f5">
<img src="https://img.shields.io/discord/949090953497567312?label=Discord&color=5865F2" />
</a>
2022-04-22 04:34:27 +00:00
<a href="https://twitter.com/spacedriveapp">
<img src="https://img.shields.io/badge/Twitter-00acee?logo=twitter&logoColor=white" />
</a>
<a href="https://instagram.com/spacedriveapp">
<img src="https://img.shields.io/badge/Instagram-E4405F?logo=instagram&logoColor=white" />
</a>
<img src="https://img.shields.io/static/v1?label=Licence&message=GNU%20v3&color=000" />
<img src="https://img.shields.io/static/v1?label=Bundled%20Size&message=16.3MB&color=0974B4" />
<img src="https://img.shields.io/static/v1?label=Stage&message=Alpha&color=2BB4AB" />
<br />
</p>
> NOTE: Spacedrive is under active development, most of the listed features are still experimental and subject to change. Additionally, most of the links on this page are broken but will be working once the repository is made public.
2021-12-29 05:44:39 +00:00
2022-04-03 00:02:17 +00:00
# What is a VDFS?
A VDFS (virtual distributed filesystem) is a filesystem designed to work atop a variety of storage layers. It is not restricted to a single machine, with a uniform API to manipulate and access content across many devices. It achieves this by maintaining a virtual index of all storage locations, synchronizing the database between clients in realtime. This implementation also uses [CAS](https://en.wikipedia.org/wiki/Content-addressable_storage) (Content-addressable storage) to uniquely identify files, while keeping record of logical file paths relative to the storage locations.
The first implementation of a VDFS can be found in this UC Berkeley [paper](https://www2.eecs.berkeley.edu/Pubs/TechRpts/2018/EECS-2018-29.pdf) by Haoyuan Li. This paper describes its use for cloud computing, however the underlying concepts can be translated to open consumer software.
2022-04-03 00:02:17 +00:00
# Motivation
Many of us have multiple cloud accounts, drives that arent backed up and data at risk of loss. We depend on cloud services like Google Photos and iCloud, but are locked in with limited capacity and almost zero interoperability between services and operating systems. Photo albums shouldnt be suck in a device ecosystem, or harvested for advertising data. They should be OS agnostic, permanent and personally owned. Data we create is our legacy, that will long outlive us—open source technology is the only way to ensure we retain absolute control over the data that defines our lives, at unlimited scale.
2022-04-03 00:02:17 +00:00
2022-03-10 07:08:17 +00:00
# Features
2022-04-23 12:29:04 +00:00
_Note: Links are for highlight purposes only until feature specific documentation is complete._
**Complete:** _(in testing)_
2022-04-23 12:29:04 +00:00
- **[File discovery](#features)** - Scan devices, drives and cloud accounts to build a directory of all files with metadata.
- **[Preview generation](#features)** - Auto generate lower resolution stand-ins for image and video.
- **[Statistics](#features)** - Total capacity, index size, preview media size, free space etc.
2022-03-10 07:08:17 +00:00
**In progress:**
- **[File Explorer](#features)** - Browse online/offline storage locations, view files with metadata, perform basic CRUD.
2022-04-23 12:29:04 +00:00
- **[Realtime synchronization](#features)** - Data index synchronized in realtime between devices, prioritizing peer-to-peer LAN connections (WiFi sync).
**To be developed (MVP):**
2022-04-23 12:29:04 +00:00
- **[Photos](#features)** - Photo and video albums similar to Apple/Google photos.
- **[Search](#features)** - Deep search into your filesystem with a keybind, including offline locations.
- **[Tags](#features)** - Define routines on custom tags to automate workflows, easily tag files individually, in bulk and automatically via rules.
- **[Extensions](#features)** - Build tools on top of Spacedrive, extend functionality and integrate third party services. Extension directory on [spacedrive.app/extensions](#features).
**To be developed (Post-MVP):**
2022-04-23 12:29:04 +00:00
- **[Cloud integration](#features)** - Index & backup to Apple Photos, Google Drive, Dropbox, OneDrive & Mega + easy API for the community to add more.
- **[Encrypted vault(s)](#features)** - Effortlessly manage & encrypt sensitive files, built on top of VeraCrypt. Encrypt individual files or create flexible-size vaults.
- **[Key manager](#features)** - View, mount, dismount and hide keys. Mounted keys automatically unlock respective areas of your filesystem.
- **[Redundancy Goal](#features)** - Ensure a specific amount of copies exist for your important data, discover at-risk files and monitor device/drive health.
- **[Timeline](#features)** - View a linear timeline of content, travel to any time and see media represented visually.
- **[Media encoder](#features)** - Encode video and audio into various formats, use Tags to automate. Built with FFMPEG.
- **[Workers](#features)** - Utilize the compute power of your devices in unison to encode and perform tasks at increased speeds.
- **[Spacedrive Cloud](#features)** - We'll host an always-on cloud device for you, with pay-as-you-go plans for storage.
- **[Self hosted](#features)** - Spacedrive can be deployed as a service, behaving as just another device powering your personal cloud.
2021-12-29 05:44:39 +00:00
2022-04-01 03:21:36 +00:00
# Developer Installation Instructions
This environment uses [Cargo](https://doc.rust-lang.org/cargo/getting-started/installation.html) and [pnpm](https://pnpm.io/installation). Ensure you have them installed before continuing.
- `$ git clone https://github.com/spacedriveapp/spacedrive`
- IMPORTANT: _Install [FFMPEG](https://www.ffmpeg.org/download.html) if you don't have it already_
- `$ cd spacedrive`
- `$ pnpm i`
2022-04-01 03:20:20 +00:00
- `$ pnpm prep` - Runs all necessary codegen & builds required dependencies.
To quickly run only the desktop app after `prep` you can use:
- `$ pnpm desktop dev`
2022-04-22 04:34:27 +00:00
To run the landing page
2022-04-22 04:34:27 +00:00
- `$ pnpm web dev` - runs the web app for the embed
- `$ pnpm landing dev`
If you are having issues ensure you are using the following versions of Rust and Node:
- Rust version: **1.58.1**
- Node version: **17**
2022-04-01 03:20:20 +00:00
# Architecture
This project is using what I'm calling the **"PRRTT"** stack (Prisma, Rust, React, TypeScript, Tauri).
2022-04-22 04:34:27 +00:00
- Prisma on the front-end? 🤯 Made possible thanks to [prisma-client-rust](https://github.com/brendonovich/prisma-client-rust), developed by [Brendonovich](https://github.com/brendonovich). Gives us access to the powerful migration CLI in development, along with the Prisma syntax for our schema. The application bundles with the Prisma query engine and codegen for a beautiful Rust API. Our lightweight migration runner is custom built for a desktop app context.
- Tauri allows us to create a pure Rust native OS webview, without the overhead of your average Electron app. This brings the bundle size and average memory usage down dramatically. It also contributes to a more native feel, especially on macOS due to Safari's close integration with the OS.
- The core (`sdcore`) is written in pure Rust.
2022-04-25 16:51:47 +00:00
- Typesafe communication for an RPC-like message passing system between Rust and React Query.
## Monorepo structure:
### Apps:
2022-04-25 16:51:47 +00:00
- `desktop`: A [Tauri](https://tauri.studio) app with embedded `sdcore` Rust binary.
- `mobile`: A [React Native](https://reactnative.dev/) app with embedded `sdcore` Rust binary.
- `web`: A [React](https://reactjs.org) webapp as a light wrapper around the `interface` with a websocket Transport.
- `landing`: A [React](https://reactjs.org) app using Vite pages, Tailwind Typography
### Core:
2022-04-22 04:34:27 +00:00
- `core`: The [Rust](#) core, referred to internally as `sdcore`. Contains filesystem, database and networking logic. Can be deployed in a variety of host applications.
### Packages:
2022-04-22 04:34:27 +00:00
- `client`: A [TypeScript](#) client library to handle dataflow via RPC between UI and the Rust core.
- `ui`: A [React](<[#](https://reactjs.org)>) Shared component library.
2022-04-22 04:34:27 +00:00
- `interface`: The complete user interface in React (used by apps `desktop`, `web` and `landing`)
- `config`: `eslint` configurations (includes `eslint-config-next`, `eslint-config-prettier` and all `tsconfig.json` configs used throughout the monorepo.
2022-04-22 04:34:27 +00:00
- `macos`: A [Swift](#) Native binary for MacOS system extensions.
- `ios`: A [Swift](#) Native binary (planned).
- `windows`: A [C#](#) Native binary (planned).
- `android`: A [Kotlin](#) Native binary (planned).