Coder Social home page Coder Social logo

function61 / varasto Goto Github PK

View Code? Open in Web Editor NEW
52.0 5.0 5.0 13.53 MB

All your files in one simple, replicated, encrypted place - with built-in backups and configurable ransomware protection.

Home Page: https://function61.com/varasto

License: Apache License 2.0

Go 74.09% Shell 0.26% TypeScript 25.38% JavaScript 0.15% Dockerfile 0.13%
storage backups encrypted-data fuse-filesystem data-store hacktoberfest

varasto's Introduction

⬆️ For table of contents, click the above icon

Build status Download & install

All your files in one simple, replicated, encrypted place - with built-in backups and configurable ransomware protection.

Vision

Varasto vision

Video & screenshot introduction

Video:

Varasto introduction thumbnail

See screenshots to get a better picture.

Website & documentation

We have wonderful documentation on our website.

Features

NOTE: Our documentation has more details & links in this table.

Details
Supported OSes Almost everything: PCs, mobile devices (Android, iOS), Raspberry Pis etc.
Data privacy All data is encrypted - each collection with a separate key so compromise of one collection does not compromise other data. Take back ownership of your data.
Data durability Transparently replicates your data to multiple disks / off-site storage.
Data integrity SHA-256 hashes verified on file write/read - detects bit rot immediately. We also have scheduled scrubbing to detect errors in the background before they affect you.
Data sensitivity You can mark different collections with different sensitivity levels and decide on login which sensitivity level content do you want to show.
Backup all your devices' data Varasto's architecture is ideal for backing up all your PCs, mobile devices etc.
Supported storage methods Local disks or cloud services (AWS S3, Google Drive), all in encrypted form so you don't have to trust the cloud ("zero trust" model) or have data leaks if local disks get stolen.
Data access methods 1) Clone collection to your computer 2) Open/stream files from web UI 3) Via network folders 4) Linux FUSE interface
Integrated metadata backups Use optional built-in backup to automatically upload encrypted backup of your metadata DB to AWS S3. If you don't like it, there's interface for external backup tools as well.
Transparent compression Only well-compressible files will be automatically compressed
Metadata support & tagging Can use metadata sources for automatically fetching movie/TV series info, poster images etc. Can also add tags to collections.
All files in one place Never again forget on which disk a particular file was stored - it's all in one place even if you have 100 disks! Varasto is dogfooded with ~50 TB of data without any slowdowns.
Thumbnails for photos Automatic thumbnailing of photos/pictures
Health monitoring Get warnings or alerts if there is anything wrong with your volumes, data or Varasto.
Per-collection durability To save money, we support storing important files with higher redundancy than less important files
Transactional File or group of files are successfully committed or none at all. Practically no other filesystem does this
Ransomware protection Run Varasto on a separate security-hardened device/NAS to protect from ransomware, or configure replication to S3 ransomware-protected bucket
Integrated SMART monitoring Detect disk failures early

varasto's People

Contributors

joonas-fi avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

varasto's Issues

Thumbnails for videos

Pictures were done in #29

We've to support both:

  • Thumbnail explicitly made (think YouTube thumbnails)
  • No explicit thumbnail => try to extract one automatically

Compression

We should transparently compress blobs if we get >= 10 % reduction in file size

Encryption: phase 1 (DEK)

  • Blobs should be encrypted with AES256
  • Encryption key should be per-collection
  • AES key itself should be asymmetrically encrypted with a KeySet (any of the N keys can decrypt the AES key)
  • KeySet should be a group of RSA or ECC asymmetric keys:
    • TPM/Smartcard key with touch to decrypt
    • Backup TPM/Smartcard key with touch to decrypt
    • Offline key printed on paper or stored on USB drive (should be encrypted with a pwd though) - should probably be stored in two different addresses for redundancy

For terminology, see #49

Service view for disks

Interesting data would be:

  • HDD serial number (this can be found from SMART data)
  • Manufacturing date (to calculate age of drive)
  • Warranty info

Not done for now:

  • Read/write speeds (tracked by #85 )

Support hiding sensitive files

When logging in, we should ask if we will use normal privileges or super privileges. If using normal privileges, we won't show sensitive content

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.