Coder Social home page Coder Social logo

pde / tosback2 Goto Github PK

View Code? Open in Web Editor NEW
25.0 6.0 42.0 101.14 MB

Reimplementing TOSBack using git as a database layer!

Home Page: http://tosback.org

License: GNU General Public License v2.0

PHP 0.03% C++ 0.55% C 67.90% Shell 19.85% JavaScript 0.35% Objective-C 0.06% Perl 1.82% Python 9.45%

tosback2's Introduction

This is TOSBack version 2, a clean redesign & reimplementation of EFF's
TOSBack project.

It uses Git as an inherently and efficiently versioned backend storage
database.

After cloning the git repository, you need to execute this command:

git submodule update --init --recursive

That will fetch a recent version of the GitPython code, which we depend upon.

*BUGS IN WGET*

If you want to actually run the crawler yourself (not really necessary unless
you're testing something), be aware that TOSBack2 also exposes a number of
bugs in common versions of wget.  As of December 2011, there are two bugs you
might need to patch yourself!

(FOR YOUR CONVENIENCE, a patched version of the wget source can be found in
lib/wget-1.13.4/ .  There is also a binary .deb that Debian and Ubuntu users
can try in lib/.  More hints on building from source below) 

1. Versions of wget built against
   gnutls may suffer from fatal memory leaks 
   https://lists.gnu.org/archive/html/bug-wget/2011-10/msg00050.html
   (so apply that patch, or build against openssl using ./configure --with-ssl=openssl).

2. You should also apply the following patch 
   https://savannah.gnu.org/support/download.php?file_id=24473
   to fix this bug: https://savannah.gnu.org/bugs/?21714

HINTS FOR BUILDING WGET FROM SOURCE ON DEBIAN OR UBUNTU

sudo apt-get build-dep wget
cd lib/wget-1.13.4/
fakeroot debian/rules binary
an installable .deb file *should* be written to the lib/ directory

tosback2's People

Contributors

dodger487 avatar dtauerbach avatar hugoroy avatar pde avatar subsystem7 avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar avatar avatar

Forkers

dodger487 roggers mt-cicero tosdr glamrock yossiam garrettevans cyberflamego

tosback2's Issues

prepare to put tosback.org live again

hi! as we know, tosback.org has not been updated for a couple of years now, and it looks like the site is now inaccessible altogether (there's an "OMG KITTENS" acl on there). but not to worry! :) as promised, we (the ToS;DR project) got tosback's back and will fully back its comeback! ;)

@JimmStout has been working hard to put tosback.org back online, and is nearly finished with that (staging URL: http://tosback-staging.michielbdejong.com/ ). some things that are missing:

  • although we couldn't care less about under which flag this ship sails, you probably don't want this to stay under the "an EFF project" flag. what shall we put in the header/footer, then? maybe "a collaboration between EFF and ToS;DR"?
  • when everything is ready for relaunch, someone somewhere would probably have to point the DNS A-record to our server, or if you prefer, move the domain name into our Gandi handle (looks like you've already got it at Gandi). the latter option would allow us to run the site on https.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.