kngenie Goto Github PK

cdx-writer

Python script to create CDX index files of WARC data

chicken

Mirror of Chicken (VNC client for MacOS X), http://sourceforge.net/projects/chicken/

crawlhq

Crawl Headquarter - a hub for web crawler cluster

docker-build

a bunch of docker automated build files

draintasker

a tool for continuously ingesting w/arc files into the archive

graphitejs

A jQuery plugin for displaying graphite graphs

heritrix3

Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

ia-web-access-control

web access control (exclusion oracle) tools for optional use with wayback machine

ia-wrapper

A python wrapper for the various archive.org APIs (IA-S3, Metadata Write API, etc.)

ias3upload

simple Perl script for uploading files to Internet Archive through its S3-like interface

jwat

Git repository of Java Web Archive Toolkit https://bitbucket.org/nclarkekb/jwat

kafka-python

Kafka protocol support in Python

kidsafe

Proxy filtering - Keeping the kids safe. Based on the kidsafe program by Stewart Watkiss

leveldb

Mirror of LevelDB SVN

pdf-flipbook

test of PDF flipbook reader with PDF.js and turn.js

persistenturls

Automatically exported from code.google.com/p/persistenturls

py_free_kick

this is and old game I made long time ago, feel free to improve it!

python-kestrel

A Kestrel python client that is built specifically for Kestrel instead of piggybacking on python-memcache

python-zstandard

Python bindings to the Zstandard (zstd) compression library

snakebite-py3

Pure python HDFS client: python3.x version

vcproxy

a tiny HTTP proxy that archives traffic in WARCs

warctools

warctools

wayback

IA's public Wayback Machine (moved from SourceForge)

wayback-machine-chrome

A chrome browser extension

webarchive-commons