transformap / transformapetl

Extract Transform Load Pipeline for TransforMap

TransforMap.co Source Files

TransforMap works towards an online platform for you to visualize the myriads of alternatives to the dominant economic thinking on a single mapping system.

Getting Started

1. Install DocPad

2. Clone the project and run the server

   git clone https://github.com/transformap/transformap.github.io cd transformap.github.io docpad run

3. Open http://localhost:9778/

4. Start hacking away by modifying the src directory

Editing content with Prose.io

Allow contributors to edit content by adding them as collaborators (Settings > Collaborators) on the repository.

They can they edit the Markdown partials at prose.io/#transformap/transformap.github.io.

Tips for editing using Prose

• Authenticate on Github before making any changes to files using the green button on the bottom right corner of the screen.

• ???

transformapetl's Issues

Webserver does not make use of WSGI

A convenient wrapper for the standard Django runserver is the combination of a WSGI server combined with nginx serving static assets.

Jobs are not linked to the transformaps atlas

The jobs known from https://github.com/TransforMap/transformapetl/tree/master/jobs were derived in a manually curated process and were carefully chosen for compatibility. The wealth of maps in our directory of mappings is not yet represented there, why a strategy may help out to attack this casualty in a structured way.

A current data source can be described by its IRI, a data IRI and a UUID in the semantic mediawiki. If a data IRI is present, one could plug it to this ETL and finally store it in our API, which would return a UUID, if not yet present. Filling these fields with identifiers should then help gaining a broader overview about what is happening within the transformaps ecosystem.

Deployment uses Debug mode

A nice wrapper for setting the debug variable will be helpful for a production deployment of this.