djsun / datacatalog-imp-ri-gov

National Data Catalog importer for ri.gov/data/

National Data Catalog Importer for http://www.ri.gov/data/

Installation

Install Needed RubyGems

# For development and production:
gem install nokigiri

Set Up Config Files

• Create config.yml using config.example.yml as a template.

Usage

First, pull. Then, push. It's easy.

1. rake pull

Download and parse pages from data.dc.gov. You will need to specify the environment using the IMPORTER_ENV environment variable. Some examples:

• IMPORTER_ENV=local rake pull
• IMPORTER_ENV=sandbox rake pull
• IMPORTER_ENV=production rake pull

2. rake push

Upload pulled data to the National Data Catalog API. You will need to specify the environment using the IMPORTER_ENV environment variable. Some examples:

• IMPORTER_ENV=local rake push
• IMPORTER_ENV=sandbox rake push
• IMPORTER_ENV=production rake push

Join The National Data Catalog Community

• the National Data Catalog Web site
• the National Data Catalog mailing list
• the National Data Catalog project page
• the Sunlight Labs mailing list
• the transparency chat room