poivronjaune / opendata

PYTHON 3 - Open Data Project for fun. Transformed public contracts database from Quebec Open Data Website for the SEAO Information from 2009 to 2017 (Last update : march 2017)

SEAO Open Data Analaysis

This project cleans and transforms the province of Quebec's public RFP data to be loaded in a sqlite3 database. Uses python to load XML data.
Data quality analysis from 2009 to 2021
Some PANDAS jupyter notebooks are also available to manipulate data sets

Original system and Open Data

SEAO : Systeme Electronique d'Appel d'Offres (du gouvernement du quebec)

Published Open Data for SEAO

Context

SEAO Data is stored in three types of information files

1. Avis : Published RFPs contains all signed contracts with unique number (numeroseao)
2. AvisRevision : Revised RFPs (adjustments can go back to previous years - WOW)
3. Contrats : Contains final information on closed contracts
4. ContratsRevision : Contains revised information on final closed contracts (WHAT?)
5. Depenses : Contains exta spending on signed contracts
6. DepensesRevisions : Contains all revisions on extra spending for signed contracts (empty amount value means all spending were removed for this contract)

See SEAO XML Schema PDF file for detailed information (in french)

Setup

All python programs or jyputer notebooks must be used through a virtual environment
At the root folder activate environmenet using (on windows) : env\Scripts\activate
For Jupyter notebooks open a command line window and run:
env\Scripts\activate
jupyter notebook