cal-itp / paratransit-eligibility-reports

Work related to the paratransit eligibility reports

paratransit-eligibility-reports

work related to the paratransit eligibility reports.

Currently, this repo is used to generate a centralized list of paratransit agencies as part of the requirements of AB 1351

Data Sources

The current data sources are

1. Blackcat
2. State Controller's Audit Report Raw Data
3. CTSA List
4. [Trillium Maintained List of Transit Agencies in CA]

Various Datasets are cataloged in ./catalog.yml, an intake data catalog file.

Methodology

To determine which paratransit agencies are getting Mills-Alquish-Deddeh Act (aka TDA) funding, they should be in the State Controller dataset. We then filter that dataset to only agencies that are claiming and/or is claiming paratransit vehicles. This is both the starting point for the list and the produce of the is_mills variable in the final dataset.

To filter the Trillium list to Paratransit, we have a gsheet that uses the =import & =query list to give us a catalog entry of Trillium master transit in CA list that is only paratransit.

CTSA list should all be Paratransit operators or coordinators of operators.

Theoretically, the BlackCat entries for 5310 funding should all have corresponding TDA funding based on spot checking, so we remove from the dataset for now.

Once that is done, we manually created a set of crosswalks between the controller filtered list and both the Trillium and CTSA list. The datasets are merged, joined and deduped in dedupe.ipynb and we write out the final dataset in final/final_combined_paratransit.csv

Running the script

To run all the scripts to combine the data, run make data. To update the dataset, you may have to update the list of crosswalks set of crosswalks if new agencies are present in either the CTSA or Trillium lists.

Dependencies

To install the required python packages, run make install.