regardscitoyens / senapy

Retrieve painlessly data from senat.fr

senapy

A python client for senat.fr website.

Main goal

Retrieve painlessly JSON data from senat.fr.

Requirements

Python 3

Install:

• from pip: pip3 install senapy
• locally: pip3 install -e .

Dossiers Legislatifs

• Parse one: senapy-cli parse URL_or_filepath
  • example: senapy-cli parse pjl16-537 (instead of the URL, you can just give the ID)
  • warning: for now the file must be in UTF-8
• Get all the urls: senapy-cli doslegs_urls
• Parse many: cat urls | senapy-cli parse_many output_dir

Search services

• QuestionSearchService to search for questions

Tests:

• pip3 install pytest
• pytest
• If you modify the output, there's an utility to make the tests reflect that: python tests/tools/regen_regressions_output.py

senapy's Issues

Add CC censure parsing from Table de Concordance

To get really good data about CC censorship, we could deduced "articles_partially_censored" and "articles_fully_censored" from the matching table: https://www.senat.fr/dossier-legislatif/tc/tc_pjl15-773.html

Add options to filter resolutions and motions from list_dossiers

cf regardscitoyens/the-law-factory-parser@85ca49b#commitcomment-30526672

Add Transparence ordinaire to tests, and maybe also both confiance

I would do it, but I'm not really confident on how is the good way to add a text to the tests here

Release a new Python 3 compatible version on pypi

Hello,

Since that commit, there has been no release which means that install procedure using pip + Python 3 will fail.

The error on a fresh install via pypi is:

LONG_DESC = readme.read().decode('utf-8')
AttributeError: 'str' object has no attribute 'decode'

Is that possible to publish a new version on Pypi to ease the installation/reuse of that code?

Thanks!

Senate website 2023 re-design

Hello there, it's been a while,

I don't know if this project is still used somewhere, but it doesn't support the new version of www.senat.fr.

Let me know if help is needed on that matter. We've worked on it at @Contexte, we could have some ideas.