Comments (5)
No I manually downloaded them. Would have to build a scraper to download them automatically.
Also, this data doesn't change that often. New files generated 1x per year or so. For that reason, didn't spend time automating.
Nevertheless, automating looks like it's necessary if others want this data. Instead of pushing new files to the repo.
from govstat.
I don't think so, because it's technically not congress related, it's coming from another branch (executive, OMB).
It would be nice if there was an overarching package for all 3 branches of federal government. One package covering congress data, budget, cabinet, supreme court, judiciary data, etc.
from govstat.
The budget data pipeline is manual and currently has no automation.
I download files from Office of Management and Budget (OMB), and put them in congress/data/hist_fy21
.
For now, to clear this error, I will bring that directory into this repo, so that the files will be available when someone clones/installs govstat. Users will still need to install congress
for this webapp to function.
from govstat.
Can the congress commands be used to download the hist_fy21
data?
How do you download them in the first place, some command?
from govstat.
Would this scraper fit into unitedstates/congress's scope?
from govstat.
Related Issues (15)
- Port to python3+ HOT 1
- Integrate logging module for webserver
- Vote numbering resets every year
- Add scrapers to pull Budget data from OMB HOT 4
- Error with accessing ordered_dates from db HOT 1
- Missing module `openpyxl`
- Add link to website HOT 1
- Add link to website in About section HOT 1
- Create page for Election Data
- Bug: Link to website on Readme HOT 4
- License HOT 1
- Change configuration file strategy
- Move away from submodules HOT 1
- `ModuleNotFoundError: No module named 'config'`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from govstat.