jens-ox / bundesdatenkrake Goto Github PK

View Code? Open in Web Editor NEW

10.0 2.0 0.0 21.73 MB

Extraction, versioning and machine-readable provisioning of public data.

Home Page: https://krake.dev

JavaScript 3.24% TypeScript 94.84% CSS 1.92%

crawling open-data public-api

bundesdatenkrake's People

Contributors

Stargazers

Watchers

bundesdatenkrake's Issues

Swagger UI is missing id param in UI

Hi Jens,

I just stumbled over a problem in the swagger UI and thought I let you know.

Somehow the id can not be set, only the file.

Not sure if I am missing something.

Keep up the good work.

Best,
wirthual

Store snapshot size

Add snapshot size to snapshot table

Provide a JSON schema per source

Lieferengpass-Meldungen out of date

Are there any problems due to updating the JSON of Lieferengpass: https://www.krake.dev/api/file?id=bfg-lieferengpass&file=main.json ?

There were no updates since 25.04.2023, although there are new reportings at the list of Bundesministerium für Gesundheit / pharmanet.bund.

Store data diffs alongside data dumps

The crawler will currently store a complete dump every time a source changes.
It would be nice if it would store a diff alongside it, as the diffs are often the most interesting part (e.g. shareholder changes at BaFin).

https://github.com/flitbit/diff

Use Zod to validate returned data

Using zod or something similar to check whether the data returned from a source matches the expected schema would allow to send alerts as soon as the data schema of a source changes.

Recommend Projects