floriank13 / verify-marktstammdaten

Verifying and testing data in the German Energy dataset "Marktstammdatenregister"

Monitoring Germany's Core Energy System Dataset: A Data Quality Analysis of the Marktstammdatenregister

This is the github repository of the paper Monitoring Germany's Core Energy System Dataset: A Data Quality Analysis of the Marktstammdatenregister. The dashboards are live at https://marktstammdaten.kotthoff.dev/

Getting Started

1. Create a conda environment called verify-marktstammdaten and activate it
2. Run pip install -r requirements.txt
3. Run datasette install datasette-dashboards
4. Run docker-compose up
5. Run ./run_tests.sh
6. Run datasette serve .

verify-marktstammdaten's Issues

Dashboards: Add Mastr ID to units if possible

DSO approved yes/no

Dashboards: Show share of units in pie charts

Not bar charts

Find accepted values for `installation year` for different technologies

What are accepted values for installation years? For example, right now all solar systems that are installed before 1980 are seen as wrong, but this year is taken rather arbitrary. For all technologies we need an earliest year that we allow as installation year.

• Add sources for each technology and accepted installation year

Examine regions with high levels of wrongly allocated installed capacities

Check if there're hotspot in regions with wrongly assinged capacities.
Were there "Umgemeindungen"?

https://marktstammdaten.kotthoff.dev/-/dashboards/verify-marktstammdaten/chart-location-wind-power

• Add analysis script to /scripts folder
• Sort for Landkreise with increasing errors of this type
• Investigate reasoning for that
• Add to paper