gen_report.py about energyutils

[dresdner353]

can you highlight any specific fields you are trying to remove?

The entire data aggregation processing is a pretty involved to convert data from hours to days, weeks, months etc and a lot of those fields are required to make things work in terms of that aggregation.

That said, to provide a means of removing fields, I'd have to look into adding a filter option of sorts where you invoke the report generator and give it a list of fields you do not want in the resulting sheets. That would have knock-on effect on the graphs also, causing some to vanish if the related fields are not present in the sheet data.

The Excel format has a concept of hiding columns and its likely I can leverage that in the generation.

[pjmm1]

Several of the fields like dates and times are duplicates.
Would it be possible to list the Colom's you do not want to display would that be easier.
see attached

[pjmm1]

If it was also possable to change the width of the calms this would save space

[dresdner353]

Those date/time fields are there instead for data pivots. You can use them to apply filters and show all data for selected years, months or weeks by using those fields as filter references. It allows for fast filtering of data when you're trying to reduce the data set.

I will look into adding an option to list columns for hiding. This should result in the desired columns being hidden when the file is opened. You can still use the menus to show the hidden columns after the fact.

I'll play around with it later tonight and ping back to this post if I manage to get something working.

[dresdner353]

This turned out to be a pretty easy tweak. So do a git pull to update the code or re-download the zip file.

In the batch file to generate the report, you can now add a new option --hide_columns with a space separated list of fields to hide. The names used in this list are the lowercase internal keys for the fields and not necessarily the same as the title names shown.

Example here.. hiding year, month and week fields..

%PYTHON% %GEN_REPORT_SCRIPT% ^
--idir %SHELLY_DATA% ^
--file shelly_report_ev.xlsx ^
--reports %REPORTS% ^
--hide_columns year month week ^
--tariff_rate Day:0.4320 Night:0.2086 Boost:0.1225 ^
--tariff_interval 08-23:Day 23-08:Night 02-04:Boost ^
--annual_standing_charge 303 ^
--fit_rate 0.21

The full list can be determined by running the script with the --help option or checking the usage document at.. https://github.com/dresdner353/energyutils/blob/main/GEN_REPORT.md

That full list of field codes is..
datetime
ts
year
month
week
day
weekday
hour
hours
tariff_name
tariff_rate
standing_rate
standing_cost
import
import_cost
solar
battery_solar_charge
battery_grid_charge
battery_charge
battery_discharge
battery_storage
battery_capacity
solar_consumed
solar_consumed_percent
solar_credit
export_rate
export
export_percent
export_credit
consumed
rel_import
savings
savings_percent
bill_amount

[pjmm1]

Many Thanks I will have a look at this tomorrow and let you know how I get on
Regards