OTA notification spams with WARN and ERROR and floods with requests about zha-toolkit

[mdeweerd]

Thanks for the feedback, I also read the thread at zigpy - I will change the level of these message to info.

[trilu2000]

I have the same issue, but the failure results also in not downloading the respective files.
Please find below the shortend log-file.

2024-01-17 16:02:20.594 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=61), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=61&Version=1.5.100.0', LedvanceImage(manufacturer_id=4489, image_type=61, version=17130496, image_size=185112, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=61&Version=1.5.100.0')
2024-01-17 16:02:20.595 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=208), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=208&Version=3.32.54.96', LedvanceImage(manufacturer_id=4489, image_type=208, version=52442720, image_size=188416, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=208&Version=3.32.54.96')
2024-01-17 16:02:20.942 WARNING (MainThread) [zigpy.util] Error calling listener <bound method Basic.get_image of <zigpy.ota.provider.Salus object at 0x7f72fba9d890>> with args (ImageKey(manufacturer_id=4489, image_type=208),): ValueError('Data is too short')
2024-01-17 16:02:20.943 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=138), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=138&Version=2.20.101.80', LedvanceImage(manufacturer_id=4489, image_type=138, version=34891088, image_size=213058, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=138&Version=2.20.101.80')
2024-01-17 16:02:20.944 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=139), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=139&Version=2.3.101.80', LedvanceImage(manufacturer_id=4489, image_type=139, version=33776976, image_size=196574, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=139&Version=2.3.101.80')
2024-01-17 16:02:20.944 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=60), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=60&Version=1.5.100.0', LedvanceImage(manufacturer_id=4489, image_type=60, version=17130496, image_size=185972, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=60&Version=1.5.100.0')
2024-01-17 16:02:20.945 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=160), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=160&Version=2.20.101.80', LedvanceImage(manufacturer_id=4489, image_type=160, version=34891088, image_size=213154, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=160&Version=2.20.101.80')
2024-01-17 16:02:20.945 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=162), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=162&Version=2.19.101.80', LedvanceImage(manufacturer_id=4489, image_type=162, version=34825552, image_size=198254, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=162&Version=2.19.101.80')
2024-01-17 16:02:20.945 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=184), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=184&Version=3.32.54.96', LedvanceImage(manufacturer_id=4489, image_type=184, version=52442720, image_size=188384, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=184&Version=3.32.54.96')
2024-01-17 16:02:21.806 WARNING (MainThread) [zigpy.util] Error calling listener <bound method Basic.get_image of <zigpy.ota.provider.Salus object at 0x7f72fba9d890>> with args (ImageKey(manufacturer_id=4489, image_type=184),): ValueError('Data is too short')
2024-01-17 16:02:21.807 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=52), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=52&Version=1.5.100.0', LedvanceImage(manufacturer_id=4489, image_type=52, version=17130496, image_size=185112, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=52&Version=1.5.100.0')
2024-01-17 16:02:21.807 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=140), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=140&Version=2.5.101.80', LedvanceImage(manufacturer_id=4489, image_type=140, version=33908048, image_size=196574, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=140&Version=2.5.101.80')
2024-01-17 16:02:21.807 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=51), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=51&Version=1.5.100.0', LedvanceImage(manufacturer_id=4489, image_type=51, version=17130496, image_size=185968, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=51&Version=1.5.100.0')
2024-01-17 16:02:21.808 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=163), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=163&Version=2.19.101.80', LedvanceImage(manufacturer_id=4489, image_type=163, version=34825552, image_size=198246, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=163&Version=2.19.101.80')
2024-01-17 16:02:21.808 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=27), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=27&Version=0.16.36.40', LedvanceImage(manufacturer_id=4489, image_type=27, version=1057832, image_size=179100, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=27&Version=0.16.36.40')
2024-01-17 16:02:21.808 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=26), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=26&Version=0.16.36.40', LedvanceImage(manufacturer_id=4489, image_type=26, version=1057832, image_size=170776, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=26&Version=0.16.36.40')
2024-01-17 16:02:21.809 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=15), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=15&Version=0.16.36.40', LedvanceImage(manufacturer_id=4489, image_type=15, version=1057832, image_size=170120, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=15&Version=0.16.36.40')
2024-01-17 16:02:22.134 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4364, image_type=107), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4364&Product=107&Version=1.2.5.16', LedvanceImage(manufacturer_id=4364, image_type=107, version=16909584, image_size=132672, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4364&Product=107&Version=1.2.5.16')
2024-01-17 16:02:22.647 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4364, image_type=98), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4364&Product=98&Version=1.2.5.16', LedvanceImage(manufacturer_id=4364, image_type=98, version=16909584, image_size=142972, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4364&Product=98&Version=1.2.5.16')
....
2024-01-17 16:02:36.840 WARNING (MainThread) [zigpy.util] Error calling listener <bound method Basic.get_image of <zigpy.ota.provider.Salus object at 0x7f72fba9d890>> with args (ImageKey(manufacturer_id=4489, image_type=204),): ValueError('Wrong magic number for OTA Image: 1931616379')
2024-01-17 16:02:36.841 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=70), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=70&Version=1.5.100.0', LedvanceImage(manufacturer_id=4489, image_type=70, version=17130496, image_size=185980, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=70&Version=1.5.100.0')
2024-01-17 16:02:36.962 WARNING (MainThread) [zigpy.util] Error calling listener <bound method Basic.get_image of <zigpy.ota.provider.Salus object at 0x7f72fba9d890>> with args (ImageKey(manufacturer_id=4489, image_type=70),): ValueError('Wrong magic number for OTA Image: 1931616379')
2024-01-17 16:02:36.962 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=152), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=152&Version=16.19.37.3', LedvanceImage(manufacturer_id=4489, image_type=152, version=269690115, image_size=158673, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=152&Version=16.19.37.3')
2024-01-17 16:02:37.090 WARNING (MainThread) [zigpy.util] Error calling listener <bound method Basic.get_image of <zigpy.ota.provider.Salus object at 0x7f72fba9d890>> with args (ImageKey(manufacturer_id=4489, image_type=152),): ValueError('Wrong magic number for OTA Image: 1931616379')
2024-01-17 16:02:37.090 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=124), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=124&Version=17.49.102.48', LedvanceImage(manufacturer_id=4489, image_type=124, version=288450096, image_size=238110, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=124&Version=17.49.102.48')
2024-01-17 16:02:37.220 WARNING (MainThread) [zigpy.util] Error calling listener <bound method Basic.get_image of <zigpy.ota.provider.Salus object at 0x7f72fba9d890>> with args (ImageKey(manufacturer_id=4489, image_type=124),): ValueError('Wrong magic number for OTA Image: 1931616379')
2024-01-17 16:02:37.221 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4489, image_type=151), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=151&Version=17.40.102.48', LedvanceImage(manufacturer_id=4489, image_type=151, version=287860272, image_size=239750, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4489&Product=151&Version=17.40.102.48')
2024-01-17 16:02:37.343 WARNING (MainThread) [zigpy.util] Error calling listener <bound method Basic.get_image of <zigpy.ota.provider.Salus object at 0x7f72fba9d890>> with args (ImageKey(manufacturer_id=4489, image_type=151),): ValueError('Wrong magic number for OTA Image: 1931616379')
2024-01-17 16:02:37.343 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4364, image_type=57374), 'https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4364&Product=57374&Version=16.9.101.91', LedvanceImage(manufacturer_id=4364, image_type=57374, version=269051227, image_size=200036, url='https://api.update.ledvance.com/v1/zigbee/firmwares/download?Company=4364&Product=57374&Version=16.9.101.91')
2024-01-17 16:02:37.466 WARNING (MainThread) [zigpy.util] Error calling listener <bound method Basic.get_image of <zigpy.ota.provider.Salus object at 0x7f72fba9d890>> with args (ImageKey(manufacturer_id=4364, image_type=57374),): ValueError('Wrong magic number for OTA Image: 1931616379')
....
2024-01-17 16:02:37.971 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='TS600'), 'http://eu.salusconnect.io/download/firmware/4c6d66e5-f661-406a-8a0b-cbb7c90cd313/TS600_001F0019.tar.gz', SalusImage(manufacturer_id=4216, model='TS600', version='001F0019', image_size=None, url='http://eu.salusconnect.io/download/firmware/4c6d66e5-f661-406a-8a0b-cbb7c90cd313/TS600_001F0019.tar.gz')
2024-01-17 16:02:37.975 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='TS600HW'), 'http://eu.salusconnect.io/download/firmware/4e158bfa-766e-404d-9d51-1194efe574b0/TS600HW_001F0019.tar.gz', SalusImage(manufacturer_id=4216, model='TS600HW', version='001F0019', image_size=None, url='http://eu.salusconnect.io/download/firmware/4e158bfa-766e-404d-9d51-1194efe574b0/TS600HW_001F0019.tar.gz')
2024-01-17 16:02:37.976 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='Upgr-script Fw-20160311-ET102EM53.txt'), 'http://eu.salusconnect.io/download/firmware/1LZJCVE4KyTSccDwYJUTzrc-7CJ01GdMrMVMqRy_MNc/var/www/aylatest/data/Upgr-script Fw-20160311-ET102EM53.txt', SalusImage(manufacturer_id=4216, model='Upgr-script Fw-20160311-ET102EM53.txt', version='', image_size=None, url='http://eu.salusconnect.io/download/firmware/1LZJCVE4KyTSccDwYJUTzrc-7CJ01GdMrMVMqRy_MNc/var/www/aylatest/data/Upgr-script Fw-20160311-ET102EM53.txt')
2024-01-17 16:02:37.977 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='WLS600'), 'http://eu.salusconnect.io/download/firmware/3ea71e61-bbf7-4b93-a3b3-127ea6c3407f/WLS600_20181214.tar.gz', SalusImage(manufacturer_id=4216, model='WLS600', version='20181214', image_size=None, url='http://eu.salusconnect.io/download/firmware/3ea71e61-bbf7-4b93-a3b3-127ea6c3407f/WLS600_20181214.tar.gz')
2024-01-17 16:02:37.978 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='it600HW'), 'http://eu.salusconnect.io/download/firmware/c0f1f26c-fe08-400d-ba6a-b04e8dd77413/it600HW_009A50A4.tar.gz', SalusImage(manufacturer_id=4216, model='it600HW', version='009A50A4', image_size=None, url='http://eu.salusconnect.io/download/firmware/c0f1f26c-fe08-400d-ba6a-b04e8dd77413/it600HW_009A50A4.tar.gz')
2024-01-17 16:02:37.979 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='it600HW-AC'), 'http://eu.salusconnect.io/download/firmware/7c6f40e8-c433-4976-bc05-fa4de99ec4bf/it600HW-AC_009A74A4.tar.gz', SalusImage(manufacturer_id=4216, model='it600HW-AC', version='009A74A4', image_size=None, url='http://eu.salusconnect.io/download/firmware/7c6f40e8-c433-4976-bc05-fa4de99ec4bf/it600HW-AC_009A74A4.tar.gz')
2024-01-17 16:02:37.980 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='it600MINITRV'), 'http://eu.salusconnect.io/download/firmware/448bbf25-0ec6-4639-8755-bd614fea203d/it600MINITRV_00910040.tar.gz', SalusImage(manufacturer_id=4216, model='it600MINITRV', version='00910040', image_size=None, url='http://eu.salusconnect.io/download/firmware/448bbf25-0ec6-4639-8755-bd614fea203d/it600MINITRV_00910040.tar.gz')
2024-01-17 16:02:37.981 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='it600Receiver'), 'http://eu.salusconnect.io/download/firmware/315e4681-e0c8-44ff-bb77-f0bf0629203c/it600Receiver_20190410.tar.gz', SalusImage(manufacturer_id=4216, model='it600Receiver', version='20190410', image_size=None, url='http://eu.salusconnect.io/download/firmware/315e4681-e0c8-44ff-bb77-f0bf0629203c/it600Receiver_20190410.tar.gz')
2024-01-17 16:02:37.982 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='it600TRV'), 'http://eu.salusconnect.io/download/firmware/4d6f705a-b2c5-4a7c-b1e3-e7f7480dd31a/it600TRV_005F004F.tar.gz', SalusImage(manufacturer_id=4216, model='it600TRV', version='005F004F', image_size=None, url='http://eu.salusconnect.io/download/firmware/4d6f705a-b2c5-4a7c-b1e3-e7f7480dd31a/it600TRV_005F004F.tar.gz')
2024-01-17 16:02:37.983 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='it600ThermHW'), 'http://eu.salusconnect.io/download/firmware/4d8e88c4-d2b7-465e-9c51-259b0a4a66de/it600ThermHW_009A50A4.tar.gz', SalusImage(manufacturer_id=4216, model='it600ThermHW', version='009A50A4', image_size=None, url='http://eu.salusconnect.io/download/firmware/4d8e88c4-d2b7-465e-9c51-259b0a4a66de/it600ThermHW_009A50A4.tar.gz')
2024-01-17 16:02:37.984 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='it600ThermHW-AC'), 'http://eu.salusconnect.io/download/firmware/768c3747-a09a-476a-9c23-8d0e4645669a/it600ThermHW-AC_009A74A4.tar.gz', SalusImage(manufacturer_id=4216, model='it600ThermHW-AC', version='009A74A4', image_size=None, url='http://eu.salusconnect.io/download/firmware/768c3747-a09a-476a-9c23-8d0e4645669a/it600ThermHW-AC_009A74A4.tar.gz')
2024-01-17 16:02:37.985 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='it600WC'), 'http://eu.salusconnect.io/download/firmware/8a2d1183-9af1-46c5-b760-64824b11b920/it600WC_20230222.tar.gz', SalusImage(manufacturer_id=4216, model='it600WC', version='20230222', image_size=None, url='http://eu.salusconnect.io/download/firmware/8a2d1183-9af1-46c5-b760-64824b11b920/it600WC_20230222.tar.gz')
2024-01-17 16:02:37.986 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='it600WCNH'), 'http://ec2-18-194-20-66.eu-central-1.compute.amazonaws.com/firmware/UG-SYS/WC/NH/2023-0527/it600WCNH_00090005.tar.gz', SalusImage(manufacturer_id=4216, model='it600WCNH', version='00090005', image_size=None, url='http://ec2-18-194-20-66.eu-central-1.compute.amazonaws.com/firmware/UG-SYS/WC/NH/2023-0527/it600WCNH_00090005.tar.gz')
2024-01-17 16:02:37.987 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='sau2ag1Coordinator'), 'http://eu.salusconnect.io/download/firmware/HzqHdgNTusHTef91cNxZqj4_L8QRS7yOHC7Dbj7iTU8/sau2ag1Coordinator_20160425.tar.gz', SalusImage(manufacturer_id=4216, model='sau2ag1Coordinator', version='20160425', image_size=None, url='http://eu.salusconnect.io/download/firmware/HzqHdgNTusHTef91cNxZqj4_L8QRS7yOHC7Dbj7iTU8/sau2ag1Coordinator_20160425.tar.gz')
2024-01-17 16:02:37.988 ERROR (MainThread) [custom_components.zha_toolkit.ota] Try getting ImageKey(manufacturer_id=4216, image_type='sau2ag1Gateway'), 'http://eu.salusconnect.io/download/firmware/K_l0y4NJdTRLzf2-woUqwF_YGYZpam8sB4M3vT_758w/sau2ag1Gateway_020077160122.tar.gz', SalusImage(manufacturer_id=4216, model='sau2ag1Gateway', version='020077160122', image_size=None, url='http://eu.salusconnect.io/download/firmware/K_l0y4NJdTRLzf2-woUqwF_YGYZpam8sB4M3vT_758w/sau2ag1Gateway_020077160122.tar.gz')
2024-01-17 16:02:50.356 WARNING (MainThread) [zigpy.ota.provider] Ledvance: Couldn't download 'https://api.update.ledvance.com/v1/zigbee/firmwares': 429/Too Many Requests

[mdeweerd]

In another issue a reference was made to a zigpy issue where Puddly identified that the downloads from ledvance were refused because there are too many in a short period.

It is not to be worried about as such and retrying at later times will probably allow you to get all the files.

I did not have a good way when I wrote the code to download the ota files to limit the download to the files that match the devices known in ZHA - currently the filter is made based on the manufacturer code.

That is something to improve - and if it is not possible to make a narrow selection, I guess that some kind of limiter has to be added or add an option to let the user determine the file to download (but help by providing the list of available downloads in the service reply.

However, I do not have the time for that currently.

It is still possible to download the file separately and put it in the proper directory.