HPO ParameterSet bug about clearml

[ainoam]

@BalogneseCoder Appreciate if you can provide a code example demonstrating how you your parameters are defined and passed to HPO.

[BalogneseCoder]

param1 = DiscreteParameterRange(name='param1', values=[0, 1])
param2 = DiscreteParameterRange(name='param2', values=[0, 1])
param3 = DiscreteParameterRange(name='param3', values=[0, 1])
paramset1 = ParameterSet([{'param4': DiscreteParameterRange(name='param4', values=[0]),
'param5': DiscreteParameterRange(name='param5', values=[0])},
{'param4': DiscreteParameterRange(name='param4', values=[1]),
'param5': DiscreteParameterRange(name='param5', values=[1])}])
paramset2 = ParameterSet([{'param6': DiscreteParameterRange(name='param6', values=[10]),
'param7': DiscreteParameterRange(name='param7', values=[10])},
{'param6': DiscreteParameterRange(name='param6', values=[20]),
'param7': DiscreteParameterRange(name='param7', values=[20])}])

hparams = [param1, param2, param3, paramset1, paramset2]

[BalogneseCoder]

optimizer = HyperParameterOptimizer(
base_task_id='696d6e7a4d154d0286ba5df27f9de52d',
hyper_parameters=hparams,
objective_metric_title='test_title',
objective_metric_series='test_series',
objective_metric_sign='max',
# setting optimizer
optimizer_class=GridSearch,
# project for child tasks
spawn_project='paramset_test_project/children',
# configuring optimization parameters
execution_queue='someQueue',
save_top_k_tasks_only=2,
max_number_of_concurrent_tasks=2,
optimization_time_limit=1440,
total_max_jobs=2,
)

[eugen-ajechiloae-clearml]

Hi @BalogneseCoder !

2024-02-12 20:17:51,239 - clearml - WARNING - Could not determine if Hydra is overriding a Config Group param1=<clearml.automation.parameters.DiscreteParameterRange object at 0x7f86043163b0> so instead of value the task is provided with object itself, for sure it fails after that.

This looks like a Hydra error. We issue this warning when something went wrong when checking if an override corresponds to a config group. How could this happen? Do you have some simple runnable code that contains both the HPO code and the task you are trying to optimize, to help us reproduce this?