plotting predictions for 1 step ahead forecasting about lag-llama

[ashok-arjun]

Hi!

Thanks for the detailed issue.

The way you evaluate it with a for loop may not be correct. You can just set the prediction_length to be 1, and run it through the entire test data. It will be evaluated for one-step prediction in each timestep i.e.
Predicts timestep T using history until T-1
Predicts timestep T+1 using history until T (not the previous prediction etc.).

Can you try that?

[sebasmos]

Thanks for your response!

I tried a similar approach where I use the context length as a sliding window at each timestamp, and it gave better much results. On this approach it would not consider the context length as lags for each timestamp but the entire historical data until the current timestamp right?

[ashok-arjun]

Can you elaborate on what you mean by the context length as a sliding window at each timestamp?

As for your question, your maximum lag taken from the history is the value 1093 timesteps behind the timestep to be predicted. Lags can potentially go beyond context length; the context length is taken for the token independently.

[sebasmos]

Thank you @ashok-arjun I solved the issue by using the context length as the number of lags for each prediction. This ensured consistent use of historical data across models. In the past I used the prediction_lengthas you suggested but this only works for a single sample, while I needed to compare for several ground truths so the above was allows me to compare sample by sample over my testing data