3 Comments
User's avatar
aleksei's avatar

Have you tried to run backest on years historical data, accounting llm model's cut off dates?

Expand full comment
Anatolt's avatar

as far as I understand - backtest here is not possible. because you cant cut knowledge of models by some date

Expand full comment
aleksei's avatar

Partially you right, but knowledge cutoff of most openai models is 2024-06-01 so we can perform backrest from this date at least.

Moreover, we can switch to earlier models reaching dates earlier than 2024-06-01 I know some models has earlier knowledge cutoff date.

Expand full comment