Wednesday, Jul 22, 2026 | 1 minute read | Updated at Wednesday, Jul 22, 2026
Evaluating the performance of a currently running production model vs evaluating the performance between different models are two different questions.
For the production model, we need to have a certain lookback period to continuously run evaluation calculations.
For model comparison, we need to make sure that the metrics are being calculated on the same test set, such as the same split, or the same date range.
This comes up when you are developing a new model from an existing model.
I created this blog to monitor my curiosity, writing about concepts that interest me.
I write about personal projects, ideas, and the things I learn along the way. Hand-crafted and LLM-free.
Occasionally, a travel story or food review sneaks in.
If my writing resonates with you, feel free to connect with me at ecdecena [@] gmail.com.
I’m currently based in Cebu City, PH 🏖️.
The contents on this site reflect my thoughts and opinions only. It does not represent the views of any organization, employer, or institution I am affiliated with.
