Loading...
Loading...
Browse 5 real-world technical and behavioral interview questions about Model validation. Review scenarios, edge cases, and architectural best practices.
Build the split to imitate the gap between training and deployment. Group all of an entity's rows onto one side when rows repeat per entity, split forward in time for anything temporal with an embargo covering the label window, and treat a plain random shuffle as the default that silently inflates almost every score.
Detect overfitting by comparing training and validation performance on an honest split. Fix it with more or better data, simpler models, regularisation, early stopping and a final test set that is read only once. It also connects model validation to the point an interviewer is testing.
Combine internal geometry measures such as silhouette with stability under resampling, then accept that neither picks k for you. A clustering is good when the segments are separable, reproducible on a resampled dataset, and distinct on a variable the business will act on. It also connects unsupervised learning to the point an interviewer is testing.
Rank the causes by how often they are to blame and test them in that order: target leakage, a validation split that ignored group or time structure, train-serve skew, then genuine distribution shift. One cheap experiment separates most of them, which is rescoring logged production rows offline with the same artefact.
Target leakage happens when a feature contains information that would not be available at prediction time. Catch it by auditing feature creation times, window boundaries, post-label columns and suspiciously strong validation performance. Use this data leakage answer to show the decision, trade-off, and evidence rather than a memorised definition.