Freeze
The period is fixed before final selection and excluded from tuning.
Frozen holdout separates candidate creation from its final independent evaluation and preserves the provenance of every version.
Challenge the candidate before risk
The period is fixed before final selection and excluded from tuning.
Repeated peeking turns holdout into another training sample and must count as a new trial.
The same rule version, costs and execution assumptions move into holdout.
A strong holdout reduces part of overfitting risk but cannot guarantee future transfer.
Treat holdout, time stability, multiple-testing correction and stress paths as separate evidence. Agreement matters more than one green metric.
Protect unseen data
Record every trial
Accept FAIL and insufficient data
Validation verdict
Historical, statistical and model results do not promise future returns. kquant provides computational tools and technical execution, but does not assess whether a specific trade is suitable for a user.