VALIDATE / UNSEEN DATA

The final answer should come from data the strategy never saw.

Frozen holdout separates candidate creation from its final independent evaluation and preserves the provenance of every version.

EVIDENCE / VERDICTRESILIENT
UNSEEN
HOLDOUTPASSDSR0.93PBO18%
SYSTEM DOMAIN03 / VALIDATE

Challenge the candidate before risk

  1. DISCOVER
  2. OPTIMIZE
  3. VALIDATE
  4. RUN
  5. OBSERVE
01

Freeze

The period is fixed before final selection and excluded from tuning.

02

Controlled access

Repeated peeking turns holdout into another training sample and must count as a new trial.

03

Comparability

The same rule version, costs and execution assumptions move into holdout.

04

Interpretation

A strong holdout reduces part of overfitting risk but cannot guarantee future transfer.

DECISION FRAMEWORK

Which independent test could still reject the candidate?

Treat holdout, time stability, multiple-testing correction and stress paths as separate evidence. Agreement matters more than one green metric.

01

Protect unseen data

02

Record every trial

03

Accept FAIL and insufficient data

OUTPUT

Validation verdict

Important

Historical, statistical and model results do not promise future returns. kquant provides computational tools and technical execution, but does not assess whether a specific trade is suitable for a user.