VALIDATE / PIPELINE

Do not confirm the attractive chart. Try to break it.

The kquant validation pipeline combines independent data, time windows, multiple-testing correction and stress checks into one verdict.

EVIDENCE / VERDICTRESILIENT
UNSEEN
HOLDOUTPASSDSR0.93PBO18%
SYSTEM DOMAIN03 / VALIDATE

Challenge the candidate before risk

  1. DISCOVER
  2. OPTIMIZE
  3. VALIDATE
  4. RUN
  5. OBSERVE
01

Frozen holdout

Reserve data that parameter search never sees.

02

DSR

Adjust Sharpe evidence for trial count, sample length and return shape.

03

PBO

Estimate the probability that the in-sample winner fails out of sample.

04

Walk-forward

Test stability across successive training and validation windows.

DECISION FRAMEWORK

Which independent test could still reject the candidate?

Treat holdout, time stability, multiple-testing correction and stress paths as separate evidence. Agreement matters more than one green metric.

01

Protect unseen data

02

Record every trial

03

Accept FAIL and insufficient data

OUTPUT

Validation verdict

An honest verdict

Not every result should be green

A status describes the current validation procedure. It never guarantees a future result.

PASS

No blocking signal was found by the current test set.

YELLOW

Evidence is incomplete or unstable.

FAIL

A critical validation test failed.

INSUFFICIENT DATA

There are too few observations or trades for a conclusion.

Important

Historical, statistical and model results do not promise future returns. kquant provides computational tools and technical execution, but does not assess whether a specific trade is suitable for a user.