Outsample Request an audit

Outsample Research

Tested on data
it never saw.

We stress-test trading strategies with the tests most backtests never face, and we build indicators that pass the same gauntlet before they ship. No signals. No promises. Evidence.

strategy_042 · BTCUSDT · 8H
in-sample out-of-sample
resamples 0 permutation p · bear-year calmar · verdict testing…
Sample figure. Every audit report opens with its verdict and shows every test behind it.
0path resamples per audit
0permutation runs, seed disclosed
0hard gates before a verdict
0signals sold, ever

01 · The problem

Most backtests are marketing.

A strategy tuned to its own history will look brilliant on that history. The equity curve is smooth, the ratios are spectacular, and none of it survives contact with data it has not seen.

The industry calls this a track record. Statistics calls it overfitting. The difference between the two is exactly one test, and almost nobody runs it before selling you the result.

We run it. It is the whole company.

in-sample out-of-sample
Fig. 1 · What overfitting looks like. Brilliant in sample. Broke the moment it met new data.

02 · The method

The Gauntlet.

Every audit we deliver and every verdict we publish runs the same battery. It is designed to kill strategies. The ones that survive have earned it.

  1. G1

    Baseline profile

    The strategy as submitted. Full history, honest costs, no tuning. The floor everything else is measured from.

  2. G2

    Path risk

    50,000 reorderings of the trade sequence. Ruin probability, abandonment probability, terminal-loss probability.

  3. G3

    Regime slicing

    One continuous run, sliced by market regime. A bear-year failure is a verdict, not a footnote.

  4. G4

    Parameter neighborhood

    If the settings are a lucky peak, the neighborhood collapses. Robust settings live on plateaus.

  5. G5

    Permutation

    The strategy re-run on thousands of shuffled histories. If randomness explains the returns, we say so, with the p-value and the seed.

Every report states its limitations, every assumption is flagged, and Pine ports ship with an exact parity proof. The full methodology page publishes with our first public verdict. Honesty is not proprietary.

03 · Services

Two ways to use the engine.

Strategy validation audit

Send your strategy. Get a verdict: robust, fragile, or overfit, with every test shown.

  • Trade audityour trade export, path-risk battery$99
  • Full gauntletyour Pine script, ported with parity proof, all five gates$299
  • Deep customPython systems, multi-asset, scoped with youfrom $599

3 to 5 business days. If we cannot test it honestly, we decline it before you pay.

Start an audit intake

Indicator & strategy development

Your idea, built properly in Pine or Python, delivered privately with honest limitations stated.

  • Indicatorbuilt clean, documentedfrom $149
  • Strategywith a real backtest, costs includedfrom $349
  • Strategy + validationdevelopment plus the full gauntletfrom $599

5 to 10 business days. One revision round included. Your code stays yours.

Start a build intake

04 · The Verdict series

Public stress-tests of popular strategies.

The same engine customers pay for, run in public on strategies traders actually use. First target, in production now: SuperTrend. The verdict will be whatever the evidence says. That is the point.

05 · Questions

Asked before you ask.

Do you sell signals?

No, and we never will. We sell evidence about strategies, and tools that were tested before they shipped. If someone promises you entries and exits with a win rate, that is the product we exist to check.

Will you tell me my strategy is good?

We will tell you what the evidence says. Verdicts come out robust, fragile, or overfit, and we publish the same battery against popular public strategies, so you can see we mean it.

What do I need to submit?

Tier 1 needs a trade export from any platform. Tier 2 needs your Pine script, shared read-only. Deep work is scoped person to person. Every intake states exactly what we assumed and what we could not verify.

Why should I trust the verdict?

Because we show the work. Pine ports include a parity proof against the original, permutation runs disclose their seeds, and the methodology is public. You are not asked to trust us, you are shown the evidence.

Is my strategy safe with you?

Your code is read privately, never published, never reused, and deleted on request after delivery. The report is yours. We keep only what we need to stand behind the verdict.

What does a verdict of overfit cost me?

The same as any other verdict. You are paying for the truth about a strategy before the market charges you more for the same lesson.