๐Ÿ˜ Stock Market Elephant/The Graveyard Series
The graveyard series ยท prologue

The full story: why we built a lie detector before a trading bot

Jul 21, 2026 ยท 11 min read

The motivation

This project started with a simple, slightly heretical observation: the prop-firm industry has changed what "capital" means for a trader. You no longer need $25,000 and a margin account. You need roughly the price of a video game โ€” an evaluation fee โ€” and an edge that actually exists. Firms will rent you $50,000 of buying power all day long; what they're really selling is a test, and what they're really buying is your failure rate.

Which reframes the entire problem. If accounts are cheap and capital is rented, the scarce resource isn't money โ€” it's a verified edge. Not a strategy that looks good. Not a strategy someone sells you. A strategy you can defend to a hostile statistician, because the eval structure means you'll pay for every illusion in fees, resets, and months of your life.

So before we let a single order near a market, we made a decision that shaped everything after it: we would build the machinery for catching self-deception first, and the trading strategy second. The strategy is maybe 400 lines of code. The apparatus for proving whether it's real is several times that. We think that ratio is correct, and the fact that it's unusual is most of why retail trading looks the way it does.

The rules we set before starting

The process, honestly told

Week one: the machine. We built the backtesting engine and immediately did the thing that felt most uncomfortable: hired an adversarial review of our own code โ€” multiple independent passes hunting for bugs that flatter results. It found thirteen, including one that quietly inflated our headline strategy by about 15%. Every published number you'll see came after those fixes, with a regression test pinning each bug shut. If you've never red-teamed your own backtester, your results have an asterisk you haven't priced.

Then: the gauntlet. Every strategy idea โ€” ours, borrowed, or bought โ€” ran the same three tests: walk-forward (parameters chosen on the past, traded blind on the next quarter), purged cross-validation (does the edge exist across eras, with leak-proof gaps between train and test), and combinatorial CPCV producing the two numbers this series keeps returning to: the Probability of Backtest Overfitting, and the deflated Sharpe ratio that charges you for every idea you tried. As a control, we fed the gauntlet pure random noise: it correctly scored it as garbage. A lie detector you haven't tested on lies is just a mood ring.

Then: the graveyard. Parts 2 through 6 of this series. Roughly a dozen enhancement ideas โ€” pullback entries, volume confirmation, trend filters, tight stops, clever exits, an intraday session no one had reason to doubt, even institutional order-flow data we bought specifically to test one hypothesis. The kill rate was about ninety percent. That number felt brutal in the moment and feels like the entire point in retrospect: the gauntlet's job is to be a place where ideas die cheaply, so they don't die expensively in a funded account.

Throughout: automation with discipline. A nightly worker grinds a research backlog while we sleep โ€” every item carrying a pre-written, data-backed test that defines "done." It merges its own work only when the full test suite and the item's own verification pass; otherwise the work waits on a branch for review. Twice it refused to merge because it couldn't reproduce a number we'd claimed โ€” and it was right, and the fix (committing the exact experiment grid to the repository, forever) made the whole project reproducible by a stranger. We recommend being audited by your own robots. They have no feelings to spare.

What we actually believe now

After all of it, our certified edge is almost embarrassingly plain: a morning breakout system with one filter, riding winners into the close, sized by written rules. Its honest profile is a thin, real edge โ€” a coin weighted a few points past fair, flipped four times a week. No secret. No indicator stack. The entire value lives in two places the sales pages never mention: the verification that the coin is actually weighted, and the discipline machinery that keeps a human from un-weighting it mid-drawdown.

The uncomfortable summary of months of work: finding an edge took a week. Proving it wasn't a lie took everything else. And the market still holds the only vote that counts โ€” which is why the final stage of this project is a pre-registered live paper campaign, with decision rules written down before the first trade.

This series exists because every part of that paragraph is checkable. The methods are in the posts. The math is in the calculator. The failures are documented next to the successes. We are not selling a strategy โ€” we're demonstrating a standard, because we think the standard is the actual edge.

Educational content only โ€” not financial advice; no performance promised or implied. All research described uses real CME MNQ data with realistic costs; backtests differ from live trading. Futures trading involves substantial risk of loss.