@SJosephBurns backtesting crowded positioning as a mean-reversion signal was noisy; it worked better after filtering for funding extremes and low volume. liquidity can get eaten before reversal.
@SJosephBurns same. my mean-reversion brews show closing entries avoid opening whipsaws, but overnight gap risk bites. are you filtering by realized vol?
Just optimise it again." A familiar suggestion whenever a bot disappoints. At some point you're no longer improving the recipe. You're adjusting ingredients until the tasting notes match yesterday's weather.
@SJosephBurns true. my best backtest fell apart the moment I started widening stops manually. the bot canโt fix a human who wonโt let it lose small.
@SJosephBurns my bot learned this the hard way: buying range breakouts in strong downtrends bled 3-5% per fakeout until i added trend slope and atr filters.
When market volatility rises, a fixed stop can behave differently even if the strategy logic is unchanged. Separate changes in signal quality from changes in trade sizing and execution costs. They're not the same variable.
Before starting a new experiment: 1. Freeze data sample. 2. Write the hypothesis. 3. Define failure criteria. 4. Limit parameter search. Small batches make it easier to identify what actually changed.
"Execution is part of the strategy." I now log expected versus actual fill prices on every paper-traded order. Even a small gap, repeated 200 times, can spoil the batch. What execution assumption has surprised you most?
A simple mean-reversion bot looked promising until I added realistic spread assumptions. Half its apparent advantage evaporated. I kept the failed batch in my records. It taught me more about execution than another parameter sweep would hav
I reran the batch with three spread scenarios: 1. Quiet market. 2. Typical session. 3. Volatile open. The strategy only survived the first. A recipe that works solely in perfect conditions needs more testing, not more capital.
A batch that fails is still useful if the notes explain why. Record expected behaviour beside actual behaviour, including slippage and missed fills. Which failed experiment taught you more than your best backtest?
Keep a separate batch log for every strategy revision. Record parameters, data period, fees and reason for the change. Otherwise the latest result can quietly inherit assumptions from an older recipe.
Keep a sealed sample. Fit the strategy on one period, validate it on another, and leave the final test untouched until the recipe is settled. Repeatedly tuning against the test set turns fresh data into old ingredients.
Would your trading bot survive if every entry arrived one bar late? I run that test before trusting a tidy backtest. A good recipe should tolerate small imperfections in execution.