Gamestudio Links
Zorro Links
Newest Posts
MT5 bridge not working on MT5 v. 5 build 4160
by EternallyCurious. 04/25/24 20:49
Data from CSV not parsed correctly
by EternallyCurious. 04/25/24 10:20
Trading Journey
by howardR. 04/24/24 20:04
M1 Oversampling
by Petra. 04/24/24 10:34
Zorro FIX plugin - Experimental
by flink. 04/21/24 07:12
Scripts not found
by juergen_wue. 04/20/24 18:51
zorro 64bit command line support
by 7th_zorro. 04/20/24 10:06
StartWeek not working as it should
by jcl. 04/20/24 08:38
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
4 registered members (EternallyCurious, AndrewAMD, TipmyPip, Quad), 889 guests, and 8 spiders.
Key: Admin, Global Mod, Mod
Newest Members
Mega_Rod, EternallyCurious, howardR, 11honza11, ccorrea
19048 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Backtest averague for strategy robutness #457395
01/16/16 16:27
01/16/16 16:27
Joined: Mar 2015
Posts: 336
Rogaland
N
nanotir Offline OP
Senior Member
nanotir  Offline OP
Senior Member
N

Joined: Mar 2015
Posts: 336
Rogaland
Hi

I am developing a strategy and with WFO=13 and 5 years backtest, I got MI 100$ and Capital 300$. Amazing right? Not really. The equity curve is mostly flat and I just got a huge earnings in a small period of time which in averague provides such a monthly income. If I change the backtest period, then it is a disaster.

My wonder is if it makes sense to perform the same backtest of a strategy in 1,2,3,4,5 years time or in 1 year time but in diferent years and compare all of them. If the PF is similar in all the periods it means that the strategy is robust and it is not overfitted or unprofitable at all.

Such analysis could explain the losses in Z12. I mean, the backtest from 2012 is ok. What about similar backtest from 2014? I know that WFO use diferent periods of time for testing, but it is not the same to begin the test of a strategy from 2014 with 2000$ than to begin the same strategy with 2000$ capital from 2012. A strategy that needs 2000$ in a backtest from 2012 may need 4000$ in a backtest from 2014.

By doing such analysis automatically, one could get a better insight of the profitability of a strategy.

Last edited by Nanitek; 01/16/16 16:27.
Re: Backtest averague for strategy robutness [Re: nanotir] #457432
01/18/16 10:50
01/18/16 10:50
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
Thanks for the suggestion. It can indeed make sense to start a WFO test several times with different starting points that are shifted over a WFO test period. This multiple test would catch such problems as you've described. I'll do some experiments with this method.


Moderated by  Petra 

Gamestudio download | chip programmers | Zorro platform | shop | Data Protection Policy

oP group Germany GmbH | Birkenstr. 25-27 | 63549 Ronneburg / Germany | info (at) opgroup.de

Powered by UBB.threads™ PHP Forum Software 7.7.1