Gamestudio Links
Zorro Links
Newest Posts
Data from CSV not parsed correctly
by EternallyCurious. 04/25/24 10:20
Trading Journey
by howardR. 04/24/24 20:04
M1 Oversampling
by Petra. 04/24/24 10:34
Zorro FIX plugin - Experimental
by flink. 04/21/24 07:12
Scripts not found
by juergen_wue. 04/20/24 18:51
zorro 64bit command line support
by 7th_zorro. 04/20/24 10:06
StartWeek not working as it should
by jcl. 04/20/24 08:38
folder management functions
by VoroneTZ. 04/17/24 06:52
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
4 registered members (AndrewAMD, Quad, EternallyCurious, 1 invisible), 726 guests, and 5 spiders.
Key: Admin, Global Mod, Mod
Newest Members
Mega_Rod, EternallyCurious, howardR, 11honza11, ccorrea
19048 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Monte Carlo analysis seems amazing #440441
04/25/14 14:28
04/25/14 14:28
Joined: Jul 2013
Posts: 522
D
dusktrader Offline OP
User
dusktrader  Offline OP
User
D

Joined: Jul 2013
Posts: 522
This feature is amazing. It's so simple and fast that it seems too good to be true.

Can you please answer a few questions I have so far:
I see that the simulations are random. Is it possible then that there could be a situation where the reported values could change between tests? I would think this is a Yes, but possibly only noticeable if the # of simulations were very small. For example I have my # of simulations set very high at 2000. It seems that, in a given random sampling, the outcome would tend towards the same result as the # of simulations increase. And this would then be reflective of the real-world expected performance of the trade logic.

Where is the Median AR% figure coming from? That number doesn't seem to change if I increase the # of simulations. I don't think that comes from the 50% confidence level. What is the usefulness of knowing the Median AR% figure? Personally I want to look at the most realistic outcome, about 95%

THANKS

Re: Monte Carlo analysis seems amazing [Re: dusktrader] #440448
04/25/14 17:01
04/25/14 17:01
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
The values don't change between tests because a special random sequence is used that is always the same. Otherwise there would be indeed small changes between tests.

The median AR is the AR at 50% confidence level, i.e. 50% of results are worse and 50% are better. It _is_ the most likely outcome, and also useful for comparison with the 'real' AR. A real AR that is always better or worse than the median AR reveals some information about the system, f.i. a negative or positive self-correlation of the results.

The AR at 95% is not the most realistic AR, it only means that 95% of results get this _or_ a better AR.

Re: Monte Carlo analysis seems amazing [Re: jcl] #440456
04/25/14 18:27
04/25/14 18:27
Joined: Jul 2013
Posts: 522
D
dusktrader Offline OP
User
dusktrader  Offline OP
User
D

Joined: Jul 2013
Posts: 522
Thanks for explaining that. It makes sense.

I did not state that correctly above when I said "I want to look at the most realistic outcome" -- my actual feeling is more like this:

I want to look at a statistically probable outcome that is heavily pessimistically skewed, about 95%. That way, I am setting my expectations in a very conservative way. It will also highlight problems quicker if my real-life outcome is not at least as profitable on average.

Re: Monte Carlo analysis seems amazing [Re: dusktrader] #440651
04/29/14 14:18
04/29/14 14:18
Joined: Jul 2013
Posts: 522
D
dusktrader Offline OP
User
dusktrader  Offline OP
User
D

Joined: Jul 2013
Posts: 522
I'm starting to get confused by the Monte Carlo analysis figures. I think the only value that changes in the Zorro window, as well as the Performance Report is the AR% (or CAGR%)

Would it be possible to see all the metrics adjusted by the Monte Carlo analysis? I'm specifically interested to see a highly-pessimistic result, including things like the monthly average profit, for example.

Ideally I think if MonteCarlo and Confidence are not set (or default), then you should show the report as it is currently. If they are set, then you should reflect all metrics based on that MonteCarlo analysis.

Thanks

Re: Monte Carlo analysis seems amazing [Re: dusktrader] #440657
04/29/14 15:50
04/29/14 15:50
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
That's already so.

Re: Monte Carlo analysis seems amazing [Re: jcl] #440659
04/29/14 15:56
04/29/14 15:56
Joined: Jul 2013
Posts: 522
D
dusktrader Offline OP
User
dusktrader  Offline OP
User
D

Joined: Jul 2013
Posts: 522
Hmm... well as a disclaimer I did say I was "getting confused" so maybe this means I already "am confused" LOL. I am doing a Train now, but when that's done I'll go back and re-Test with and without the MonteCarlo settings. If there seems to be a discrepancy I'll post back here.

THANKS

Ok I did a side-by-side comparison. Does this look correct? I would like the metrics to all reflect the results at the chosen Confidence level, if possible.

The only difference between these 2 tests is that in the one "with-montecarlo" I've added these two lines in the script:
MonteCarlo = 2000;
Confidence = 95;

Attached Files no-montecarlo.pngwith-montecarlo.png
Last edited by dusktrader; 04/29/14 19:39.
Re: Monte Carlo analysis seems amazing [Re: dusktrader] #440872
05/05/14 03:32
05/05/14 03:32
Joined: Sep 2013
Posts: 504
California
G
GPEngine Offline
User
GPEngine  Offline
User
G

Joined: Sep 2013
Posts: 504
California
Monte Carlo is amazing.
Nice job!

Re: Monte Carlo analysis seems amazing [Re: GPEngine] #440883
05/05/14 10:37
05/05/14 10:37
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
Dusktrader: Monte Carlo analysis is used for calculating performance figures from the equity curve, such as annual return, drawdown, etc. For calculating them you must not set the Capital variable, because then the figures are based on your invested capital, not on the equity curve (I think).


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1