Gamestudio Links
Zorro Links
Newest Posts
Data from CSV not parsed correctly
by EternallyCurious. 04/18/24 10:45
StartWeek not working as it should
by Zheka. 04/18/24 10:11
folder management functions
by VoroneTZ. 04/17/24 06:52
lookback setting performance issue
by 7th_zorro. 04/16/24 03:08
zorro 64bit command line support
by 7th_zorro. 04/15/24 09:36
Zorro FIX plugin - Experimental
by flink. 04/14/24 07:48
Zorro FIX plugin - Experimental
by flink. 04/14/24 07:46
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
4 registered members (ozgur, EternallyCurious, howardR, 1 invisible), 623 guests, and 0 spiders.
Key: Admin, Global Mod, Mod
Newest Members
EternallyCurious, 11honza11, ccorrea, sakolin, rajesh7827
19046 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Asset History Questions #484303
10/03/21 21:30
10/03/21 21:30
Joined: Jun 2013
Posts: 1,609
D
DdlV Offline OP
Serious User
DdlV  Offline OP
Serious User
D

Joined: Jun 2013
Posts: 1,609
Some of these issues of this big topic have been hinted at elsewhere, but I can't recall seeing explicit recommendations...

a) Should separate History be maintained for each Broker used? (Obviously at the expense of disk, potentially lots of disk)
b) Does this matter less for EOD History? I.e., can any Broker's History be used for EOD?
c) Does it matter more and more the finer the Trading time period is?
d) If I read the manual right, some of the Z Systems are Tested using a simulated Oanda account but with FXCM data? When is this mix-and-match OK? At what BarPeriod or other measure does it become critical to use the target Broker's History?
e) If one has multiple History files for an Asset, possibly with partially overlapping data, can those safely be combined? Is there a helper script to do so?

And so on... As I said, a big topic...

Re: Asset History Questions [Re: DdlV] #484306
10/04/21 09:06
10/04/21 09:06
Joined: Jul 2000
Posts: 27,978
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,978
Frankfurt
You need different histories when a) the prices are broker dependent and b) the differences matter for your strategy.

Re: Asset History Questions [Re: DdlV] #484308
10/04/21 19:34
10/04/21 19:34
Joined: Jun 2013
Posts: 1,609
D
DdlV Offline OP
Serious User
DdlV  Offline OP
Serious User
D

Joined: Jun 2013
Posts: 1,609
Thanks @jcl.

Actually, for that portion, I was asking more metrics and/or "rule of thumb" questions... Let me try a different way:

a) For long-term periods between trades - f.i. Z8, Z9, strategies that don't trade intra-day, etc. - EOD data from anywhere is good enough? Whatever differences there might be won't matter?

b) For shorter periods, the example mentioned above was data from one Broker while simulating trading at a different Broker. Is there a metric or "rule of thumb" to tell when likely "the differences matter" without the time, trouble, disk space, etc. of actually downloading a whole 'nother set of data to test?

c) In cases where we've ended up with multiple History files for an asset that we wish to combine, is there a helper script to accomplish this?

Thanks.

Re: Asset History Questions [Re: DdlV] #484310
10/05/21 15:23
10/05/21 15:23
Joined: Jul 2000
Posts: 27,978
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,978
Frankfurt
Z8 and Z9 trade stocks and ETFs. They are traded on exchanges. Their prices are not made up by the broker.

As a rule of thumb, when you trade Forex, CFDs, Cryptos, or any other asset where any broker has different prices, and your system runs on ticks or short bars less than 10 minutes, then you should compare backtests with prices from different sources and find out if the results are affected.

Re: Asset History Questions [Re: DdlV] #484311
10/05/21 16:31
10/05/21 16:31
Joined: Jun 2013
Posts: 1,609
D
DdlV Offline OP
Serious User
DdlV  Offline OP
Serious User
D

Joined: Jun 2013
Posts: 1,609
Thanks @jcl. That's much clearer.

Z8/9 were meant as examples of long time-frame trading more than price source. A better example would have been Z10 where Crypto prices are Broker-dependent - since it uses daily bars Broker intra-day price differences don't matter, correct?

Thanks.

Re: Asset History Questions [Re: DdlV] #484317
10/07/21 07:46
10/07/21 07:46
Joined: Jul 2000
Posts: 27,978
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,978
Frankfurt
Yes, for daily prices the broker differences are negligible.

Re: Asset History Questions [Re: DdlV] #484320
10/07/21 15:25
10/07/21 15:25
Joined: Jun 2013
Posts: 1,609
D
DdlV Offline OP
Serious User
DdlV  Offline OP
Serious User
D

Joined: Jun 2013
Posts: 1,609
@jcl,

Thanks!

For combining/merging History files, is there a helper script I've missed?

Thanks.

Re: Asset History Questions [Re: DdlV] #484436
10/25/21 23:02
10/25/21 23:02
Joined: Jun 2013
Posts: 1,609
D
DdlV Offline OP
Serious User
DdlV  Offline OP
Serious User
D

Joined: Jun 2013
Posts: 1,609
@jcl,

I assume, then, there is no existing helper script for this.

If I undertake to do this, are there particular dangers or other issues one should beware of in combining History files?

Thanks.

Re: Asset History Questions [Re: DdlV] #484439
10/26/21 01:14
10/26/21 01:14
Joined: Feb 2017
Posts: 1,725
Chicago
AndrewAMD Offline
Serious User
AndrewAMD  Offline
Serious User

Joined: Feb 2017
Posts: 1,725
Chicago
The t6 files are nothing more than dataSets with six fields. Use the file and dataset functions.

Re: Asset History Questions [Re: DdlV] #484445
10/26/21 11:05
10/26/21 11:05
Joined: Apr 2008
Posts: 585
Austria
Petra Offline
Support
Petra  Offline
Support

Joined: Apr 2008
Posts: 585
Austria
The simplest way is merging files with the copy command. Bill Gates helps: https://docs.microsoft.com/en-us/windows-server/administration/windows-commands/copy


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1