Gamestudio Links
Zorro Links
Newest Posts
Blobsculptor tools and objects download here
by NeoDumont. 03/28/24 03:01
Issue with Multi-Core WFO Training
by aliswee. 03/24/24 20:20
Why Zorro supports up to 72 cores?
by Edgar_Herrera. 03/23/24 21:41
Zorro Trader GPT
by TipmyPip. 03/06/24 09:27
VSCode instead of SED
by 3run. 03/01/24 19:06
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
2 registered members (AndrewAMD, VoroneTZ), 831 guests, and 5 spiders.
Key: Admin, Global Mod, Mod
Newest Members
sakolin, rajesh7827, juergen_wue, NITRO_FOREVER, jack0roses
19043 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
M1 tick data format #479347
03/21/20 04:38
03/21/20 04:38
Joined: Mar 2020
Posts: 41
J
jbhunter Offline OP
Newbie
jbhunter  Offline OP
Newbie
J

Joined: Mar 2020
Posts: 41
I am wanting to experiment with some 1 minute tick data (M1). To start with I can get SPY for ~$15 of about 20 years in csv format to mess around with. I am curious now the path to get csv to zorro format files. For formatting I am good with c# and the ZHistoryEditor seems to be dotNet, I was thinking of leaning on that to figure out how to parse and output the zorro format. Does anyone know if ZHistoryEditor is open source? Am running the wrong path from a price and/or effort point of view? Is there an easier path? Any suggestions welcomed.

Thanks

Re: M1 tick data format [Re: jbhunter] #479348
03/21/20 08:48
03/21/20 08:48
Joined: Mar 2016
Posts: 1
U
ugofx Offline
Guest
ugofx  Offline
Guest
U

Joined: Mar 2016
Posts: 1
Look at CSVtoHistory.c
In case of problems search with that name in the forum.

Re: M1 tick data format [Re: jbhunter] #479364
03/24/20 05:13
03/24/20 05:13
Joined: Mar 2020
Posts: 41
J
jbhunter Offline OP
Newbie
jbhunter  Offline OP
Newbie
J

Joined: Mar 2020
Posts: 41
This script is very handy. Hopefully I can use this for my data. If anything the comments show the format there is code to decipher output for the zorro history files.

Thanks!

Re: M1 tick data format [Re: jbhunter] #479398
03/26/20 20:21
03/26/20 20:21
Joined: Mar 2020
Posts: 41
J
jbhunter Offline OP
Newbie
jbhunter  Offline OP
Newbie
J

Joined: Mar 2020
Posts: 41
I have some data now. Some of the dates were YYYY-mm-dd and some were YYYY.mm.dd. I changed them all to YYYYmmdd. The data looks like below.

Date,Time,Open,High,Low,Close
20200102,093000,3244.67,3247.4,3244.67,3247.22
20200102,093100,3247.19,3247.22,3245.01,3245.22
20200102,093200,3245.07,3245.54,3244.16,3244.66
20200102,093300,3244.89,3247.69,3244.89,3247.61
20200102,093400,3247.38,3248.08,3246.92,3246.92
20200102,093500,3246.89,3249.15,3246.89,3249.09
20200102,093600,3249.02,3249.45,3248.2,3249.45
20200102,093700,3249.38,3249.63,3248.49,3248.54

I am using a format in CSVtoHistory.c like below.
string Format = "%Y%m%d,%H%M%S,f3,f1,f2,f4"

I am getting .t6 output files. However when trying to use in backtest I get "No asset data for SPX".

When load the .t6 files in ZHistoryEditor am getting "2000.12.31 00:00" for all of the dates. It is picking up the open/high/low/close data. And the spread and vol are showing zeros.

Any thoughts on what is happening here? I notice in the help files there is mention of using Verbose=7 to debug. I tried setting this in the zorro.ini and in the .c script but I am not seeing any log/debug output. Any help appreciated. Thanks!

Re: M1 tick data format [Re: jbhunter] #479400
03/27/20 07:02
03/27/20 07:02
Joined: Jul 2000
Posts: 27,977
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,977
Frankfurt
"No asset data" means the SPX data is missing in your asset list. The format string is missing a "+". And no debug output means that your attempts to set Verbose have not yet been successful.

Re: M1 tick data format [Re: jcl] #479408
03/27/20 12:20
03/27/20 12:20
Joined: Mar 2020
Posts: 41
J
jbhunter Offline OP
Newbie
jbhunter  Offline OP
Newbie
J

Joined: Mar 2020
Posts: 41
jcl, thanks for the help.

I added the + for decending order.

I added an asset list, now I am getting Error 55. No valid ticks, No bars generated.

I added set(LOGFILE) to CSVtoHistory and am now seeing the debug info. It appears to be grabbing the date in OA format. I am not sure what the 0.39722222 and 0.39791667 refer to.

DTA: 34 MB allocated
20040906,093200,1114.75,1114.75,1114.65,1114.65

38236.00000000 0.39722222 1114.75000 1114.75000 1114.65000 1114.65000
20040906,093300,1114.65,1114.65,1114.65,1114.65

38236.00000000 0.39791667 1114.65000 1114.65000 1114.65000 1114.65000 ....... 1528310 records
1528310 lines read

Re: M1 tick data format [Re: jbhunter] #479410
03/27/20 12:47
03/27/20 12:47
Joined: Mar 2020
Posts: 41
J
jbhunter Offline OP
Newbie
jbhunter  Offline OP
Newbie
J

Joined: Mar 2020
Posts: 41
I finally figured this one out. I changed my format of the date in my date to 9:32:00, and my format spec to

string Format = "+%Y%m%d,%H:%M:%S,f3,f1,f2,f4,f5,f6";

I also had to pad my date with ,0,0 at the end to zero out the spread and vol data. This appears to be working. Is it possible to parse data without the spread and volume data?

Thanks!


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1