Posted By: HamzaAhmed
What's up with dataParse Handle? - 09/13/22 14:55
Using Zorro Version 2.50.2 on 64 bit Windows 11 Pro.
While enumerating through 4652 historical data csv files and attempting to convert them to T6 format using dataParse in the following manner
I observed that if the value of the Handle (count) exceeds 1500 dataParse does not read csv records.
Therefore I could just convert first 1500 of my 4652 files. As soon as count became 1501 dataParse failed as verified in the Log file
Currently I have side stepped this hitherto undiscovered and serious Zorro bug [attempting to lay my hands on a Zorro S(uper) license] by resetting count to 1 when it exceeds 1500.
Proof is in the Logs
I have successfully converted all my 4652 history csv files to T6 format correctly but seriously what's up with dataParse Handle?
While enumerating through 4652 historical data csv files and attempting to convert them to T6 format using dataParse in the following manner
Code
int Records = dataParse(count,Format,InName); printf("\n%d lines read from %s",Records,InName);
I observed that if the value of the Handle (count) exceeds 1500 dataParse does not read csv records.
Code
dataParse (int Handle, string Format, string Filename, int Start, int Num): int
Therefore I could just convert first 1500 of my 4652 files. As soon as count became 1501 dataParse failed as verified in the Log file
Code
1497 -> GTEIT_eod.csv 2680 lines read E:\Zorro_2502\CSV\BSE\GTEIT_eod.t6 1498 -> GTLINFRA_eod.csv 3904 lines read E:\Zorro_2502\CSV\BSE\GTLINFRA_eod.t6 1499 -> GTL_eod.csv 4557 lines read E:\Zorro_2502\CSV\BSE\GTL_eod.t6 1500 -> GTNINDS_eod.csv 4250 lines read E:\Zorro_2502\CSV\BSE\GTNINDS_eod.t6 1501 -> GTNTEX_eod.csv 0 lines read E:\Zorro_2502\CSV\BSE\GTNTEX_eod.t6 1502 -> GTPL_eod.csv 0 lines read E:\Zorro_2502\CSV\BSE\GTPL_eod.t6 1503 -> GTV_eod.csv 0 lines read
Currently I have side stepped this hitherto undiscovered and serious Zorro bug [attempting to lay my hands on a Zorro S(uper) license] by resetting count to 1 when it exceeds 1500.
Code
// reset count back to 1 since dataparse does not parse data with handle greater than 1500 // nice chance to grab Zorro S so I can use multiple cores and find my buried love for C++ if (count == 1501){ count = 1; }
Proof is in the Logs
Code
1497 -> GTEIT_eod.csv 2680 lines read from E:\Zorro_2502\CSV\BSE\GTEIT_eod.csv E:\Zorro_2502\CSV\BSE\GTEIT_eod.t6 1498 -> GTLINFRA_eod.csv 3904 lines read from E:\Zorro_2502\CSV\BSE\GTLINFRA_eod.csv E:\Zorro_2502\CSV\BSE\GTLINFRA_eod.t6 1499 -> GTL_eod.csv 4557 lines read from E:\Zorro_2502\CSV\BSE\GTL_eod.csv E:\Zorro_2502\CSV\BSE\GTL_eod.t6 1 -> GTNINDS_eod.csv 4250 lines read from E:\Zorro_2502\CSV\BSE\GTNINDS_eod.csv E:\Zorro_2502\CSV\BSE\GTNINDS_eod.t6 2 -> GTNTEX_eod.csv 3615 lines read from E:\Zorro_2502\CSV\BSE\GTNTEX_eod.csv E:\Zorro_2502\CSV\BSE\GTNTEX_eod.t6 3 -> GTPL_eod.csv 1275 lines read from E:\Zorro_2502\CSV\BSE\GTPL_eod.csv E:\Zorro_2502\CSV\BSE\GTPL_eod.t6 4 -> GTV_eod.csv 999 lines read from E:\Zorro_2502\CSV\BSE\GTV_eod.csv E:\Zorro_2502\CSV\BSE\GTV_eod.t6 5 -> GUFICBIO_eod.csv 4597 lines read from E:\Zorro_2502\CSV\BSE\GUFICBIO_eod.csv E:\Zorro_2502\CSV\BSE\GUFICBIO_eod.t6
I have successfully converted all my 4652 history csv files to T6 format correctly but seriously what's up with dataParse Handle?