Gamestudio Links
Zorro Links
Newest Posts
Blobsculptor tools and objects download here
by NeoDumont. 03/28/24 03:01
Issue with Multi-Core WFO Training
by aliswee. 03/24/24 20:20
Why Zorro supports up to 72 cores?
by Edgar_Herrera. 03/23/24 21:41
Zorro Trader GPT
by TipmyPip. 03/06/24 09:27
VSCode instead of SED
by 3run. 03/01/24 19:06
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
5 registered members (TipmyPip, AndrewAMD, Quad, aliswee, degenerate_762), 970 guests, and 4 spiders.
Key: Admin, Global Mod, Mod
Newest Members
sakolin, rajesh7827, juergen_wue, NITRO_FOREVER, jack0roses
19043 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Best Practice to deal with missing trade data/no trades made? #476851
04/12/19 23:16
04/12/19 23:16
Joined: Dec 2016
Posts: 12
K
kreko Offline OP
Newbie
kreko  Offline OP
Newbie
K

Joined: Dec 2016
Posts: 12
Hi, I got almost 8 years of BTC/USD data with 1 min resolution. The problem is there are plenty of instances where there are no trades made in any given minute. Especially in the beginning, which in my case is the year 2011.
I took this data set through Python's pandas library and forward filled the missing entries, ie filled all missing minutes with the data from the last minute where data was available. (See screenshots)

Is it a correct approach or I should have kept the missing entries empty as the reality of that moment? What is the correct way of dealing with these cases re backtesting?

Thanks

Attached Files forward_fill.PNG
Re: Best Practice to deal with missing trade data/no trades made? [Re: kreko] #476855
04/13/19 07:36
04/13/19 07:36
Joined: Jul 2000
Posts: 27,977
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,977
Frankfurt
Better remove all NaN quotes out of the history. Very old BTC data is anyway not well suited for backtests due to the low volume. Only after 2016 BTC backtests became meaningful.

Re: Best Practice to deal with missing trade data/no trades made? [Re: jcl] #476861
04/13/19 16:21
04/13/19 16:21
Joined: Dec 2016
Posts: 12
K
kreko Offline OP
Newbie
kreko  Offline OP
Newbie
K

Joined: Dec 2016
Posts: 12
Originally Posted By: jcl
Better remove all NaN quotes out of the history. Very old BTC data is anyway not well suited for backtests due to the low volume. Only after 2016 BTC backtests became meaningful.


Got it, thanks


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1