Gamestudio Links
Zorro Links
Newest Posts
Alternative to Stooq for Zorro S
by cwford. 10/09/26 21:13
Stooq now requires an API key
by cwford. 10/08/26 23:27
ZorroGPT
by TipmyPip. 10/06/26 05:32
Purchase A8 full licence version
by jcl. 10/05/26 12:12
AUM Magazine
Latest Screens
Dorifto samurai
Shadow 2
Rocker`s Revenge
Stug 3 Stormartillery
Who's Online Now
0 registered members (), 21,757 guests, and 1 spider.
Key: Admin, Global Mod, Mod
Newest Members
JimSimons, julienp, julienper, KelleyAbbey, Yopachi
19246 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Best Practice to deal with missing trade data/no trades made? #476851
04/12/19 23:16
04/12/19 23:16
Joined: Dec 2016
Posts: 12
K
kreko Offline OP
Newbie
kreko  Offline OP
Newbie
K

Joined: Dec 2016
Posts: 12
Hi, I got almost 8 years of BTC/USD data with 1 min resolution. The problem is there are plenty of instances where there are no trades made in any given minute. Especially in the beginning, which in my case is the year 2011.
I took this data set through Python's pandas library and forward filled the missing entries, ie filled all missing minutes with the data from the last minute where data was available. (See screenshots)

Is it a correct approach or I should have kept the missing entries empty as the reality of that moment? What is the correct way of dealing with these cases re backtesting?

Thanks

Attached Files forward_fill.PNG
Re: Best Practice to deal with missing trade data/no trades made? [Re: kreko] #476855
04/13/19 07:36
04/13/19 07:36
Joined: Jul 2000
Posts: 28,140
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 28,140
Frankfurt
Better remove all NaN quotes out of the history. Very old BTC data is anyway not well suited for backtests due to the low volume. Only after 2016 BTC backtests became meaningful.

Re: Best Practice to deal with missing trade data/no trades made? [Re: jcl] #476861
04/13/19 16:21
04/13/19 16:21
Joined: Dec 2016
Posts: 12
K
kreko Offline OP
Newbie
kreko  Offline OP
Newbie
K

Joined: Dec 2016
Posts: 12
Originally Posted By: jcl
Better remove all NaN quotes out of the history. Very old BTC data is anyway not well suited for backtests due to the low volume. Only after 2016 BTC backtests became meaningful.


Got it, thanks


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1