Gamestudio Links
Zorro Links
Newest Posts
What are you working on?
by Ayumi
8 minutes 11 seconds ago
Performance report on the imported trades
by OptimusPrime
15 minutes 30 seconds ago
Possible to return character vector from R bridge?
by JamesHH
Today at 18:59
Help with Wine on Linux
by AndrewAMD
Today at 16:59
Stock Splits
by AndrewAMD
Today at 16:23
Linux - Help with setting up with Wine and Zorro
by michaelj
Today at 04:49
How to expand Zorro to work with other broker ( like Tradovate )
by AndrewAMD
Today at 02:12
AUM Magazine
Latest Screens
The Space Between
Pogostuck: Rage With Your Friends
Worst Case Z
AckCon'18 - Lotter vs the World 2 - Preview Release
Who's Online
12 registered (AndrewAMD, Ayumi, JamesHH, ChrstphFr, michaelj, Akow, jenGs, Bill_Lin_Fang, alibaba, 1 invisible), 165 Guests and 8 Spiders online.
Key: Admin, Global Mod, Mod
Newest Members
Bill_Lin_Fang, michaelj, ThePituLegend, kankan, Nofip
18207 Registered Users
Topic Options
Rate This Topic
#476851 - 04/13/19 01:16 Best Practice to deal with missing trade data/no trades made?
kreko Offline
Newbie

Registered: 12/15/16
Posts: 12
Hi, I got almost 8 years of BTC/USD data with 1 min resolution. The problem is there are plenty of instances where there are no trades made in any given minute. Especially in the beginning, which in my case is the year 2011.
I took this data set through Python's pandas library and forward filled the missing entries, ie filled all missing minutes with the data from the last minute where data was available. (See screenshots)

Is it a correct approach or I should have kept the missing entries empty as the reality of that moment? What is the correct way of dealing with these cases re backtesting?

Thanks


Attachments
forward_fill.PNG (8 downloads)


Top
#476855 - 04/13/19 09:36 Re: Best Practice to deal with missing trade data/no trades made? [Re: kreko]
jcl Online

Chief Engineer

Registered: 07/22/00
Posts: 26839
Loc: Frankfurt
Better remove all NaN quotes out of the history. Very old BTC data is anyway not well suited for backtests due to the low volume. Only after 2016 BTC backtests became meaningful.

Top
#476861 - 04/13/19 18:21 Re: Best Practice to deal with missing trade data/no trades made? [Re: jcl]
kreko Offline
Newbie

Registered: 12/15/16
Posts: 12
Originally Posted By: jcl
Better remove all NaN quotes out of the history. Very old BTC data is anyway not well suited for backtests due to the low volume. Only after 2016 BTC backtests became meaningful.


Got it, thanks

Top



Gamestudio download | chip programmers | Zorro platform | shop | Data Protection Policy

oP group Germany GmbH | Birkenstr. 25-27 | 63549 Ronneburg / Germany | info (at) opgroup.de