Gamestudio Links
Zorro Links
Newest Posts
Data from CSV not parsed correctly
by EternallyCurious. 04/18/24 10:45
StartWeek not working as it should
by Zheka. 04/18/24 10:11
folder management functions
by VoroneTZ. 04/17/24 06:52
lookback setting performance issue
by 7th_zorro. 04/16/24 03:08
zorro 64bit command line support
by 7th_zorro. 04/15/24 09:36
Zorro FIX plugin - Experimental
by flink. 04/14/24 07:48
Zorro FIX plugin - Experimental
by flink. 04/14/24 07:46
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
1 registered members (AndrewAMD), 677 guests, and 2 spiders.
Key: Admin, Global Mod, Mod
Newest Members
EternallyCurious, howardR, 11honza11, ccorrea, sakolin
19047 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Huge array for Deep Learning #472798
05/23/18 20:28
05/23/18 20:28
Joined: Jul 2016
Posts: 64
G
gtell Offline OP
Junior Member
gtell  Offline OP
Junior Member
G

Joined: Jul 2016
Posts: 64
Dear all,
dear jcl,

I am designing a strategy which uses Deep Learning with a great number of variables and long sliding window.
I have a sliding window of 128 and 163 features.
This means that I would pass to adviseLong an array of 20864 var.
I can't do it, it crashes.
Do you have any other good idea?
I am thinking to pass only the 163 features and then build the sliding window array from R, but the problem is the prediction part.
How to give to prediction the deepness of the sliding window?
Can you please give me some hint?

Thanks.
Best regards.

Re: Huge array for Deep Learning [Re: gtell] #472801
05/24/18 10:06
05/24/18 10:06
Joined: Jul 2000
Posts: 27,978
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,978
Frankfurt
I have not yet seen a machine learning algorithm with 20,000 features, but theoretically there is no hard limit. Make sure that you allocate this array on the heap, not on the stack, and that you use an objective and not the trade result for prediction. If this does not help, you can contact Support with that script and they'll look into it.

For a sliding window, I would use either a LSTM neural net, or indeed store the data on the R side. In the prediction part, use an array for storing the features, and shift it by 163 with any new incoming feature set.


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1