Gamestudio Links
Zorro Links
Newest Posts
Zorro FIX plugin - Experimental
by flink. 04/21/24 07:12
Data from CSV not parsed correctly
by EternallyCurious. 04/20/24 21:39
M1 Oversampling
by 11honza11. 04/20/24 20:57
Scripts not found
by juergen_wue. 04/20/24 18:51
zorro 64bit command line support
by 7th_zorro. 04/20/24 10:06
StartWeek not working as it should
by jcl. 04/20/24 08:38
folder management functions
by VoroneTZ. 04/17/24 06:52
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
2 registered members (AndrewAMD, VoroneTZ), 396 guests, and 0 spiders.
Key: Admin, Global Mod, Mod
Newest Members
EternallyCurious, howardR, 11honza11, ccorrea, sakolin
19047 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Skip exporting Signals.csv for DeepLearning -> save time #479591
04/09/20 05:39
04/09/20 05:39
Joined: Dec 2014
Posts: 206
Germany
Smon Offline OP
Member
Smon  Offline OP
Member

Joined: Dec 2014
Posts: 206
Germany
I'm building a script with deep learning. It takes ages, to export the signals.csv datafiles, because I'm using indicators which rely on R and the slow R-Bridge.

I don't want to let this CSV file be recreated when it's already there. I have incorporated the number of the WFOCycle, Asset and number of columns into the filenames to make these files unique.

I know how to check if a file is present, but how can I skip this very step of exporting the signals and creating the CSV files?

Last edited by sdh309795gaas; 04/09/20 09:49.
Re: Skip exporting Signals.csv for DeepLearning -> save time [Re: Smon] #479595
04/09/20 12:13
04/09/20 12:13
Joined: Dec 2014
Posts: 206
Germany
Smon Offline OP
Member
Smon  Offline OP
Member

Joined: Dec 2014
Posts: 206
Germany
Okay, I made some progress:

I can skip the execution with

Code
if(is(RULCYCLE)) return;


Now I just need to find out how I can trigger the neural.train() in R after each RULCYCLE. This should be easy.

Re: Skip exporting Signals.csv for DeepLearning -> save time [Re: Smon] #479602
04/09/20 18:11
04/09/20 18:11
Joined: Dec 2014
Posts: 206
Germany
Smon Offline OP
Member
Smon  Offline OP
Member

Joined: Dec 2014
Posts: 206
Germany
More difficult than I thought!

The filename of the CSV file is set with this:

Code
string signals_csv()
{
	return slash(strf("%sData\\%d_%s_%s_%i.csv", ZorroFolder, WFOCycle, Script, strx(Asset,"/",""), Core));
}



I thought I'd just put this at the beginning of my trading script:

Code
	if(file_length(signals_csv()) > 0)
	{
		adviseLong(NEURAL, 0, 0);  //don't want to lose all the convenience!!!
		return;
	}


I want adviseLong to trigger the neural.train() in R for me.

In neural(NEURAL_TRAIN, ...) I'm preventing the CSV from being overwritten with:

Code
if(file_length(name == 0)) file_write(name,Data,0);


However, the training in R isn't triggered. Why?

Re: Skip exporting Signals.csv for DeepLearning -> save time [Re: Smon] #487619
06/19/23 09:29
06/19/23 09:29
Joined: Feb 2018
Posts: 68
T
tomaslolo Offline
Junior Member
tomaslolo  Offline
Junior Member
T

Joined: Feb 2018
Posts: 68
Hello Smon! Did you find the way to skip the csv creation, so we can train a customised one?

Thank you!


Moderated by  Petra 

Gamestudio download | chip programmers | Zorro platform | shop | Data Protection Policy

oP group Germany GmbH | Birkenstr. 25-27 | 63549 Ronneburg / Germany | info (at) opgroup.de

Powered by UBB.threads™ PHP Forum Software 7.7.1