Here is the situation:
I have a huge dataset for which I need quick access. This is a set of financial data, so basically the way it is configured is that at every point in time you have data for thousands of stocks. Now loading this data into the program takes some time (20-40 seconds), and I would like it to not be done every time I make changes to the code.
Basically, I had an idea, and I want to know if it makes sense / if it is optimal. I was thinking about setting up some server on which all the downloaded data and all object definitions, and then from the second program / client, I would like to send a predefined class type (strategy class) to the server, ask the server to run the code, and then the server will return the results to me test.
I create trading strategies in this case, so I have an abstract class that defines what “strategies” are. I have a market simulator that calls a derivative strategy every time the date changes, then the strategy buys or sells shares, and then saves the profit from the strategy in some kind of result object. Therefore, I want to be able to code part of the strategy, send it and get the result. I want to avoid loading all the data every time I change the parameters or the source code in the strategy object.
I hope this makes sense to someone, and I'm sorry if this is not very clear. Please let me know if possible, and then how would I go on Google searches? I don’t even know what to look for here.