- ago
Hi,

I read that some of you have many parameters, but are not optimizing them all at once. I learned at a workshop that you should optimize always all parameters at the same time (at least all parameters of the entry without transaction weight).

Was this a wrong teaching or just not covering all feasible ways to create strategies?

Werner
0
277
Solved
4 Replies

Reply

Bookmark

Sort
- ago
#1
QUOTE:
... have many parameters, but are not optimizing them all at once. I learned at a workshop that you should optimize ... all parameters at the same time ...

Both approaches are correct but under different circumstances. Let's start with the production strategy that's fully developed.

1) For a production strategy, you should optimize all parameters together but ...
a) Your production strategy shouldn't have more than 10 parameters. I usually try to minimize mine to 5 or 6. You're over fitting if you try to include more, in which case your strategy won't stand the test of time.
b) Each parameter shouldn't have more than 10-15 possible values. I usually try to limit mine between 4 to 6. More than that and the optimization will take forever without much meaningful progress.

2) For a strategy under development, you may have 25 parameters, so you need to divide and conquer to have any hope of optimizing it. And that means optimizing a few related (i.e. interacting) parameters at a time.
a) Your goal should be to figure out which parameters have a low variance across different stocks and can simply be set to a constant for all cases, and which parameters have a high variance across different stocks and may need to be set differently for different stocks or group of stocks (e.g. a dataset with large cap, value stocks).
b) You're also trying to find the correct range limits for each parameter. You want to set those as tight as possible (so the optimizer doesn't get lost in right field), and still cover all the salient values.
c) You want to find the appropriate increment for each parameter. It's probably not time efficient for the optimizer to go over 6 to 8 possible values for a given parameter; 5 possible values is a good choice. Some optimizers like SMAC ignore the specified increment.

I hope that clarifies things better.

Off topic, but the market is constantly changing. So I would pick modern adaptive indicators to use with your strategy over the older non-adaptive indicators. You can learn technical analysis with the older indicators (A good idea), but then choose their modern counterpart that's adaptive. That should stabilize your strategy best with a minimal number of parameters.
1
Best Answer
- ago
#2
Thank you very much for the detailed answer.

You mean with "in production" that you are trading a strategy and from time to time you are optimizing its parameters. I guess that you do this on a Walk Forward basis?

Thanks for the other advices regarding parameters. I wonder if it makes sense to test each indicator alone thoroughly - that might be the way to learn how to use it in an optimal fashion within a strategy.

Best regards
Werner
0
- ago
#3
QUOTE:
You mean with "in production" that you are trading a strategy and from time to time you are optimizing its parameters.

That's correct.

QUOTE:
I guess that you do this on a Walk Forward basis?

No, Walk Forward analysis is something totally different. You should start (or find) a new topic to discuss that. Briefly, Walk Forward analysis is about testing the robustness of your strategy model against out-of-sample (OOS) data that you have not optimized against. If your model is robust, then it should trade profitably against all price data whether or not the optimizer has seen it or not. And if you've over fitted your strategy with too many parameters, it won't be robust.

QUOTE:
I wonder if it makes sense to test each indicator alone thoroughly ...
That's exactly what the indicator profiler extension does. Again, you should find an existing (via Search) Indicator Profiler topic to ask more questions about that. But first you need to download and install it. https://www.wealth-lab.com/extension/detail/IndicatorProfiler
0
- ago
#4
OK, thank you so much for your help!
1

Reply

Bookmark

Sort