Glitch8
 ( 12.08% )
- ago
The beloved Data Tool is now the #1 most requested Feature!

So that means that after NeuroLab, if it retains this lead, it will be the next major feature we work on. We'd like to integrate old Data Tool features directly into the Data Manager instead of creating a new Data Tool window.

Let's discuss which are the most important Data Tool functionality that should go into the first pass of this effort, and how they should be nicely integrated into the Data Manager UI.
1
726
11 Replies

Reply

Bookmark

Sort
- ago
#1
That's good news, indeed!

I would say the most important functions in the initial effort (more can be added later) are:
1) Data truncation (incl the option to Remove all data).
2) Remove inactive symbols (incl sub-window: Also remove symbols with last data before {user-defined date}). Currently, I see no way to delete inactive symbols other that to remove than one by one from the dataset, which is very tedious; a right-click option to delete individual symbols would be better than nothing... but the best would be the en masse removal via Data Tool.
3) Change a symbol across all (provider-compatible) datasets.
[Adapted from my Post #2 in: https://www.wealth-lab.com/Discussion/Please-restore-Data-Tool-in-WL7-5643]
0
Glitch8
 ( 12.08% )
- ago
#2
What about checking DataSets for potentially bad data, such as zeroes, etc?
0
- ago
#3
There are a host of "bad data" issues that the Data Tool should be considering. "Zeros" are one, Lows > Highs, negative Volume, etc. If you are looking at including this capability, I suggest that all of the checks performed in some of the WL6 Utility Scripts be included.

Vince
1
- ago
#4
QUOTE:
2) Remove inactive symbols ...

Or renaming symbols in all datasets (like WLPro did for Fidelity data) when there's a ticker symbol change. This is the most important feature.
0
Glitch8
 ( 12.08% )
- ago
#5
You can already very easily change the symbols in a DataSet from a number of places. What additional functionality is really needed here, do you mean, like globally replace all symbol ABC to XYZ among all DataSets?
0
- ago
#6
QUOTE:
3) Change a symbol across all (provider-compatible) datasets.

The same symbol may be in multiple datasets of the same/different provider(s) (e.g. Dow 30, SP100, SP500, etc).
0
Glitch8
 ( 12.08% )
- ago
#7
Gotcha!
0
- ago
#8
Thank you!

I'm not sure of the purpose of Configure vs Update Data Set but doing one should fix the other given that they don't sync as they should as I described in a previous post.

I agree about the bad symbol tools. I had to manually delete one by one and it was very frustrating.
0
- ago
#9
QUOTE:
1) (incl the option to Remove all data).

As already suggested, "Remove all data" is implemented natively. Look up my answer in the topic you're citing.
https://www.wealth-lab.com/Discussion/Please-restore-Data-Tool-in-WL7-5643

QUOTE:
1) Data truncation

Data truncation is an afterthought. I would not like seeing this function reappear as is. We should aim to solve the issue behind it, preferably elegantly / without user interaction rather than copy the Data Tool's patterns in a lighthearted manner:
https://www.wealth-lab.com/Discussion/Please-restore-Data-Tool-in-WL7-5643

QUOTE:
The same symbol may be in multiple datasets of the same/different provider(s) (e.g. Dow 30, SP100, SP500, etc).

The "mass symbol rename" option a la Fidelity's should be approached with care. I don't want to have one symbol renamed automatically across different providers' DataSets. Because they may belong to different markets. This also has a potential to break some providers which match symbols to internal IDs to retrieve data.

QUOTE:
There are a host of "bad data" issues that the Data Tool should be considering. "Zeros" are one, Lows > Highs, negative Volume, etc. If you are looking at including this capability, I suggest that all of the checks performed in some of the WL6 Utility Scripts be included.

IMHO, the Data Tool in WL6 has advanced to have more checks (like "synthetic" data detection) than the script you're talking about?
0
- ago
#10
You guys are the best judge of what/how to implement, I'm just happy the Data Tool is making a reappearance!

One thing I would like to add, though:
When you right-click a provider in Data Manager > Historical Providers you get 3 options one of which is Clear Internal Request Tracking Info, but when you right-click on a provider under Event Providers there are no choices; from personal experience I can say that I've deleted FundamentalData subfolder of a provider several times and restarted WL7 but the Fundamental data doesn't download, WL7 says it is up to date, perhaps that needs an internal reset too just like Hist data.
[Not sure if this is off-topic??]
1
Glitch8
 ( 12.08% )
- ago
#11
I was already thinking we need that, thanks for the reminder!
1

Reply

Bookmark

Sort