- ago
FMP from Data Extensions B10.
Strange behaviour when trying to download data from DataManager - Downloads now one month or about that.
Downloading history from graph starts from all the time from the beginning. I have managed to download 10 years of history, but all the time I am reopening the graph it starts downloading all the history from the begging.
1
897
35 Replies

Reply

Bookmark

Sort
- ago
#1
Can you tell us the symbol / data range (at the bottom of the chart's status bar)?
0
- ago
#2

Mabe it's ok... Tonight I have managed to dowload to batch 32000... But 50 years of history is only 18250 days. Started dowload one more time to see when it will stop
0
- ago
#3
0
- ago
#4
It's been 15401 days so there should be only 5133 batches of 1-min data to request. In my testing, provider adhered to the rules. In your case it has exceeded the number by a wide margin. Don't know why.

At any rate please let it finish before reopening charts. Also when it does, try to take WL offline from File menu just to see what happens.
0
- ago
#6
0
- ago
#7
Indeed it's odd. FMP can return no more than last 15 years of intraday history so the provider is prepared. It simply won't request more even if you were to specify an unsupported start date in the past explicitly.

I just looked into it under debugger and couldn't reproduce.
0
- ago
#8

My settings for date range on graph
Cleared all data for this data provider and trying one more time
0
- ago
#9
That helped and I have managed to dowload AAPL completely

But when I closed the graph window after that and reopened it and choosed the 1m timeframe it started doing dowload again

I can send you the dowloaded QX file for AAPL if it helps...
0
- ago
#10
Trying to download AMGN, let's wait until it ends. Maybe the provider history data is longer than we think
0
- ago
#11
QUOTE:
Maybe the provider history data is longer than we think

No, the provider is not asking FMP for more than 15 years when requesting an intraday history.

QUOTE:
But when I closed the graph window after that and reopened it and choosed the 1m timeframe it started doing dowload again

A provider simply gets as much data as requested by WL via start/end date. As said above, there's a safety net that prevents it from making unsatisfiable requests. What you describe looks like some WL hiccup rather than provider's.
0
- ago
#12
QUOTE:
Trying to download AMGN, let's wait until it ends. Maybe the provider history data is longer than we think

This download ended on batch ~10000+ with dialog ”Couldn't obtain historical data for symbol”
0
- ago
#13
Is there anything I can do to help isolate the problem?
0
- ago
#14
I don't spot any obvious error in the code and it works fine for me. Perhaps some error from FMP provider while you're downloading batches in Tools > Log viewer. Are there any?
0
- ago
#15

Only these errors, but it's about coin base... I will try to make a download from another PC with Windows 10 Setup. Maybe there I will have a chance.
Dayly bars are loaded fine, but the problem is with one minute bars
0
- ago
#16
I had a large amount of batches load from fmp as well, and info might prove helpful, but appears ok for me presently.

Preface, compared free 30 minute and 15 minute historical from: 12 data, tingo, av, and fmp off hours and in market hours. With limitations on what they provide for free mainly looked at time for bar updates and missing or flat line data. tingo way late on last bar and appears missing data, av and 12 seemed slow and inconsistent on timing, and very limited on bars in free, fmp was fastest to populate finished bars, but it did utilize a huge amount of calls, I say 3-4 times more than others (all done on 500 bars from charts with attached strat). All test data above and below on SPY.

All stated I purchased fmp. Went back into chart with 500 bars of 30 min (attached strat with 5 year test period), data in charts set to 500 bars in preferences, always load all unchecked. I switched it to 15 minutes and it decided I wanted to wait 25 minutes to load near 10k batches.

Appears to have loaded; all to 1993 for daily, w, m, q, yearly, all to 2008 for 5min and 10 min, and the remaining intra are just showing time periods I have request precisely from bars or strat time period.

Appeared ok afterwards and didnot reload. But I didn't ask for the data. Possibly a setting somewhere I need to look at. And it's at it again on IVV the switched the chart from 15m to 30m then to 10m all on 500 bars. First two snapped in at ~5 batches but when I switched to 10 minutes it appears to be going for broke. Pulled around 800 batches and took 10-15 minutes, down to 2008 in 5m and 10m.

Not sure why its pulling so much data. Settings on one side or another are seeming insuring users must have to subscribe to data plans.

Hope this info is helpful to someone.


0
- ago
#17
So the problem reproduces only when trying to dowload 1 min data (causes ifinite dowload untill the memory ends), 5 min data dowload works fine. Have no idea why 1 min download is not OK
0
- ago
#18

Batch 48720
0
Cone8
 ( 4.98% )
- ago
#19
QUOTE:
Appeared ok afterwards and didnot reload. But I didn't ask for the data.
I haven't followed this entire post, buy this statement is missing context. For example, after a backtest in the Strategy Window, data will not reload for another backtest for the same symbol/aDataSet by design. To reload, click the "n Symbol(s) Loaded" message in the status bar.

Also, there was an image above of setting default data options to load "All Data" for intraday. That's not recommended - but maybe as the case may be here, you did that temporarily in order to download all data available to build your local cache.

Could you please summarize the problem with 1 min data. Like Eugene, it works fine for me.
0
- ago
#20
@chuhchuhh, could you please create a 1-minute DataSet and update that instead of choosing 1-Minute from the daily chart?
0
- ago
#21

In progress... Lets wait untill it ends
0
Cone8
 ( 4.98% )
- ago
#22
QUOTE:
please create a 1-minute DataSet
DataSets don't have scales associated with them. ???
0
- ago
#23
You're right, old habits die hard. Obviously I meant to say "create a new DataSet, switch scale to 1-min and update it" - just what topic starter has done.
0
- ago
#24
0
- ago
#25
What a die hard condition. What region settings are applied to your Windows (region, regional format)?
0
- ago
#26

5 minutes dowloads ok
0
- ago
#27
QUOTE:
What a die hard condition. What region settings are applied to your Windows (region, regional format)?

0
- ago
#28
Looks good. Provider has been tested in this locale as well.
0
- ago
#29
https://financialmodelingprep.com/api/v3/historical-chart/1min/AAPL?apikey=<your_API_key_here>&to=2003-09-10

And one quick notice FMP started intraday data collection 20 years ago

{
"date": "2003-09-10 16:00:00",
"open": 0.3981,
"low": 0.3973,
"high": 0.3991,
"close": 0.3984,
"volume": 559832
},
{
"date": "2003-09-10 15:59:00",
"open": 0.3965,
"low": 0.3959,
"high": 0.399,
"close": 0.3975,
"volume": 7749840
},
0
- ago
#30
QUOTE:
Looks good. Provider has been tested in this locale as well.

Please feel free to use API key that I've sent you by email for testing purposes
1
- ago
#31
QUOTE:
And one quick notice FMP started intraday data collection 20 years ago

Indeed. Let's squeeze 5 more years out of it (totaling 20 years) for upcoming build 11 of DataExtensions and see if it changes anything.
0
- ago
#32
And one more quick notice it provides historical intraday data with nearly no delay and when I try to dowload it I only get data ending on previous day
0
- ago
#33
Today is 15/02/2023 and I got data for 5 min candles ending 14/02/2023. But FMP provides data nearly with no delay..
0
- ago
#34
You have made requests for data today. Have you clicked "Clear tracking info"?
0
- ago
#35
Yes, all the time I'm ckicking delete local files than clear tracking info and after that (just in case) restarting WL. To reproduce you need to dowload and try to update data somewhere in the middle of current trading day - you will get only previous day
0

Reply

Bookmark

Sort