Reuters News halts after some symbols update
Author: abegy
Creation Date: 12/10/2014 3:14 PM
profile picture

abegy

#1
I have noticed that the download of the Reuters news is not working anymore. Indeed, the system halts after some symbols updates.

For example, I'm unable to update the news for the symbols list of S&P 500
profile picture

Eugene

#2
If it was "not working anymore" as you've just supposed, neither you would be able to update "some symbols" nor it would work perfectly for me right now when I successfully ran it on a Dow 30 symbol. The provider is functioning correctly. Maybe its a connectivity issue, or they're curbing excessive usage, or some symbol returned an unexpected data and the process hang. By the way, which symbol was it as I couldn't find it in your message?
profile picture

abegy

#3
Eugene, It's not a problem with my internet connection because I can update the S&P 500 list without problems if I select Google News.
I have this problem only with Reuters News. There is no specific symbol which blocks the download. I can update one day only 10 symbols and the day after 20,

This mornings, the download stops after AOC. There is no error message.

QUOTE:
Updating Provider Reuters news ...
A 45 news items updated
AA 37 news items updated
AAPL 70 news items updated
ABC 35 news items updated
ABT 50 news items updated
ACAS 11 news items updated
ACS 1 news items updated
ADBE 23 news items updated
ADI 23 news items updated
ADM 34 news items updated
ADP 22 news items updated
ADSK 22 news items updated
AEE 21 news items updated
AEP 22 news items updated
AES 39 news items updated
AET 42 news items updated
AFL 24 news items updated
AGN 46 news items updated
AIG 39 news items updated
AIV 26 news items updated
AIZ 20 news items updated
AKAM 20 news items updated
AKS 16 news items updated
ALL 14 news items updated
ALTR 24 news items updated
AMAT 17 news items updated
AMD 22 news items updated
AMGN 80 news items updated
AMP 13 news items updated
AMT 35 news items updated
AMZN 39 news items updated
AN 3 news items updated
ANF 22 news items updated
AOC 0 news items updated
profile picture

Eugene

#4
It's a problem on your end. The provider is functioning absolutely correctly. I've just updated Reuters News for S&P 500 (using recently updated Yahoo! Classification Groups) which took me 5,180 HTTP requests in total (which means that slightly over 10 HTML pages are processed per each symbol on average). Below you see the log:

QUOTE:
Updating Provider Reuters news ...

A 45 news items updated
AA 37 news items updated
AAPL 70 news items updated
ABBV 61 news items updated
ABC 35 news items updated
ABT 50 news items updated
ACE 21 news items updated
ACN 111 news items updated
ACT 97 news items updated
ADBE 23 news items updated
ADI 23 news items updated
ADM 34 news items updated
ADP 22 news items updated
ADS 36 news items updated
ADSK 22 news items updated
ADT 28 news items updated
AEE 21 news items updated
AEP 22 news items updated
AES 39 news items updated
AET 42 news items updated
AFL 24 news items updated
AGN 46 news items updated
AIG 39 news items updated
AIV 26 news items updated
AIZ 20 news items updated
AKAM 20 news items updated
ALL 14 news items updated
ALLE 14 news items updated
ALTR 24 news items updated
ALXN 33 news items updated
AMAT 17 news items updated
AME 26 news items updated
AMG 10 news items updated
AMGN 80 news items updated
AMP 13 news items updated
AMT 35 news items updated
AMZN 39 news items updated
AN 3 news items updated
AON 12 news items updated
APA 24 news items updated
APC 19 news items updated
APD 29 news items updated
APH 21 news items updated
ARG 25 news items updated
ATI 23 news items updated
AVB 24 news items updated
AVGO 29 news items updated
AVP 21 news items updated
AVY 23 news items updated
AXP 20 news items updated
AZO 4 news items updated
BA 124 news items updated
BAC 91 news items updated
BAX 51 news items updated
BBBY 11 news items updated
BBT 16 news items updated
BBY 18 news items updated
BCR 24 news items updated
BDX 32 news items updated
BEN 12 news items updated
BF-B 0 news items updated
BHI 21 news items updated
BIIB 50 news items updated
BK 24 news items updated
BLK 38 news items updated
BLL 27 news items updated
BMS 25 news items updated
BMY 95 news items updated
BRCM 32 news items updated
BRK-B 0 news items updated
BSX 49 news items updated
BTU 25 news items updated
BWA 23 news items updated
BXP 25 news items updated
C 51 news items updated
CA 22 news items updated
CAG 31 news items updated
CAH 26 news items updated
CAM 22 news items updated
CAT 30 news items updated
CB 16 news items updated
CBG 38 news items updated
CBS 22 news items updated
CCE 27 news items updated
CCI 25 news items updated
CCL 22 news items updated
CELG 53 news items updated
CERN 20 news items updated
CF 20 news items updated
CFN 20 news items updated
CHK 42 news items updated
CHRW 11 news items updated
CI 29 news items updated
CINF 8 news items updated
CL 18 news items updated
CLX 22 news items updated
CMA 10 news items updated
CMCSA 27 news items updated
CME 18 news items updated
CMG 9 news items updated
CMI 19 news items updated
CMS 15 news items updated
CNP 19 news items updated
CNX 20 news items updated
COF 18 news items updated
COG 20 news items updated
COH 20 news items updated
COL 31 news items updated
COP 39 news items updated
COST 11 news items updated
COV 40 news items updated
CPB 26 news items updated
CRM 25 news items updated
CSC 23 news items updated
CSCO 60 news items updated
CSX 24 news items updated
CTAS 16 news items updated
CTL 38 news items updated
CTSH 24 news items updated
CTXS 23 news items updated
CVC 15 news items updated
CVS 31 news items updated
CVX 31 news items updated
D 31 news items updated
DAL 21 news items updated
DD 28 news items updated
DE 24 news items updated
DFS 13 news items updated
DG 23 news items updated
DGX 45 news items updated
DHI 13 news items updated
DHR 31 news items updated
DIS 25 news items updated
DISCA 20 news items updated
DLPH 31 news items updated
DLTR 11 news items updated
DNB 24 news items updated
DNR 16 news items updated
DO 12 news items updated
DOV 29 news items updated
DOW 36 news items updated
DPS 21 news items updated
DRI 31 news items updated
DTE 19 news items updated
DTV 14 news items updated
DUK 26 news items updated
DVA 22 news items updated
DVN 25 news items updated
EA 23 news items updated
EBAY 29 news items updated
ECL 25 news items updated
ED 19 news items updated
EFX 27 news items updated
EIX 17 news items updated
EL 22 news items updated
EMC 24 news items updated
EMN 28 news items updated
EMR 32 news items updated
EOG 17 news items updated
EQR 17 news items updated
EQT 19 news items updated
ESRX 20 news items updated
ESS 22 news items updated
ESV 21 news items updated
ETFC 7 news items updated
ETN 25 news items updated
ETR 28 news items updated
EW 31 news items updated
EXC 31 news items updated
EXPD 8 news items updated
EXPE 27 news items updated
F 51 news items updated
FAST 11 news items updated
FB 29 news items updated
FCX 25 news items updated
FDO 32 news items updated
FDX 25 news items updated
FE 20 news items updated
FFIV 17 news items updated
FIS 39 news items updated
FISV 32 news items updated
FITB 13 news items updated
FLIR 27 news items updated
FLR 54 news items updated
FLS 30 news items updated
FMC 35 news items updated
FOSL 12 news items updated
FOXA 39 news items updated
FSLR 26 news items updated
FTI 49 news items updated
FTR 26 news items updated
GAS 20 news items updated
GCI 31 news items updated
GD 99 news items updated
GE 173 news items updated
GGP 21 news items updated
GHC 22 news items updated
GILD 49 news items updated
GIS 21 news items updated
GLW 21 news items updated
GM 61 news items updated
GMCR 27 news items updated
GME 21 news items updated
GNW 15 news items updated
GOOGL 75 news items updated
GPC 19 news items updated
GPS 34 news items updated
GRMN 22 news items updated
GS 58 news items updated
GT 15 news items updated
GWW 27 news items updated
HAL 31 news items updated
HAR 26 news items updated
HAS 17 news items updated
HBAN 16 news items updated
HCBK 14 news items updated
HCN 36 news items updated
HCP 26 news items updated
HD 22 news items updated
HES 41 news items updated
HIG 23 news items updated
HOG 9 news items updated
HON 59 news items updated
HOT 34 news items updated
HP 13 news items updated
HPQ 100 news items updated
HRB 14 news items updated
HRL 22 news items updated
HRS 71 news items updated
HSP 14 news items updated
HST 23 news items updated
HSY 24 news items updated
HUM 37 news items updated
IBM 148 news items updated
ICE 36 news items updated
IFF 21 news items updated
INTC 62 news items updated
INTU 28 news items updated
IP 20 news items updated
IPG 18 news items updated
IR 31 news items updated
IRM 26 news items updated
ISRG 28 news items updated
ITW 27 news items updated
IVZ 15 news items updated
JBL 26 news items updated
JCI 31 news items updated
JEC 107 news items updated
JNJ 53 news items updated
JNPR 37 news items updated
JOY 22 news items updated
JPM 101 news items updated
JWN 24 news items updated
K 30 news items updated
KEY 16 news items updated
KIM 36 news items updated
KLAC 40 news items updated
KMB 27 news items updated
KMI 11 news items updated
KMX 2 news items updated
KO 27 news items updated
KORS 0 news items updated
KR 33 news items updated
KRFT 17 news items updated
KSS 30 news items updated
KSU 28 news items updated
L 17 news items updated
LB 27 news items updated
LEG 26 news items updated
LEN 17 news items updated
LH 21 news items updated
LLL 29 news items updated
LLTC 14 news items updated
LLY 90 news items updated
LM 21 news items updated
LMT 121 news items updated
LNC 8 news items updated
LO 15 news items updated
LOW 23 news items updated
LRCX 15 news items updated
LUK 21 news items updated
LUV 20 news items updated
LYB 18 news items updated
M 26 news items updated
MA 33 news items updated
MAC 19 news items updated
MAR 0 news items updated
MAS 9 news items updated
MAT 13 news items updated
MCD 17 news items updated
MCHP 32 news items updated
MCK 31 news items updated
MCO 31 news items updated
MDLZ 25 news items updated
MDT 60 news items updated
MET 46 news items updated
MHFI 36 news items updated
MHK 13 news items updated
MJN 26 news items updated
MKC 20 news items updated
MLM 17 news items updated
MMC 26 news items updated
MMM 34 news items updated
MNST 2 news items updated
MO 29 news items updated
MON 32 news items updated
MOS 20 news items updated
MPC 14 news items updated
MRK 91 news items updated
MRO 22 news items updated
MS 45 news items updated
MSFT 96 news items updated
MSI 30 news items updated
MTB 18 news items updated
MU 19 news items updated
MUR 20 news items updated
MWV 23 news items updated
MYL 43 news items updated
NAVI 6 news items updated
NBL 22 news items updated
NBR 9 news items updated
NDAQ 38 news items updated
NE 16 news items updated
NEE 30 news items updated
NEM 35 news items updated
NFLX 16 news items updated
NFX 15 news items updated
NI 20 news items updated
NKE 20 news items updated
NLSN 39 news items updated
NOC 99 news items updated
NOV 18 news items updated
NRG 42 news items updated
NSC 10 news items updated
NTAP 20 news items updated
NTRS 11 news items updated
NU 17 news items updated
NUE 23 news items updated
NVDA 20 news items updated
NWL 37 news items updated
NWSA 17 news items updated
OI 12 news items updated
OKE 22 news items updated
OMC 30 news items updated
ORCL 44 news items updated
ORLY 13 news items updated
OXY 19 news items updated
PAYX 17 news items updated
PBCT 9 news items updated
PBI 25 news items updated
PCAR 9 news items updated
PCG 16 news items updated
PCL 30 news items updated
PCLN 22 news items updated
PCP 14 news items updated
PDCO 21 news items updated
PEG 21 news items updated
PEP 28 news items updated
PETM 23 news items updated
PFE 121 news items updated
PFG 21 news items updated
PG 35 news items updated
PGR 4 news items updated
PH 18 news items updated
PHM 9 news items updated
PKI 25 news items updated
PLD 42 news items updated
PLL 26 news items updated
PM 30 news items updated
PNC 14 news items updated
PNR 24 news items updated
PNW 17 news items updated
POM 23 news items updated
PPG 33 news items updated
PPL 24 news items updated
PRGO 55 news items updated
PRU 20 news items updated
PSA 12 news items updated
PSX 21 news items updated
PVH 24 news items updated
PWR 16 news items updated
PX 42 news items updated
PXD 29 news items updated
QCOM 49 news items updated
QEP 22 news items updated
R 27 news items updated
RAI 15 news items updated
RDC 11 news items updated
REGN 35 news items updated
RF 11 news items updated
RHI 16 news items updated
RHT 28 news items updated
RIG 13 news items updated
RL 17 news items updated
ROK 24 news items updated
ROP 19 news items updated
ROST 24 news items updated
RRC 19 news items updated
RSG 20 news items updated
RTN 98 news items updated
SBUX 33 news items updated
SCG 20 news items updated
SCHW 16 news items updated
SE 16 news items updated
SEE 26 news items updated
SHW 20 news items updated
SIAL 29 news items updated
SJM 22 news items updated
SLB 12 news items updated
SNA 10 news items updated
SNDK 30 news items updated
SNI 16 news items updated
SO 23 news items updated
SPG 27 news items updated
SPLS 26 news items updated
SRCL 11 news items updated
SRE 22 news items updated
STI 13 news items updated
STJ 42 news items updated
STT 22 news items updated
STX 29 news items updated
STZ 20 news items updated
SWK 27 news items updated
SWN 16 news items updated
SWY 32 news items updated
SYK 36 news items updated
SYMC 23 news items updated
SYY 21 news items updated
T 59 news items updated
TAP 13 news items updated
TDC 15 news items updated
TE 22 news items updated
TEG 20 news items updated
TEL 26 news items updated
TGT 30 news items updated
THC 30 news items updated
TIF 28 news items updated
TJX 26 news items updated
TMK 21 news items updated
TMO 37 news items updated
TRIP 22 news items updated
TROW 8 news items updated
TRV 11 news items updated
TSCO 24 news items updated
TSN 34 news items updated
TSO 19 news items updated
TSS 30 news items updated
TWC 33 news items updated
TWX 29 news items updated
TXN 28 news items updated
TXT 30 news items updated
TYC 26 news items updated
UA 14 news items updated
UNH 24 news items updated
UNM 20 news items updated
UNP 13 news items updated
UPS 35 news items updated
URBN 5 news items updated
USB 20 news items updated
UTX 114 news items updated
V 34 news items updated
VAR 23 news items updated
VFC 21 news items updated
VIAB 30 news items updated
VLO 17 news items updated
VMC 12 news items updated
VNO 38 news items updated
VRSN 20 news items updated
VRTX 21 news items updated
VTR 27 news items updated
VZ 42 news items updated
WAG 31 news items updated
WAT 19 news items updated
WDC 27 news items updated
WEC 22 news items updated
WFC 42 news items updated
WFM 17 news items updated
WHR 34 news items updated
WIN 33 news items updated
WLP 0 news items updated
WM 26 news items updated
WMB 25 news items updated
WMT 28 news items updated
WU 30 news items updated
WY 19 news items updated
WYN 25 news items updated
WYNN 16 news items updated
XEC 26 news items updated
XEL 16 news items updated
XL 14 news items updated
XLNX 23 news items updated
XOM 42 news items updated
XRAY 18 news items updated
XRX 45 news items updated
XYL 31 news items updated
YHOO 34 news items updated
YUM 43 news items updated
ZION 18 news items updated
ZMH 25 news items updated
ZTS 26 news items updated
Provider update complete for Reuters news
----------------


Update completed (44 min 15.521 sec)
----------------


Some stocks failed (BF-B, BRK-B expectedly: invalid tickers at Reuters; KORS, WLP might have done for some other reason) which was gracefully handled by the provider as expected.
profile picture

abegy

#5
One question Eugene : Have you done with the Wealth-lab 32 bits version ou 64 bits ? On my side, I'm using the 32 bits at this time.
In any case, I will retry to download without my anti-virus to check if there is an impact or not.
profile picture

Eugene

#6
I'm using 64-bit version with enough RAM. Disabling A/V is a good idea.
profile picture

abegy

#7
I try again to download Reuters news without my antivirus. Unfortunately, I have the same problem. Can you try with the 32 bits version on your side ?

I would like to add that when I try to close the windows, the system starts the cancel process but never finish it. I need to kill the Wealth-lab with the Windows task manager.
profile picture

Eugene

#8
I do not plan to investigate under 32-bit version. It's not worth it. For now, I recommend to use 64-bit version for there's no excuse to not use it. However, in a future release of Reuters News provider I'll make a code change that has demonstrated a positive effect in other providers and remedied some problems. If it works, great, and if it wasn't related, you can always stick with 64-bit version.

profile picture

Eugene

#9
Alexandre,

Give the latest version 2015.01 a try. Happy New Year!
profile picture

abegy

#10
Hi Eugene,

I have again the same problem. I try to download news from a dataset with more than 1 000 symbols and the system looks like to freeze after some time.

Is it possible for you to check ?
profile picture

Eugene

#11
Alexandre,

Clearly you're pushing the limits of the free service. As a workaround try to split your DataSet into chunks and manually update them through the day one by one in "Update DataSet" mode (w/o the "Pricing"), or use Google News.

Good luck!
profile picture

Eugene

#12
Alexandre, I can confirm there's an issue when Wealth-Lab randomly "freezes after some time" during update of Reuters news items. Thanks for reporting it. After revamping the download routine to comply with modern patterns, downloading the news for several hundred stocks went just fine. Look for the fix in upcoming update v2018.03 of the library.
profile picture

Eugene

#13
Fixed. Please update the library.
profile picture

Eugene

#14
The Reuters news provider is currently broken by a website breaking change:

1) Forced Reuters Instrument Code (RIC) which is quite odd. For example, you get the data for MSFT.O and a "404 RIC not found" for MSFT. Needless to say no static data provider would return the data for MSFT.O, making workarounds complex and error-prone.

2) The old links with extensive stock news history are replaced with a new API. Adapting to the change would take a rewrite of the downloader. The real bad news here is that the new data is much more humble: just a dozen of latest key developments. Formerly there could be hundreds.

The data for MSFT.O goes back some whopping 2 weeks which to my mind defeats the purpose of rebuilding the historical news provider. Sad to say but the Reuters News provider is pending deletion from MS123 Fundamental/News in November 2019. Please consider a switch to the WSJ News provider.
This website uses cookies to improve your experience. We'll assume you're ok with that, but you can opt-out if you wish (Read more).