Today I had a SELL signal at local time 10:50. It successfully filled but the Order Manger did not recognize the fill, so it continued to issue SELL signals. For some reason it did not do so every ten minutes. The next SELL for the same position was issued an hour later.
Coincidentally, it appears that the streaming chart that uses Tradier streaming also stopped updating at 10:50. Both of these errors have been happening occasionally but randomly. The only correlation seems to be that when this happens it is immediately after a trade is placed (lack of position syncing + streaming stops).
A manual "Request Updates from Broker" resynced the Accounts page positions. The streaming chart was updated when streaming (red dot) was disabled and re-enabled. There is no log error for the syncing error, and there never is.
There were previous disconnects this day logged in the Log Viewer, but it looks like that may have been unrelated as it looks like it successfully reconnected.
QUOTE:
Signal Quantity Symbol "Security Name" "Order Type" "Order Price" Status "Fill Qty" "Fill Price" Timestamp Message "Signal Source" Account
Sell 1 QQQ241210C00515000 Invesco QQQ Trust Market 0 CancelPending 0 0 12/5/2024 11:50:14 SMAK Trader, QQQ;Tradier, 10 Minute, Tradier, [acct#], US Stocks [acct#]
Sell 1 QQQ241210C00515000 Invesco QQQ Trust Market 0 CancelPending 0 0 12/5/2024 12:50:06 SMAK Trader, QQQ;Tradier, 10 Minute, Tradier, [acct#], US Stocks [acct#]
Sell 1 QQQ241210C00515000 Invesco QQQ Trust Market 0 Placed 0 0 12/5/2024 13:00:05 SMAK Trader, QQQ;Tradier, 10 Minute, Tradier, [acct#], US Stocks [acct#]
Coincidentally, it appears that the streaming chart that uses Tradier streaming also stopped updating at 10:50. Both of these errors have been happening occasionally but randomly. The only correlation seems to be that when this happens it is immediately after a trade is placed (lack of position syncing + streaming stops).
A manual "Request Updates from Broker" resynced the Accounts page positions. The streaming chart was updated when streaming (red dot) was disabled and re-enabled. There is no log error for the syncing error, and there never is.
There were previous disconnects this day logged in the Log Viewer, but it looks like that may have been unrelated as it looks like it successfully reconnected.
QUOTE:
Timestamp Source Message Exception
"12/5/2024 06:03:02:291" "Tradier" "06:03:02.291 Initiating Tradier accounts socket...Start"
"12/5/2024 06:03:03:569" "Tradier" "06:03:03.569 Tradier Broker Connected on sessionID: 9a02b8d6-e77e-44b8-bc0d-9f25be82f14e"
"12/5/2024 08:20:51:014" "Tradier" "08:20:51.014 Tradier Broker socket transient disconnect: Lost;"
"12/5/2024 08:20:53:341" "Tradier" "Tradier Streaming Reconnected after Lost on sessionID: 74c0eb41-5362-4aa5-94a7-4253b53631d1"
"12/5/2024 08:21:02:306" "Tradier" "08:21:02.306 Tradier Broker socket disconnected: Error; Reconnecting..."
"12/5/2024 08:21:09:368" "Tradier" "08:21:09.368 Tradier Broker reconnected after Error"
"12/5/2024 08:21:20:316" "Tradier" "08:21:20.316 Tradier Broker socket transient disconnect: Lost;"
"12/5/2024 08:21:21:588" "Tradier" "08:21:21.588 Tradier Broker reconnected after Lost"
"12/5/2024 08:21:25:554" "Tradier" "Tradier Streaming Reconnected after Lost on sessionID: 74c0eb41-5362-4aa5-94a7-4253b53631d1"
Rename
This failure happens only occasionally now. The last Tradier streaming bar was at (local) 7:15 (partial) and order manager did not recognize a fill shortly after placing trades for 3 symbols at 7:30. In the streaming chart window, there is a red dot next to the streaming widget.
Clicking on the streaming button to disconnect / reconnect gets the streaming chart working again. I had to reconnect Tradier in the Order Manager window. That go the order manager working again.
Here's the log from this morning, including error and recovery messages. I thought the error log might be useful to you in figuring out why it did not recover.
Clicking on the streaming button to disconnect / reconnect gets the streaming chart working again. I had to reconnect Tradier in the Order Manager window. That go the order manager working again.
Here's the log from this morning, including error and recovery messages. I thought the error log might be useful to you in figuring out why it did not recover.
QUOTE:
Timestamp Source Message Exception
"2/26/2025 06:01:36:439" "Tradier" "06:01:36.439 Initiating Tradier accounts socket...Start"
"2/26/2025 06:01:37:823" "Tradier" "06:01:37.823 Tradier Broker Connected on sessionID: e327c912-6c0f-47be-9ce5-16f7538f9776"
"2/26/2025 06:43:07:380" "Tradier" "06:43:07.380 Tradier Broker socket transient disconnect: Lost;"
"2/26/2025 06:43:08:737" "Tradier" "06:43:08.737 Tradier Broker reconnected after Lost"
"2/26/2025 07:15:01:135" "Tradier" "07:15:01.135 Tradier Broker socket transient disconnect: Lost;"
"2/26/2025 07:15:02:493" "Tradier" "07:15:02.493 Tradier Broker reconnected after Lost"
"2/26/2025 07:15:07:730" "Tradier" "Tradier Streaming Reconnected after Lost on sessionID: 19883c59-084e-4f7c-bcb1-a49c4d804e43"
"2/26/2025 07:29:11:808" "Tradier" "07:29:11.808 Tradier Broker socket disconnected ByServer. Click Connect or restart WealthLab."
"2/26/2025 07:29:11:923" "Tradier" "07:29:11.923 07:29:11.923 Reset Broker Socket: ByServer Socket.Stop() result: True"
"2/26/2025 07:29:42:425" "Tradier" "Streaming Disconnected - attempting Reconnect: Error, NormalClosure, SessionId: 19883c59-084e-4f7c-bcb1-a49c4d804e43"
"2/26/2025 07:29:49:349" "Tradier" "Streaming Socket failed Start"
"2/26/2025 07:30:49:631" "Tradier" "07:30:49.631 Initiating Tradier accounts socket...Start"
"2/26/2025 07:30:51:065" "Tradier" "07:30:51.065 Tradier Broker Connected on sessionID: a5ae8fec-e20e-45ac-ba9d-4bb3bd1cf9a2"
"2/26/2025 07:30:52:449" "Tradier" "Connected"
"2/26/2025 07:53:21:844" "Tradier" "Streaming Disconnected - attempting Reconnect: Error, NormalClosure, SessionId: fe59ddb1-9c40-40bf-9e40-eb726b454f23"
"2/26/2025 07:53:23:648" "Tradier" "Tradier Streaming connect failed: One or more errors occurred. (Failed to start Websocket client , error: 'The server returned status code '502' when status code '101' was expected.')" "One or more errors occurred. (Failed to start Websocket client , error: 'The server returned status code '502' when status code '101' was expected.') Inner Exception: Failed to start Websocket client , error: 'The server returned status code '502' when status code '101' was expected.'"
"2/26/2025 07:55:11:671" "Tradier" "07:55:11.671 Tradier Broker socket disconnected ByServer. Click Connect or restart WealthLab."
"2/26/2025 07:55:11:794" "Tradier" "07:55:11.794 07:55:11.794 Reset Broker Socket: ByServer Socket.Stop() result: True"
"2/26/2025 07:56:48:043" "Tradier" "07:56:48.043 Initiating Tradier accounts socket...Start"
"2/26/2025 07:56:49:860" "Tradier" "Connected"
"2/26/2025 07:56:49:422" "Tradier" "07:56:49.422 Tradier Broker Connected on sessionID: 258a5c6c-5f0a-4f71-bf09-8152522e1f5c"
502 is Tradier Server error - and looks like it was a temporary condition because it did connect about a minute later. That's as good as it gets. Servers aren't "up" all the time, there's maintenance, switching around with load balancing, etc.
@Cone, thanks for taking a look at that. My instinct was that these errors are originating with Tradier because of their randomness but I wasn't sure. Thanks for confirming. I will send an email to Tradier support, so they are aware of it.
Except, when it "Connected", it wasn't really connected because streaming was not working, and the broker connection was not re-established.
Except, when it "Connected", it wasn't really connected because streaming was not working, and the broker connection was not re-established.
Streaming uses a different [socket] connection, but do you mean that WealthLab wasn't aware that the broker socket had reconnected?
Were you able to click "Connect" (or restart) like the message indicated?
Were you able to click "Connect" (or restart) like the message indicated?
QUOTE:
"2/26/2025 07:29:11:808" "Tradier" "07:29:11.808 Tradier Broker socket disconnected ByServer. Click Connect or restart WealthLab."
"Yes" to both questions.
It seems that broker connection and streaming connection consistently break at the same time. When it happens, it always seems to be just when multiple orders are placed, but it could be when an order is filled (but it is not marked as filled in WL).
It seems that broker connection and streaming connection consistently break at the same time. When it happens, it always seems to be just when multiple orders are placed, but it could be when an order is filled (but it is not marked as filled in WL).
QUOTE:Sure, due to a single point of failure - internet dropout or server issue, both of which are evidenced in the log.
It seems that broker connection and streaming connection consistently break at the same time.
My guess is that "it happens" when you're placing orders because that's when you notice it. Otherwise it's a silent error unless you're monitoring the connection status or Log viewer. The connection tries to recover as much as possible, but if the server is serving up 502's, it ain't going to happen.
The last messages in the log at 07:56:49.. indicate that the Broker "Connected". There wasn't a message that Streaming did too. What evidence is there that that "connection was not re-established" at that time?
QUOTE:
My guess is that "it happens" when you're placing orders because that's when you notice it.
Not sure about that. ("Happens" = disconnects but doesn't reconnect functionally)
When I notice that streaming has stopped or filled orders have not been detected by WL Order Manager, I check the log, and the last entry is generally "Connected" at around 7:30 AM. That's the only time in the day when a specific strategy places multiple orders. It's happened so many times I didn't think it was a coincidence.
QUOTE:
What evidence is there that that "connection was not re-established" at that time?
1. Streaming data is not up-to-date or updating anymore. I can get it working by disconnecting and reconnecting streaming from chart.
2. The WL Order Manager does not reflect a fill that happened after that message. Also, green "Connect" button is lit. After I manually connect, it seems to work OK.
Another disconnection of streaming and broker services without reconnect. Could not immediately reconnect broker. Later, green "Connect" button appeared on order manager screen, and when pressed it appeared to successfully connect to broker. Streaming service and data updates stopped and did not recover until I manually disconnected / reconnected streaming from chart.
Let me know if these log updates are repetitive or do not provide helpful new clues for you.
Let me know if these log updates are repetitive or do not provide helpful new clues for you.
QUOTE:
Timestamp Source Message Exception
"3/4/2025 06:01:28:020" "Tradier" "06:01:28.020 Initiating Tradier accounts socket...Start"
"3/4/2025 06:01:29:291" "Tradier" "Connected"
"3/4/2025 06:01:29:291" "Tradier" "06:01:29.291 Tradier Broker Connected on sessionID: 64064f88-60ec-42a9-8e41-d1e94b9d984f"
"3/4/2025 07:51:20:558" "Tradier" "07:51:20.558 Tradier Broker socket transient disconnect: Lost;"
"3/4/2025 07:51:21:615" "Tradier" "07:51:21.615 Tradier Broker socket disconnected: Error; Reconnecting..."
"3/4/2025 07:51:25:530" "Tradier" "Streaming Disconnected - attempting Reconnect: Error, , SessionId: 5569140e-87ed-4936-bb94-b84208ea7664"
"3/4/2025 07:51:43:293" "Tradier" "07:51:43.293 Tradier Broker reconnected after Error"
"3/4/2025 07:51:43:393" "Tradier" "Streaming Reconnect Successful"
"3/4/2025 08:32:11:040" "Tradier" "08:32:11.040 Tradier Broker socket disconnected ByServer. Click Connect or restart WealthLab."
"3/4/2025 08:32:11:128" "Tradier" "08:32:11.128 08:32:11.128 Reset Broker Socket: ByServer Socket.Stop() result: True"
"3/4/2025 08:32:16:539" "Tradier" "Tradier Streaming Reconnected after Lost on sessionID: c9dfc323-4352-408e-8e90-d33c9d0a269a"
"3/4/2025 08:33:38:714" "Tradier" "Streaming Disconnected - attempting Reconnect: Error, , SessionId: c9dfc323-4352-408e-8e90-d33c9d0a269a"
"3/4/2025 08:33:42:938" "Tradier" "Tradier Streaming connect failed: One or more errors occurred. (Failed to start Websocket client , error: 'The server returned status code '502' when status code '101' was expected.')" "One or more errors occurred. (Failed to start Websocket client , error: 'The server returned status code '502' when status code '101' was expected.') Inner Exception: Failed to start Websocket client , error: 'The server returned status code '502' when status code '101' was expected.'"
Your Response
Post
Edit Post
Login is required