SST control plane

Consumer instance dashboard

Watch registered instances, queue health, hydration batches, and recent event traffic from one place. This is the shortest path to seeing whether SST is healthy, stale, or quietly swallowing poison messages.

Instances Queue Monitor Hydration Events Fanout Alerts Failures Credentials
Instances
3
registered consumers tracked right now
Ready
3
instances that have called ready
Fan-out eligible
2
ready targets; heartbeat health is advisory
Healthy
2
fresh heartbeat plus no queue red flags
Failed batches
2
hydration batches that need attention
Stale batches
1
unresolved past the operator timeout
Open alerts
1
persisted monitor findings requiring review
What this dashboard watches

Operational signals

Live data
Instance state Inbound queue Outbound queue DLQ pressure Hydration batches Recent events Lane fanout
Client secrets are never rendered here. Queue URLs, readiness URLs, and event/audit history are safe to inspect.
Alert logic

How health is derived

Rules
Healthy: heartbeat in the last 5 minutes and no queue/DLQ failure.
Stale: heartbeat between 5 and 15 minutes old.
Offline: heartbeat older than 15 minutes.
Failed: disabled instance, queue error, or DLQ messages present.
Fan-out eligibility: ready, non-disabled instances receive events only while their heartbeat lease is valid; lease expiry holds new fan-out without disabling the instance.
Instances

Registered consumer instances

This list separates delivery eligibility from heartbeat health. A lease-expired instance remains registered and can recover through its ready/rehydration handshake.
Instance Status Heartbeat Queue health Credentials Capabilities
Otangeles PCC production consumer
otangeles · prod · open detail
Key: otangelesPccProd
Healthy ready Fan-out Eligible
Heartbeat is fresh and the instance is ready.
Ready, non-disabled instance has a valid heartbeat lease; each lane still requires its declared capability and queue.
2026-10-09T05:42:20+00:00
Ready: 2026-09-26T08:10:59+00:00
Processed: unknown
Healthy
Inbound visible: 0
Outbound visible: 0
Inbound DLQ: 0
Outbound DLQ: 0
Client key: sst-prod-otangeles-otangelespccprod-01m21fpych6kjdatttrdj28jz3
Credential status: active
Manifest: v3
patient_events
Otangeles PCC test consumer
otangeles · test · open detail
Key: otangelesPccTest
Healthy ready Fan-out Eligible
Heartbeat is fresh and the instance is ready.
Ready, non-disabled instance has a valid heartbeat lease; each lane still requires its declared capability and queue.
2026-10-09T05:41:34+00:00
Ready: 2026-09-03T07:12:03+00:00
Processed: unknown
Healthy
Inbound visible: 0
Outbound visible: 0
Inbound DLQ: 0
Outbound DLQ: 0
Client key: sst-test-otangeles-otangelespcctest-01m1hsaj6mfmrndwtnqc0qfkb7
Credential status: active
Manifest: v3
patient_events hydration
Backroom Staff Auto
backroomstaff · test · open detail
Key: backroomStaffAuto
Offline ready Fan-out Lease expired
Instance was ready, but the heartbeat window expired.
Heartbeat lease expired after 1800 seconds. New fan-out is held until the instance heartbeats and calls ready; the instance remains registered and is not disabled.
2026-08-02T06:05:08+00:00
Ready: 2026-06-23T11:00:08+00:00
Processed: unknown
Healthy
Inbound visible: 0
Outbound visible: 0
Inbound DLQ: 0
Outbound DLQ: 0
Client key: sst-test-backroomstaff-backroomstaffauto-01kvt26bfhayz99hdwenddrx1q
Credential status: active
Manifest: v3
hydration facility_events patient_events provider_events
Queue monitor

Instance queue pressure

This is the operator view for backlog, delayed messages, and DLQ pressure without opening the instance detail page.
All queues
Instance Inbound Outbound
Otangeles PCC production consumer
otangeles · prod
otangelesPccProd
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Otangeles PCC test consumer
otangeles · test
otangelesPccTest
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Backroom Staff Auto
backroomstaff · test
backroomStaffAuto
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Hydration batches

Recent hydration runs

0 active
Batch Status Instance Counts
01M1K1RH29QQ8CDBWF2DQTYBS4
consumer-hydration:test:otangeles:otangelesPccTest:01M1K1RH29QQ8CDBWF2DQTYBS4
 applied
Published: 2026-09-03T07:13:10+00:00
Otangeles PCC test consumer
otangelesPccTest
Messages: 43
Received: 2026-09-03T07:13:10+00:00
Applied: 2026-09-03T07:15:17+00:00
01M1K18ARTARD5G0E8CJM2XFQ0
consumer-hydration:test:otangeles:otangelesPccTest:01M1K18ARTARD5G0E8CJM2XFQ0
 failed
Published: 2026-09-03T07:04:22+00:00
Otangeles PCC test consumer
otangelesPccTest
Messages: 67
Received: 2026-09-03T07:04:22+00:00
Applied: n/a
01M1HSAKZBXAW37NPH8CDHD4MD
consumer-hydration:test:otangeles:otangelesPccTest:01M1HSAKZBXAW37NPH8CDHD4MD
 stale
Published: 2026-09-02T19:25:24+00:00
Otangeles PCC test consumer
otangelesPccTest
Messages: 1
Received: n/a
Applied: n/a
01KVT26DFKGSXD3JAQ92WR00V4
consumer-hydration:test:backroomstaff:backroomStaffAuto:01KVT26DFKGSXD3JAQ92WR00V4
 applied
Published: 2026-06-23T11:00:08+00:00
Backroom Staff Auto
backroomStaffAuto
Messages: 1
Received: 2026-06-23T11:01:56+00:00
Applied: 2026-06-23T11:01:56+00:00
01M1J6523NQZQ98FJZ24SNCAGM
consumer-hydration:test:otangeles:otangelesPccTest:01M1J6523NQZQ98FJZ24SNCAGM
 failed
Published: n/a
Otangeles PCC test consumer
otangelesPccTest
Messages: 0
Received: n/a
Applied: n/a
Event explorer

Search and review recent events

Filter by event id, object id, event type, or the queue / instance key that carried the event.
1830 matching
Clear filters
Event Object Status
01M221WZV8G93DRFNHSSWA23D9
adt_record.synced
adt_record
30889559
 applied
Attempts: 1
01M221WZXCBS1NPEFMSSNX3RCR
adt_record.synced
adt_record
30889475
 applied
Attempts: 1
01M221WZZG352D24GNYBZ2GYD3
adt_record.synced
adt_record
30889557
 applied
Attempts: 1
01M221X01SK756NNTY5SHW9P6C
adt_record.synced
adt_record
30889553
 applied
Attempts: 1
01M221X03XCCZT5M20ZP2VKQEA
adt_record.synced
adt_record
30889490
 applied
Attempts: 1
01M221X0601FG0FVN1F11N7NT3
adt_record.synced
adt_record
30889007
 applied
Attempts: 1
01M221X080WQM2Y0NF7Z9XEZV2
adt_record.synced
adt_record
30888440
 applied
Attempts: 1
01M221X0A3Q4GHNZR80SD7CTYH
adt_record.synced
adt_record
30888320
 applied
Attempts: 1
01M221X0C7QY96HAMGV3W3RBM8
adt_record.synced
adt_record
30888170
 applied
Attempts: 1
01M221X0ET57D13KJ79Z6KXFG1
adt_record.synced
adt_record
30887940
 applied
Attempts: 1
01M221WZG24E2J7V80QRCAQE5M
adt_record.synced
adt_record
30890041
 applied
Attempts: 1
01M221WYZV8SSJAJA57QHKGKCK
adt_record.synced
adt_record
31129497
 applied
Attempts: 1
Showing 877 - 888 of 1830 matching events.
Previous Next
Lane fanout

Recent events pushed to ready instances

This is the record of SST taking an accepted event and pushing it into each matching consumer instance lane.
18 recent
Event Instance Status Queue
01a11ea4-e60a-73bf-894e-786cd2c838d9
condition.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 58b664f4-9941-42bc-80b6-f6904e67ef9e
01a11ea4-e19e-7384-9ddb-4f33a7e42af5
condition.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: f89d4f7f-e76b-4f2b-918f-e057581c4f01
01a11ea4-d3f1-7319-af45-676fdae7fa8a
observation.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: e1469e21-a27a-46c6-8add-b1dc8d580903
01a11ea4-d1a4-7152-870a-a6d83c68f2cd
coverage.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 87a30261-4b81-4205-b610-048ec86b5bce
01a11ea4-d065-733e-a3b4-58f9f4c8dcaa
allergy_intolerance.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 9a0e4956-1221-47aa-983d-262ed2569de9
01a11ea4-c793-73d6-98c1-f25625cdfb36
observation.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 997253b3-f2d9-4210-9651-851d41a944b8
01a11ea4-576d-70b7-b01f-13917f2b3f56
observation.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: dd85987c-f544-4e75-88c6-46aed8ee8a09
01a11ea4-f292-708f-93ad-88da4f3466c1
medication.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 839d2d53-f1fe-4b4f-bfa5-033449b1379e
01a11ea3-8ffc-72a0-ba9e-45a86cace25a
adt_record.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: c4abd43c-e69d-4e15-8591-98a7f1cd2f15
01a11ea3-8d61-70aa-983a-47c7710f5335
observation.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 2f4f84a8-74c2-4f83-9795-7d107540e2ef
01a11ea3-8b8a-71b4-bb81-bd369ac1c688
medication.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 03f9973e-a31d-45dd-b144-3dfb444313c8
01a11ea4-dd6d-70d8-b653-7ed0382aae02
adt_record.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 6c40d7ce-4aad-48fc-beea-649148fa0eaa
01a11ea4-d66a-727c-9128-b848312e065b
coverage.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 9def8c32-c87c-43a3-9bb4-928c1f8c393a
01a11ea4-7b18-726b-9eda-0a4b0dc507eb
allergy_intolerance.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 8cdca347-8476-49af-9699-4bfdc6783673
01a11ea3-344f-7085-923f-6e4961726d56
condition.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: f23762ae-ce14-4a10-87a7-f0f9f656e477
01a11ea3-1657-7366-8bc4-8c6509178227
coverage.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 2c0f97dd-12cd-4189-9a51-88a90dfcd001
01a11ea3-a553-73cb-9807-98715184b9a0
allergy_intolerance.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 071c2e45-22a3-430d-82d3-0893be0a098a
01a11ea3-a0be-7106-8ea6-afcc8df7bf5d
medication.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: f11bde31-844a-424b-9975-7ba5715db745
Alerts

Persisted monitor findings

The health monitor records lease expiry and newly stale or failed hydration work. Resolved lease alerts remain in the database for review.
1 open
consumer_lease_expired

Consumer delivery lease expired: Backroom Staff Auto

warning
Heartbeat lease expired for Backroom Staff Auto (backroomStaffAuto). New lane fan-out is held until the instance heartbeats and calls ready; the instance remains registered and is not disabled.
Last seen: 2026-10-09T05:43:03+00:00
Failures

Operational red flags

This collapses stale instances, failed batches, and queue/DLQ pressure into one place.
4 items
instance

Backroom Staff Auto

offline
Instance was ready, but the heartbeat window expired.
hydration

01M1K18ARTARD5G0E8CJM2XFQ0

failed
Abandoned after hydration capability table-contract mismatch; replaced by canonical-only publisher.
hydration

01M1HSAKZBXAW37NPH8CDHD4MD

stale
Hydration is still published after the operator timeout.
hydration

01M1J6523NQZQ98FJZ24SNCAGM

failed
Abandoned after synchronous ready timeout; replaced by queued hydration handoff.
Audit logs

Operator action trail

Every replay, redrive, credential rotation, pause, and resume is written here.
0 recent
Action Status Instance Summary When
No audit logs recorded yet.
Credentials

Credential metadata

Secrets stay hidden, but the operator still sees which client key and manifest version each instance is using.
No secrets shown
Instance Client key Status
Otangeles PCC production consumer
v3
sst-prod-otangeles-otangelespccprod-01m21fpych6kjdatttrdj28jz3
 active
Ready: ready
Heartbeat: heartbeat
Otangeles PCC test consumer
v3
sst-test-otangeles-otangelespcctest-01m1hsaj6mfmrndwtnqc0qfkb7
 active
Ready: ready
Heartbeat: heartbeat
Backroom Staff Auto
v3
sst-test-backroomstaff-backroomstaffauto-01kvt26bfhayz99hdwenddrx1q
 active
Ready: ready
Heartbeat: heartbeat