SST control plane

Consumer instance dashboard

Watch registered instances, queue health, hydration batches, and recent event traffic from one place. This is the shortest path to seeing whether SST is healthy, stale, or quietly swallowing poison messages.

Instances Queue Monitor Hydration Events Fanout Alerts Failures Credentials
Instances
3
registered consumers tracked right now
Ready
3
instances that have called ready
Fan-out eligible
2
ready targets; heartbeat health is advisory
Healthy
2
fresh heartbeat plus no queue red flags
Failed batches
2
hydration batches that need attention
Stale batches
1
unresolved past the operator timeout
Open alerts
1
persisted monitor findings requiring review
What this dashboard watches

Operational signals

Live data
Instance state Inbound queue Outbound queue DLQ pressure Hydration batches Recent events Lane fanout
Client secrets are never rendered here. Queue URLs, readiness URLs, and event/audit history are safe to inspect.
Alert logic

How health is derived

Rules
Healthy: heartbeat in the last 5 minutes and no queue/DLQ failure.
Stale: heartbeat between 5 and 15 minutes old.
Offline: heartbeat older than 15 minutes.
Failed: disabled instance, queue error, or DLQ messages present.
Fan-out eligibility: ready, non-disabled instances receive events only while their heartbeat lease is valid; lease expiry holds new fan-out without disabling the instance.
Instances

Registered consumer instances

This list separates delivery eligibility from heartbeat health. A lease-expired instance remains registered and can recover through its ready/rehydration handshake.
Instance Status Heartbeat Queue health Credentials Capabilities
Otangeles PCC production consumer
otangeles · prod · open detail
Key: otangelesPccProd
Healthy ready Fan-out Eligible
Heartbeat is fresh and the instance is ready.
Ready, non-disabled instance has a valid heartbeat lease; each lane still requires its declared capability and queue.
2026-10-10T20:19:04+00:00
Ready: 2026-09-26T08:10:59+00:00
Processed: unknown
Healthy
Inbound visible: 0
Outbound visible: 0
Inbound DLQ: 0
Outbound DLQ: 0
Client key: sst-prod-otangeles-otangelespccprod-01m21fpych6kjdatttrdj28jz3
Credential status: active
Manifest: v3
patient_events
Otangeles PCC test consumer
otangeles · test · open detail
Key: otangelesPccTest
Healthy ready Fan-out Eligible
Heartbeat is fresh and the instance is ready.
Ready, non-disabled instance has a valid heartbeat lease; each lane still requires its declared capability and queue.
2026-10-10T20:18:01+00:00
Ready: 2026-09-03T07:12:03+00:00
Processed: unknown
Healthy
Inbound visible: 0
Outbound visible: 0
Inbound DLQ: 0
Outbound DLQ: 0
Client key: sst-test-otangeles-otangelespcctest-01m1hsaj6mfmrndwtnqc0qfkb7
Credential status: active
Manifest: v3
patient_events hydration
Backroom Staff Auto
backroomstaff · test · open detail
Key: backroomStaffAuto
Offline ready Fan-out Lease expired
Instance was ready, but the heartbeat window expired.
Heartbeat lease expired after 1800 seconds. New fan-out is held until the instance heartbeats and calls ready; the instance remains registered and is not disabled.
2026-08-02T06:05:08+00:00
Ready: 2026-06-23T11:00:08+00:00
Processed: unknown
Healthy
Inbound visible: 0
Outbound visible: 0
Inbound DLQ: 0
Outbound DLQ: 0
Client key: sst-test-backroomstaff-backroomstaffauto-01kvt26bfhayz99hdwenddrx1q
Credential status: active
Manifest: v3
hydration facility_events patient_events provider_events
Queue monitor

Instance queue pressure

This is the operator view for backlog, delayed messages, and DLQ pressure without opening the instance detail page.
All queues
Instance Inbound Outbound
Otangeles PCC production consumer
otangeles · prod
otangelesPccProd
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Otangeles PCC test consumer
otangeles · test
otangelesPccTest
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Backroom Staff Auto
backroomstaff · test
backroomStaffAuto
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Hydration batches

Recent hydration runs

0 active
Batch Status Instance Counts
01M1K1RH29QQ8CDBWF2DQTYBS4
consumer-hydration:test:otangeles:otangelesPccTest:01M1K1RH29QQ8CDBWF2DQTYBS4
 applied
Published: 2026-09-03T07:13:10+00:00
Otangeles PCC test consumer
otangelesPccTest
Messages: 43
Received: 2026-09-03T07:13:10+00:00
Applied: 2026-09-03T07:15:17+00:00
01M1K18ARTARD5G0E8CJM2XFQ0
consumer-hydration:test:otangeles:otangelesPccTest:01M1K18ARTARD5G0E8CJM2XFQ0
 failed
Published: 2026-09-03T07:04:22+00:00
Otangeles PCC test consumer
otangelesPccTest
Messages: 67
Received: 2026-09-03T07:04:22+00:00
Applied: n/a
01M1HSAKZBXAW37NPH8CDHD4MD
consumer-hydration:test:otangeles:otangelesPccTest:01M1HSAKZBXAW37NPH8CDHD4MD
 stale
Published: 2026-09-02T19:25:24+00:00
Otangeles PCC test consumer
otangelesPccTest
Messages: 1
Received: n/a
Applied: n/a
01KVT26DFKGSXD3JAQ92WR00V4
consumer-hydration:test:backroomstaff:backroomStaffAuto:01KVT26DFKGSXD3JAQ92WR00V4
 applied
Published: 2026-06-23T11:00:08+00:00
Backroom Staff Auto
backroomStaffAuto
Messages: 1
Received: 2026-06-23T11:01:56+00:00
Applied: 2026-06-23T11:01:56+00:00
01M1J6523NQZQ98FJZ24SNCAGM
consumer-hydration:test:otangeles:otangelesPccTest:01M1J6523NQZQ98FJZ24SNCAGM
 failed
Published: n/a
Otangeles PCC test consumer
otangelesPccTest
Messages: 0
Received: n/a
Applied: n/a
Event explorer

Search and review recent events

Filter by event id, object id, event type, or the queue / instance key that carried the event.
1833 matching
Clear filters
Event Object Status
01M1ERNW3PQX46Y77ZYG3Z2NMZ
coverage.insert
coverage
01m1ernw2ht4w4s112rw74c3d0
 applied
Attempts: 1
01M1ERNW5RVXH75SVT9HX3CVBD
coverage.softDelete
coverage
01m1epabbma2ac9apx0k9jvm91
 applied
Attempts: 1
01M1ERHBZ1MRCS5A8WEK2HV7SM
patient.edit
patient
01kzxwvft2awmxtcwhgc3av3jc
 applied
Attempts: 1
01M1EPABCFSWK8PQXTQ2R95TT3
coverage.insert
coverage
01m1epabbma2ac9apx0k9jvm91
 applied
Attempts: 1
01M1EP92XM4MM6NBVXRYD976Y0
patient.edit
patient
01kzxwvft2awmxtcwhgc3av3jc
 applied
Attempts: 1
01KZNGDA7VASPFDEN9NAYD166Z
adt_record.synced
adt_record
1345191
 applied
Attempts: 1
01KZNGDAACSKREAZ6W9S4CXNYM
adt_record.synced
adt_record
1345161
 applied
Attempts: 1
01KZNDJE1T3ACCT9MMF0EGVK1N
adt_record.synced
adt_record
795405
 applied
Attempts: 1
01KZNDJE4VBP873Y2K7EQA9HK7
adt_record.synced
adt_record
698714
 applied
Attempts: 1
01KZNDJE7YPBTS83054H0WY5T2
adt_record.synced
adt_record
672009
 applied
Attempts: 1
01KZNDJEBCY6Z3CPT9TZRQ4BY0
adt_record.synced
adt_record
510586
 applied
Attempts: 1
01KZNDJEE60418349M2Y6CJABR
adt_record.synced
adt_record
459090
 applied
Attempts: 1
Showing 1477 - 1488 of 1833 matching events.
Previous Next
Lane fanout

Recent events pushed to ready instances

This is the record of SST taking an accepted event and pushing it into each matching consumer instance lane.
18 recent
Event Instance Status Queue
01a12739-af61-7237-8597-e4a9a56021eb
medication.sync_completed · patient_events
Otangeles PCC test consumer
otangelesPccTest
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-test-otangelespcctest-01a06395-sst-to-instance-patient-events.fifo
Message: 12f5bea5-c179-429a-9203-93c5e8912c89
01a12739-43b5-7231-bf47-8feedbe277b2
medication.sync_completed · patient_events
Otangeles PCC test consumer
otangelesPccTest
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-test-otangelespcctest-01a06395-sst-to-instance-patient-events.fifo
Message: e3ecc6e0-0c40-4bac-99b2-f4865c59e4f1
01a12705-a167-7089-bf86-6ff841b1dc6d
medication.sync_completed · patient_events
Otangeles PCC test consumer
otangelesPccTest
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-test-otangelespcctest-01a06395-sst-to-instance-patient-events.fifo
Message: 95fee86d-66cb-419c-97f1-64c4262c8897
01a126ea-bd4d-73f6-b139-9ffe6eada74a
medication.sync_completed · patient_events
Otangeles PCC test consumer
otangelesPccTest
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-test-otangelespcctest-01a06395-sst-to-instance-patient-events.fifo
Message: 96282b34-e589-4f3b-b577-fb7f3678600e
01a126df-cba1-7282-8542-b89e9bf8ca05
medication.sync_completed · patient_events
Otangeles PCC test consumer
otangelesPccTest
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-test-otangelespcctest-01a06395-sst-to-instance-patient-events.fifo
Message: 6ecfd98e-65ce-4f35-b82b-92ccd581d555
01a126b7-4d71-705d-b0a9-555a581b8ee4
medication.sync_completed · patient_events
Otangeles PCC test consumer
otangelesPccTest
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-test-otangelespcctest-01a06395-sst-to-instance-patient-events.fifo
Message: 8852fb22-cadd-4db4-b0ec-fced9f5a777a
01a126a4-a9a7-720e-8231-546feeb671e7
medication.sync_completed · patient_events
Otangeles PCC test consumer
otangelesPccTest
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-test-otangelespcctest-01a06395-sst-to-instance-patient-events.fifo
Message: 44f09803-0b36-4ac6-9066-c85a53e84d71
01a12691-2726-7066-a9d7-f2015d67fe9e
medication.sync_completed · patient_events
Otangeles PCC test consumer
otangelesPccTest
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-test-otangelespcctest-01a06395-sst-to-instance-patient-events.fifo
Message: d324d09b-4201-4845-b91f-b803a543dc56
01a12690-e277-71fd-9d8d-1b441b4debd3
medication.sync_completed · patient_events
Otangeles PCC test consumer
otangelesPccTest
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-test-otangelespcctest-01a06395-sst-to-instance-patient-events.fifo
Message: 1d75a005-7667-46e3-90b9-7225c662695a
01a1256e-27df-73a4-8254-f73e6591e3c2
care_plan_focus.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: d9679d5d-e703-4d2a-909c-66496a111d8f
01a1256e-1d2e-7231-9e3e-41846ceccd3f
care_plan_focus.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: a027f60b-9cd5-4d33-a4d1-f9762f624fe0
01a1256e-2e37-7374-99af-226a7f09d868
care_plan_focus.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 7666d9a4-4ee1-4bcf-a17d-70f149574dbc
01a1256d-8c0e-71d4-b05c-314f22917d09
practitioners.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 8e48c755-9494-4cc1-afe0-68d1837a42ba
01a1256d-89d6-70f1-8da7-0d00e0220868
nutrition_order.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 77078f51-aa66-4f1d-864c-0adfeec4e250
01a1256e-316b-7144-ae7e-699e10903783
care_plan_focus.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 56ba0ad4-1c66-4e5a-b9f9-28531099f83f
01a1256e-241c-725a-8108-0eedd9708fb9
care_plan_focus.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 3881d02a-eb10-4a80-ab79-aac003674ffc
01a1256d-81be-71ab-9482-4bd3d121cc1d
medication.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 169087c8-76bf-4896-b570-f21f76a0019a
01a1256e-2aff-72be-9d64-58d63dd633ae
care_plan_focus.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: d26da7a5-73dc-4c2d-a9ce-b3e6a33e2df0
Alerts

Persisted monitor findings

The health monitor records lease expiry and newly stale or failed hydration work. Resolved lease alerts remain in the database for review.
1 open
consumer_lease_expired

Consumer delivery lease expired: Backroom Staff Auto

warning
Heartbeat lease expired for Backroom Staff Auto (backroomStaffAuto). New lane fan-out is held until the instance heartbeats and calls ready; the instance remains registered and is not disabled.
Last seen: 2026-10-10T20:20:00+00:00
Failures

Operational red flags

This collapses stale instances, failed batches, and queue/DLQ pressure into one place.
4 items
instance

Backroom Staff Auto

offline
Instance was ready, but the heartbeat window expired.
hydration

01M1K18ARTARD5G0E8CJM2XFQ0

failed
Abandoned after hydration capability table-contract mismatch; replaced by canonical-only publisher.
hydration

01M1HSAKZBXAW37NPH8CDHD4MD

stale
Hydration is still published after the operator timeout.
hydration

01M1J6523NQZQ98FJZ24SNCAGM

failed
Abandoned after synchronous ready timeout; replaced by queued hydration handoff.
Audit logs

Operator action trail

Every replay, redrive, credential rotation, pause, and resume is written here.
0 recent
Action Status Instance Summary When
No audit logs recorded yet.
Credentials

Credential metadata

Secrets stay hidden, but the operator still sees which client key and manifest version each instance is using.
No secrets shown
Instance Client key Status
Otangeles PCC production consumer
v3
sst-prod-otangeles-otangelespccprod-01m21fpych6kjdatttrdj28jz3
 active
Ready: ready
Heartbeat: heartbeat
Otangeles PCC test consumer
v3
sst-test-otangeles-otangelespcctest-01m1hsaj6mfmrndwtnqc0qfkb7
 active
Ready: ready
Heartbeat: heartbeat
Backroom Staff Auto
v3
sst-test-backroomstaff-backroomstaffauto-01kvt26bfhayz99hdwenddrx1q
 active
Ready: ready
Heartbeat: heartbeat