SST control plane

Consumer instance dashboard

Watch registered instances, queue health, hydration batches, and recent event traffic from one place. This is the shortest path to seeing whether SST is healthy, stale, or quietly swallowing poison messages.

Instances Queue Monitor Hydration Events Fanout Alerts Failures Credentials
Instances
3
registered consumers tracked right now
Ready
3
instances that have called ready
Fan-out eligible
2
ready targets; heartbeat health is advisory
Healthy
2
fresh heartbeat plus no queue red flags
Failed batches
2
hydration batches that need attention
Stale batches
1
unresolved past the operator timeout
Open alerts
1
persisted monitor findings requiring review
What this dashboard watches

Operational signals

Live data
Instance state Inbound queue Outbound queue DLQ pressure Hydration batches Recent events Lane fanout
Client secrets are never rendered here. Queue URLs, readiness URLs, and event/audit history are safe to inspect.
Alert logic

How health is derived

Rules
Healthy: heartbeat in the last 5 minutes and no queue/DLQ failure.
Stale: heartbeat between 5 and 15 minutes old.
Offline: heartbeat older than 15 minutes.
Failed: disabled instance, queue error, or DLQ messages present.
Fan-out eligibility: ready, non-disabled instances receive events only while their heartbeat lease is valid; lease expiry holds new fan-out without disabling the instance.
Instances

Registered consumer instances

This list separates delivery eligibility from heartbeat health. A lease-expired instance remains registered and can recover through its ready/rehydration handshake.
Instance Status Heartbeat Queue health Credentials Capabilities
Otangeles PCC production consumer
otangeles · prod · open detail
Key: otangelesPccProd
Healthy ready Fan-out Eligible
Heartbeat is fresh and the instance is ready.
Ready, non-disabled instance has a valid heartbeat lease; each lane still requires its declared capability and queue.
2026-10-08T06:16:23+00:00
Ready: 2026-09-26T08:10:59+00:00
Processed: unknown
Healthy
Inbound visible: 0
Outbound visible: 0
Inbound DLQ: 0
Outbound DLQ: 0
Client key: sst-prod-otangeles-otangelespccprod-01m21fpych6kjdatttrdj28jz3
Credential status: active
Manifest: v3
patient_events
Otangeles PCC test consumer
otangeles · test · open detail
Key: otangelesPccTest
Healthy ready Fan-out Eligible
Heartbeat is fresh and the instance is ready.
Ready, non-disabled instance has a valid heartbeat lease; each lane still requires its declared capability and queue.
2026-10-08T06:12:42+00:00
Ready: 2026-09-03T07:12:03+00:00
Processed: unknown
Healthy
Inbound visible: 0
Outbound visible: 0
Inbound DLQ: 0
Outbound DLQ: 0
Client key: sst-test-otangeles-otangelespcctest-01m1hsaj6mfmrndwtnqc0qfkb7
Credential status: active
Manifest: v3
patient_events hydration
Backroom Staff Auto
backroomstaff · test · open detail
Key: backroomStaffAuto
Offline ready Fan-out Lease expired
Instance was ready, but the heartbeat window expired.
Heartbeat lease expired after 1800 seconds. New fan-out is held until the instance heartbeats and calls ready; the instance remains registered and is not disabled.
2026-08-02T06:05:08+00:00
Ready: 2026-06-23T11:00:08+00:00
Processed: unknown
Healthy
Inbound visible: 0
Outbound visible: 0
Inbound DLQ: 0
Outbound DLQ: 0
Client key: sst-test-backroomstaff-backroomstaffauto-01kvt26bfhayz99hdwenddrx1q
Credential status: active
Manifest: v3
hydration facility_events patient_events provider_events
Queue monitor

Instance queue pressure

This is the operator view for backlog, delayed messages, and DLQ pressure without opening the instance detail page.
All queues
Instance Inbound Outbound
Otangeles PCC production consumer
otangeles · prod
otangelesPccProd
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Otangeles PCC test consumer
otangeles · test
otangelesPccTest
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Backroom Staff Auto
backroomstaff · test
backroomStaffAuto
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Visible: 0
In flight: 0
DLQ: 0
Age: 0s
Hydration batches

Recent hydration runs

0 active
Batch Status Instance Counts
01M1K1RH29QQ8CDBWF2DQTYBS4
consumer-hydration:test:otangeles:otangelesPccTest:01M1K1RH29QQ8CDBWF2DQTYBS4
 applied
Published: 2026-09-03T07:13:10+00:00
Otangeles PCC test consumer
otangelesPccTest
Messages: 43
Received: 2026-09-03T07:13:10+00:00
Applied: 2026-09-03T07:15:17+00:00
01M1K18ARTARD5G0E8CJM2XFQ0
consumer-hydration:test:otangeles:otangelesPccTest:01M1K18ARTARD5G0E8CJM2XFQ0
 failed
Published: 2026-09-03T07:04:22+00:00
Otangeles PCC test consumer
otangelesPccTest
Messages: 67
Received: 2026-09-03T07:04:22+00:00
Applied: n/a
01M1HSAKZBXAW37NPH8CDHD4MD
consumer-hydration:test:otangeles:otangelesPccTest:01M1HSAKZBXAW37NPH8CDHD4MD
 stale
Published: 2026-09-02T19:25:24+00:00
Otangeles PCC test consumer
otangelesPccTest
Messages: 1
Received: n/a
Applied: n/a
01KVT26DFKGSXD3JAQ92WR00V4
consumer-hydration:test:backroomstaff:backroomStaffAuto:01KVT26DFKGSXD3JAQ92WR00V4
 applied
Published: 2026-06-23T11:00:08+00:00
Backroom Staff Auto
backroomStaffAuto
Messages: 1
Received: 2026-06-23T11:01:56+00:00
Applied: 2026-06-23T11:01:56+00:00
01M1J6523NQZQ98FJZ24SNCAGM
consumer-hydration:test:otangeles:otangelesPccTest:01M1J6523NQZQ98FJZ24SNCAGM
 failed
Published: n/a
Otangeles PCC test consumer
otangelesPccTest
Messages: 0
Received: n/a
Applied: n/a
Event explorer

Search and review recent events

Filter by event id, object id, event type, or the queue / instance key that carried the event.
1828 matching
Clear filters
Event Object Status
01M241N6K2RDY8HS6ZD4NGEZS0
adt_record.synced
adt_record
923882
 applied
Attempts: 1
01M23Q08MXNNVPHCEVVKBYCVV7
adt_record.synced
adt_record
1009966
 applied
Attempts: 1
01M23Q08QPECG1T2B4VBWSN3GY
adt_record.synced
adt_record
805900
 applied
Attempts: 1
01M23Q08TRD2939F4XD35DM8PK
adt_record.synced
adt_record
802252
 applied
Attempts: 1
01M23Q08WSZV0CRQGBKTCPE7NA
adt_record.synced
adt_record
790733
 applied
Attempts: 1
01M23Q08YT2YYR9QSTDC72W00E
adt_record.synced
adt_record
786692
 applied
Attempts: 1
01M23Q090Z4J14Z0HNJY245T0Y
adt_record.synced
adt_record
781012
 applied
Attempts: 1
01M23Q0930H3KBGDYX4KYR75NN
adt_record.synced
adt_record
755440
 applied
Attempts: 1
01M23M7KK8X6YRR7A176SSNSXD
adt_record.synced
adt_record
1120910
 applied
Attempts: 1
01M23M7KNDTZ3V5B6BKEZB2P6X
adt_record.synced
adt_record
1040083
 applied
Attempts: 1
01M23M7KQH9V0TW9P071YVRQGY
adt_record.synced
adt_record
976514
 applied
Attempts: 1
01M23M7KSTJH369B31VR4M2YEQ
adt_record.synced
adt_record
971681
 applied
Attempts: 1
Showing 529 - 540 of 1828 matching events.
Previous Next
Lane fanout

Recent events pushed to ready instances

This is the record of SST taking an accepted event and pushing it into each matching consumer instance lane.
18 recent
Event Instance Status Queue
01a11980-6964-7370-9242-c297fc30f662
observation.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: b0853020-3b48-4d88-96b0-cc2802b47770
01a11980-4821-70f9-a1a0-a7d701dcf95e
allergy_intolerance.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 8e67ec1a-ad33-4bdf-9d8b-067edce078b3
01a1197f-d7f7-7382-af6e-89e207664673
observation.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 8791ded9-4ee4-445a-951f-6856b1841260
01a1197f-b1e5-73c2-8274-256cef4ec6a9
condition.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: deafcdf6-9660-49d2-8d00-f18859899305
01a1197f-ab7f-707c-9362-0e8d789fa3bf
medication.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 90417251-767c-45c7-bf0e-3f9edfea25ab
01a11980-73a4-7312-94cb-b9d85fd238f7
adt_record.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 45c350d4-027d-4078-87e8-bfe76e2aca61
01a11980-6f12-71f4-9dfd-ad55edf19114
allergy_intolerance.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 087e2bdc-22f6-4853-b1db-b2cd1642aa6f
01a11980-65b8-73a5-804e-0242f6f1d9c7
medication.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 87aab0c0-96c6-4b11-b313-97b5d1cea63d
01a11980-6e53-720e-9563-13061a9ef66c
condition.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: b3565db3-ddab-45de-bb0f-3b35e8cd8171
01a1197f-65c4-7181-a65f-e99d8706d302
condition.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 2b9031d9-9735-48c8-9514-2cdd0d63577c
01a1197f-5dde-725d-a889-ee6052992217
medication.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 81ceecd7-808f-4d14-bda5-07266265262a
01a11980-43b3-714e-bfa7-a7f0bde87187
medication.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 52e428b8-ed72-44f0-8fbe-7ac12fa5eec8
01a11980-310e-71ea-82fd-75f9bdf5a533
allergy_intolerance.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: cb575940-b301-4465-8710-67094fe45a04
01a11980-4aa2-737f-89b2-f1ee4798f353
coverage.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 2bd53eec-c6f5-410f-967d-7a6dd53a2cd2
01a11980-2feb-71be-bfc0-f6569096068d
medication.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 7871924f-6e19-451c-9954-dde97fe96e72
01a1197f-2301-7003-8008-9cc43651bbb1
condition.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: a753195f-367b-4cec-9c6b-ba64e60ca016
01a11980-781b-7241-84cc-b2085db86d31
coverage.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: d1333be4-8db2-4a93-9d57-2b695299f173
01a11980-7675-7034-940c-06efcb9d1a16
allergy_intolerance.sync_completed · patient_events
Otangeles PCC production consumer
otangelesPccProd
 published
https://sqs.us-east-2.amazonaws.com/391254865075/sst-prod-otangelespccprod-158ca80d6a45-sst-to-instance-patient-events.fifo
Message: 3e9e9435-33f4-4d50-b056-2ec3271c433e
Alerts

Persisted monitor findings

The health monitor records lease expiry and newly stale or failed hydration work. Resolved lease alerts remain in the database for review.
1 open
consumer_lease_expired

Consumer delivery lease expired: Backroom Staff Auto

warning
Heartbeat lease expired for Backroom Staff Auto (backroomStaffAuto). New lane fan-out is held until the instance heartbeats and calls ready; the instance remains registered and is not disabled.
Last seen: 2026-10-08T06:16:01+00:00
Failures

Operational red flags

This collapses stale instances, failed batches, and queue/DLQ pressure into one place.
4 items
instance

Backroom Staff Auto

offline
Instance was ready, but the heartbeat window expired.
hydration

01M1K18ARTARD5G0E8CJM2XFQ0

failed
Abandoned after hydration capability table-contract mismatch; replaced by canonical-only publisher.
hydration

01M1HSAKZBXAW37NPH8CDHD4MD

stale
Hydration is still published after the operator timeout.
hydration

01M1J6523NQZQ98FJZ24SNCAGM

failed
Abandoned after synchronous ready timeout; replaced by queued hydration handoff.
Audit logs

Operator action trail

Every replay, redrive, credential rotation, pause, and resume is written here.
0 recent
Action Status Instance Summary When
No audit logs recorded yet.
Credentials

Credential metadata

Secrets stay hidden, but the operator still sees which client key and manifest version each instance is using.
No secrets shown
Instance Client key Status
Otangeles PCC production consumer
v3
sst-prod-otangeles-otangelespccprod-01m21fpych6kjdatttrdj28jz3
 active
Ready: ready
Heartbeat: heartbeat
Otangeles PCC test consumer
v3
sst-test-otangeles-otangelespcctest-01m1hsaj6mfmrndwtnqc0qfkb7
 active
Ready: ready
Heartbeat: heartbeat
Backroom Staff Auto
v3
sst-test-backroomstaff-backroomstaffauto-01kvt26bfhayz99hdwenddrx1q
 active
Ready: ready
Heartbeat: heartbeat