Skip to content
← All runbooks

Keys & security

On-call rotation

Three founders rotate weekly. Pager goes through Discord @oncall mention (Year-1 free tier; PagerDuty free tier at 5 users is the Year-2 upgrade path).

Rotation schedule

Week starting
2026-W22 (May 25)
Primary
F1
Secondary
F2
Tertiary
F3
Week starting
2026-W23 (Jun 01)
Primary
F2
Secondary
F3
Tertiary
F1
Week starting
2026-W24 (Jun 08)
Primary
F3
Secondary
F1
Tertiary
F2
Week starting
2026-W25 (Jun 15)
Primary
F1
Secondary
F2
Tertiary
F3

Rotate weekly on Monday at 00:00 UTC. Buildathon week (2026-W23) F3 covers demo rehearsals; F1 covers infra; F2 covers comms.

Page sources

  • Better Stack uptime any monitor red for 60 seconds
  • Sentry any unresolved issue spike (more than 10 events in 5 min)
  • Discord #alerts channel user-reported issue with screenshot
  • GitHub Actions failure on main CI workflow red on push

Response SLAs

Severity
SEV-0 (funds at risk OR false claim shipped)
Acknowledge
5 min
First update
15 min
Resolved
1 h
Severity
SEV-1 (core flow down)
Acknowledge
15 min
First update
30 min
Resolved
4 h
Severity
SEV-2 (degraded)
Acknowledge
1 h
First update
4 h
Resolved
24 h
Severity
SEV-3 (cosmetic)
Acknowledge
next business day
First update
next business day
Resolved
next sprint

During an incident

  1. Acknowledge in Discord #alerts with the incident ID + SEV.
  2. Pull the relevant runbook from runbooks/incident-*.md.
  3. Status update every 30 min until resolution.
  4. After resolution: file /incidents/<date>-<slug>.md within 7 days.
  5. Add regression test or alert tuning before closing.

Escalation

  • If primary is unreachable for 15 min, secondary takes over
  • If secondary is unreachable for 15 min, tertiary takes over
  • All three unreachable: SEV-0 pause every contract via Praetor

emergency-pause (instant, multisig-only). Resume after the rotation recovers.

Founder contacts

  • F1: f1@useatrium.me . Discord: @F1 . Phone: in 1Password
  • F2: TBD per cohort founder lineup
  • F3: TBD per cohort founder lineup

Phone numbers + emergency contacts live in the founder 1Password vault, NOT in this repo.