Skip to main content

Runbook: Database Issue

Trigger

Use this runbook when the database is unreachable, slow, overloaded, or producing errors that affect application workflows.

Immediate Actions

StepActionOwnerEvidenceStatus
1Confirm whether application, API, or jobs are affectedIncident CommanderImpact summaryTBD
2Check database server statusOperationsServer status screenshotTBD
3Check application database error logsBackendSanitized log evidenceTBD
4Identify recent migrations or heavy queriesBackend / Release OwnerMigration or query evidenceTBD
5Pause high-risk jobs if they are increasing loadOperationsQueue status evidenceTBD
6Confirm backup availability before risky recovery actionsOperationsBackup evidenceTBD

Safety Rules

  • Do not run destructive SQL without explicit approval.
  • Do not truncate, delete, or alter production data without an approved recovery plan.
  • Confirm backup availability before schema or data repair.
  • If payment or wallet integrity may be affected, classify as SEV-1 until reconciled.

Recovery Criteria

CheckExpected Result
Application DB connectivityHealthy
API workflowsWorking
Queue jobsProcessing normally
Error rateReturned to baseline
Data integrityNo unresolved financial or tenant impact