Notes / tag / operations

#operations

32 notes across 3 topics

Known issues

Recurring limitations and accepted trade-offs across Signal Forge, consolidated in one place to check before assuming a gap is new.

ShipSolid Signal Forge Operations
Jul 10, 2026

Networking & TLS

Network-plane security for Signal Forge: NetworkPolicy default-deny model, Ingress TLS via cert-manager, and the k3d flannel enforcement caveat.

ShipSolid Signal Forge Operations
Jul 10, 2026

Reliability controls

Workload-level Kubernetes controls protecting Signal Forge availability during disruption: PodDisruptionBudgets, anti-affinity, and graceful shutdown.

ShipSolid Signal Forge Operations
Jul 10, 2026

Resilience patterns

Application-level failure handling in Signal Forge: retries, circuit breakers, backoff, and delivery-safety patterns for downstream dependency failures.

ShipSolid Signal Forge Operations
Jul 10, 2026

Runbooks

Troubleshooting playbooks for every known Signal Forge failure mode, from missing traces to Grafana Cloud export errors.

ShipSolid Signal Forge Operations Incident Response
Jul 10, 2026

Security

Threat model and secrets lifecycle reference for Signal Forge, covering credential management, input validation, CORS, RBAC, and rotation procedures.

ShipSolid Signal Forge Operations
Jul 10, 2026

Supply-chain security

What CI verifies before a Signal Forge image ships: vulnerability scanning, SBOM generation, and cosign keyless signing.

ShipSolid Signal Forge Operations
Jul 10, 2026

Alert Runbooks

Runbooks invoked directly from paging alerts.

ShipSolid Operations Incident Response
Jun 9, 2026

Runbook — ShipSolidApiGateway5xxHigh

- **Service:** api-gateway - **Owner Team:** Platform SRE

ShipSolid Operations Incident Response
Jun 9, 2026

Communication Templates

Copy-paste communication templates for incidents.

ShipSolid Operations Incident Response
Jun 9, 2026

Incident Response Playbook

The step-by-step incident response flow for platform-impacting incidents.

ShipSolid Operations Incident Response
Jun 9, 2026

Incident Trends & Themes

Cross-incident analysis — recurring themes, top contributors, and where to invest.

ShipSolid Operations Incident Response
Jun 9, 2026

On-Call Handbook

Everything an on-call engineer needs for a shift on the observability platform.

ShipSolid Operations Incident Response
Jun 9, 2026

04 — Operations & Incident Response

Running the platform: on-call, incident response, runbooks, and post-mortems.

ShipSolid Operations Incident Response
Jun 9, 2026

2026-05-21 — billing-service elevated latency

- **Incident Commander:** On-call Engineer (Platform SRE)

ShipSolid Operations Incident Response
Jun 9, 2026

Post-Mortems

Blameless post-mortems for resolved incidents.

ShipSolid Operations Incident Response
Jun 9, 2026

Rotation Schedule

Current on-call rotation and schedule.

ShipSolid Operations Incident Response
Jun 9, 2026

Runbook Index

Index of all operational runbooks.

ShipSolid Operations Incident Response
Jun 9, 2026

Severity Definitions

Severity definitions so everyone agrees on what SEV-n means.

ShipSolid Operations Incident Response
Jun 9, 2026

Incident Notification & Response

**Owner:** SRE Team **Last Updated:** 2025-05-01 **Applies to:** All production alerts routed

ShipSolid Operations Incident Response
May 1, 2026

Notification & Alerting Strategy

A unified approach to delivering actionable alerts, minimizing noise, and ensuring timely

ShipSolid Operations Incident Response
May 1, 2026

SRE Toolkit

The `srekit` CLI is a Python-based toolkit for SRE operations, located in

ShipSolid Operations Incident Response
May 1, 2026

Visualization, Alerting & SLOs

An effective observability system translates raw telemetry into actionable insights through

ShipSolid Operations Incident Response
May 1, 2026

# Internal Developer Platforms

All Internal Developer Platforms notes →