Infrastructure Monitoring & Alerting Setup

Design a complete monitoring and alerting system for {{INFRASTRUCTURE}}. The team structure is {{TEAM_STRUCTURE}}. The SLA requirements are {{SLA_REQUIREMENTS}}. Please provide: 1) Monitoring architecture: Prometheus deployment, scraping configuration, and data retention strategy, 2) Infrastructure metrics collection: node exporter, cAdvisor, and kube-state-metrics configuration, 3) Application metrics: RED method implementation with custom Prometheus metrics in application code, 4) Grafana dashboard suite: infrastructure overview, service health, database performance, and business KPIs, 5) SLO definition for critical user journeys with error budget calculation, 6) Alerting rules: symptom-based alerts with proper severity (critical, warning, info) classification, 7) Burn rate alerts for SLO monitoring with multi-window detection, 8) Alertmanager configuration: routing, grouping, silencing, and escalation policies, 9) On-call rotation setup with PagerDuty or Opsgenie integration, 10) Runbook template linked from alerts with diagnostic commands and mitigation steps, 11) Incident response workflow: detection, triage, mitigation, resolution, and post-mortem, 12) Alert quality maintenance: regular review process, noise reduction, and alert coverage auditing. Include specific PromQL queries for all alerting rules.