Senior Observability & Reliability Engineer

Peraton; Chantilly (VA); On-site; USD 112,000 - 179,000; Full time

Job summary

Peraton is seeking Observability / Site Reliability Engineers to design, implement, and operate telemetry and reliability capabilities across enterprise infrastructure, platform services, applications, and workloads. The role emphasizes OpenTelemetry-based instrumentation and centralized observability, with a focus on reliability, performance, and automation.

Expect responsibilities spanning telemetry engineering, reliability engineering, and operations/automation.

Qualifications

• Active TS/SCI clearance with CI Polygraph.
• 5–8 years of experience in observability, SRE, or related disciplines.
• BS/BA with 5 years experience; an additional 4 years may be considered in lieu of a degree.
• Hands-on experience with metrics, logging, tracing, monitoring, and alerting.
• Experience with Kubernetes and cloud environments.
• Strong troubleshooting, systems analysis, and performance-analysis skills.
• Experience operating and supporting production services and responding to technical incidents.
• Experience with scripting, automation, or infrastructure-as-code practices.
• Strong analytical, problem-solving, and communication skills.

Responsibilities

• Implement standardized collection of metrics, logs, and distributed traces across enterprise environments.
• Establish OpenTelemetry-based instrumentation and telemetry collection patterns where appropriate.
• Integrate cloud, Kubernetes, platform, application, and infrastructure telemetry into centralized observability services.
• Maintain telemetry pipelines, retention, routing, and data-quality controls.
• Develop and maintain instrumentation and telemetry configurations to support effective system monitoring and troubleshooting.
• Develop dashboards, alerts, service-health views, and operational metrics.
• Define and monitor SLOs, availability indicators, latency, error rates, saturation, and capacity measures.
• Analyze system performance, capacity, utilization, and operational trends to identify reliability issues.
• Apply site reliability engineering practices to improve system availability, performance, scalability, and resilience.
• Identify opportunities to improve detection, response, and recovery across enterprise services.
• Support incident diagnosis, cross-service troubleshooting, and root-cause analysis; automate recurring tasks.
• Partner with operations and engineering teams to improve incident detection and response.
• Participate in Tier 3/4 escalation and on-call support for observability, platform, and reliability issues.
• Develop and maintain operational procedures, troubleshooting documentation, and knowledge articles.
• Support continuous improvement of monitoring and reliability practices based on operational data and incident trends.

Skills

Observability experience

SRE experience

Metrics

Logging

Tracing

Monitoring

Alerting

Kubernetes

Cloud environments

Troubleshooting

Systems analysis

Performance analysis

Production support

Scripting

Automation

Infrastructure-as-Code

Analytical skills

Communication skills

Education

BS/BA degree

Tools

OpenTelemetry

Prometheus

Grafana

CloudWatch

OpenSearch

Job description

Peraton is seeking Observability / Site Reliability Engineers to design, implement, and operate telemetry and reliability capabilities across enterprise infrastructure, platform services, applications, and workloads. The role emphasizes OpenTelemetry-based instrumentation and centralized observability, with a focus on reliability, performance, and automation.

Expect responsibilities spanning telemetry engineering, reliability engineering, and operations/automation.