External Job Posting Title Senior Site Reliability Engineer

Peraton; Idaho; On-site; USD 104,000 - 166,000; Full time

Benefits offered by this job

Medical

Dental

Vision

Life Insurance

Health Savings Account

Short/Long Term Disability

Employee Assistance Program

401(k)

Paid Time Off

Company Holidays

Job summary

Peraton Labs is hiring a Senior Site Reliability Engineer to own the reliability of our enterprise applications end-to-end. You will define SLOs, write production code in Python and Rust, and build observable, self-healing services.

Expect to lead incident response and drive improvements across AWS, Kubernetes, and CI/CD pipelines. You’ll work in a fast, collaborative engineering environment, applying advanced observability, chaos testing, and capacity planning to ensure secure, compliant

Qualifications

• Bachelor’s Degree with 8+ years in SRE or software engineering
• Proficient in Python; Rust experience preferred
• Define SLIs/SLOs, error budgets, and burn rates for releases
• Monitoring/alerting ownership using CloudWatch, Prometheus, Grafana
• Instrumentation with metrics, logging, and distributed tracing in Python/Rust
• Incident management with blameless postmortems and corrective actions
• Strong AWS/EKS/Kubernetes ops experience; GitOps and CI/CD
• IaC expertise with OpenTofu/Terraform

Responsibilities

• Own end-to-end reliability of the enterprise application; define and enforce SLOs
• Write production Python and Rust code to improve performance and resilience
• Instrument services with metrics, logging, and tracing
• Build and manage monitoring/alerting dashboards and alert routing
• Develop health checks and synthetic transaction tests to exercise critical flows
• Lead incident response and postmortems; drive corrective actions
• Operate EKS/Kubernetes and core AWS services; manage Terraform/OpenTofu
• Maintain CI/CD pipelines with reliability gates and progressive delivery
• Enforce secrets management and least privilege; support DoD/FedRAMP readiness

Skills

Python

Rust

SRE

CloudWatch

Prometheus/Grafana

Kubernetes

OpenTelemetry

Terraform/OpenTofu

GitHub Actions/GitLab CI

AWS

Education

Bachelor’s Degree

Tools

Grafana

Prometheus

OpenTelemetry

Kubernetes

AWS

EKS

Terraform/OpenTofu

GitHub Actions

GitLab CI

Job description

Peraton Overview

Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can't be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we're keeping people around the world safe and secure.

Responsibilities

Peraton Labshiring for a Senior Site Reliability Engineer

Own the reliability of our enterprise application end-to-end: define and enforce SLOs and error budgets, build the dashboards and alerting that tell us how the system is actually behaving, and write production code in our Python and Rust services to make them observable, self-checking, and resilient. This is an engineering role first. You’ll spend real time in the application codebase, not just around it.

Job Responsibilities

• Own end-to-end reliability of the enterprise application; define SLIs/SLOs with product and engineering, enforce error-budget policy, and use burn rates to guide release and prioritization decisions.
• Write, review, and ship production Python and Rust code to fix performance, concurrency, and failure-handling issues and make services observable and resilient.
• Instrument services with metrics, structured logging, and distributed tracing (OpenTelemetry or equivalent).
• Own monitoring and alerting (CloudWatch, Prometheus/Grafana): build low-noise, SLO-based burn-rate alerts, manage alert routing and on-call hygiene, and design service, SLO, and executive dashboards.
• Build in-application health checks and synthetic user-journey tests that exercise real auth flows and critical transactions.
• Lead incident response, run blameless postmortems, and drive corrective actions to closure.
• Operate Amazon EKS/Kubernetes (Helm, RBAC, pod identity, GitOps, upgrades) and core AWS services, managed through OpenTofu/Terraform.
• Maintain GitHub Actions/GitLab CI pipelines with reliability and performance gates, supporting trunk-based, MR-driven Agile delivery and progressive (canary/blue-green) rollouts.
• Enforce secrets management and least privilege, and produce audit evidence for NIST 800-171, CMMC, FedRAMP, or DoD/ATO environments.
• Drive load testing, capacity planning, and chaos engineering, and mentor engineers on reliability practices.

Qualifications

Required Qualifications

• Bachelor’s Degree and 8+ years in SRE, platform, or software engineering roles with production reliability ownership
• Strong software engineering in Python; Rust experience strongly preferred. Comfortable reading, debugging, and shipping changes to production application code, including performance, concurrency, and failure-handling fixes. Working effectively in unfamiliar codebases, including with AI-assisted development tools, counts. Judgment and code review rigor matter more than language tenure.
• SLOs and error budgets. Defining SLIs with product and engineering, setting SLO targets, running error-budget policy, and using burn rates to drive release and prioritization decisions
• Monitoring and alerting ownership. CloudWatch, Prometheus/Grafana, or equivalent; building actionable, low-noise alerts tied to SLOs and multi-window burn rates; owning alert routing and on-call hygiene
• Designing service, SLO, and executive-level dashboards in Grafana or equivalent that answer real operational questions
• Application instrumentation. Adding metrics, structured logging, and distributed tracing (OpenTelemetry or equivalent) directly in Python and Rust services
• Synthetic and transactional health checks. Building health-check capabilities into the application and scripted user-journey checks (CloudWatch Synthetics, Grafana k6, Checkly, or equivalent) that exercise real auth flows and critical transactions
• Incident management. Leading incident response, running blameless postmortems, and driving corrective actions to closure
• Strong Amazon EKS / Kubernetes operations background: Helm, RBAC, pod identity, GitOps, upgrades, troubleshooting
• Solid AWS experience across core services (VPC, IAM, S3, RDS, CloudTrail, CloudWatch, KMS)
• CI/CD experience in GitHub Actions and/or GitLab CI, including reliability and performance gates in pipeline
• Infrastructure-as-code (OpenTofu / Terraform)
• Agile delivery: trunk-based development, MR-driven change, automated quality gates
• Security and compliance awareness: secrets management, least privilege, audit evidence, ideally in NIST 800-171, CMMC, FedRAMP, or DoD environments
• US Citizenchip is required

Desired Qualifications

• Production Rust experience (async/Tokio, FFI with Python via PyO3, or similar)
• Load and performance testing (k6, Locust, or equivalent) and capacity planning
• Chaos engineering and fault-injection testing
• Progressive delivery (canary/blue-green with automated rollback on SLO or health-check failure)
• Experience with Big Bang (Platform One), IronBank, or hardened-image pipelines
• Prior work on systems pursuing or holding an ATO
• Contributions to observability tooling or Rust/Python open-source projects

Target Salary Range

$104,000 - $166,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual's experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.

Benefits Statement

Peraton offers eligible employees a variety of benefits including medical, dental, vision, life, health savings account, short/long term disability, EAP, parental leave, 401(k), paid time off (PTO) for vacation, and company paid holidays. A full listing of available benefits can be viewed athttps://www.careers.peraton.com/benefits.

EEO

EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.