Principal DevOps Engineer: Cloud Platform & AI Infra

BitSight; Boston (MA); Remote; USD 126,000 - 180,000; Full time

Job summary

Bitsight is seeking a Principal DevOps Engineer to shape how we build and run our cloud platform. You will set infrastructure direction across AWS with growing GCP/Azure footprints and own platform availability, reliability, and cost visibility.

You’ll lead AI platform infra and drive data residency parity for US and EU customers. You’ll mentor DevOps and backend engineers, design modular IaC with Terraform, and ensure scalable, secure, and observable systems.

Qualifications

• 10+ years in infrastructure, SRE or DevOps roles, with at least 3 at staff or principal level setting technical direction.
• Deep AWS expertise (EKS, RDS, S3, IAM), plus working knowledge of GCP or Azure.
• Strong Terraform skills and a track record of building modules that other teams actually adopt.
• Production Kubernetes experience, including Helm, GitOps workflows and cluster lifecycle management.
• Experience owning uptime for production systems, including on-call and incident command.
• The judgement and maturity necessary to evaluate AI opportunities and to convert them into new capabilities. Monitor the results and mature our usage.
• Clear written communication. You can write an architecture proposal that a VP and a junior engineer both understand.

Responsibilities

• Own platform architecture. Make and document the infrastructure decisions that product teams build on, across AWS, with growing footprints in GCP and Azure.
• Own availability. Set SLOs for core platform services and meet them. Lead the response to major incidents and make sure post-mortem follow-ups actually ship.
• Run Kubernetes at scale. Operate EKS clusters, including capacity planning, node and pod density, graceful shutdown, and access models that give developers the access they need.
• Build reusable infrastructure as code. Write and maintain Terraform modules (RDS, S3, IAM) that product teams use directly. Retire old infrastructure repos and accounts cleanly.
• Lead AI platform infrastructure. Operate and improve our internal AI gateway (LiteLLM, Langfuse). Evaluate alternatives, onboard new models quickly, and build the cost reporting, guardrails and model-request policy around them.
• Deliver data residency. Keep US and EU environments at parity so regulated customers get the same product wherever their data lives.
• Make observability and cost visible. Design logging and metrics pipelines (OpenSearch, Sumo Logic, archival to S3) and enforce hygiene such as lifecycle policies, orphaned-resource cleanup and accurate tagging.
• Multiply others. Mentor DevOps and backend engineers, review designs, and turn repeated one-off requests into self-service tooling. Where appropriate, run POCs and prototype new solutions. Evaluate cost benefits and bring the best solutions to fruition.

Skills

Infrastructure leadership

AWS expertise (EKS, RDS, S3, IAM)

Terraform

Kubernetes (EKS)

Incident management

Architecture documentation

Written communication

Tools

Terraform

Kubernetes (EKS)

AWS (EKS/RDS/S3/IAM)

Job description

Bitsight is seeking a Principal DevOps Engineer to shape how we build and run our cloud platform. You will set infrastructure direction across AWS with growing GCP/Azure footprints and own platform availability, reliability, and cost visibility.

You’ll lead AI platform infra and drive data residency parity for US and EU customers. You’ll mentor DevOps and backend engineers, design modular IaC with Terraform, and ensure scalable, secure, and observable systems.