Principal Dev-Ops Architect

Zohorecruit; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

CDIT seeks a Senior Technical Authority to own the cloud platform architecture for a global, multi-tenant SaaS service. This hands-on IC role designs the platform, writes Terraform modules, builds CI/CD pipelines on AWS, and governs the AI/ML stack while ensuring HIPAA and SOC 2 Type 2 readiness.

You will set standards and drive observability across teams. You will lead SLI/SLO programs, enforce policy-as-code, and manage releases with blue/green and canary strategies, while operating AI tooling

Qualifications

• Bachelor's degree in software engineering or equivalent.
• 10+ years in SRE/DevOps/Platform Eng with IC/architect experience.
• Proven authority shaping architecture and standards across teams.
• Experience driving adoption of new platforms across multiple teams.
• Hands-on Terraform with reusable modules and CI/CD pipelines.
• Experience building CI/CD on AWS with GitHub Actions, Jenkins, or GitLab.
• Running Docker & Kubernetes workloads; observability and telemetry.
• HIPAA/security/compliance exposure in cloud environments.

Responsibilities

• Own platform architecture and technical roadmap for infrastructure, deployment, observability, and AI/ML platform.
• Set standards and patterns for IaC, CI/CD, and AI tooling; drive adoption via reference implementations.
• Manage cloud infrastructure as code in Terraform with modules, remote state, and drift detection.
• Enforce policy-as-code to meet security and cost guardrails before merge.
• Design and deploy AWS infrastructure across dev, UAT, staging, and production for performance and security.
• Build and operate CI/CD pipelines for large-scale apps on AWS; own release management and gates.
• Package and run Docker/Kubernetes workloads (EKS); maintain reliability and scale.
• Lead SLI/SLO/SLA program and modern observability with OpenTelemetry; manage incidents and on-call.
• Provision and operate AI/ML platform via AWS Bedrock and MCP services as IaC.
• Develop LLMOps: prompt versioning, evaluation, cost attribution, guardrails, auditing.
• Maintain SOC 2 Type 2 and HIPAA controls, secrets, SBOM, and FinOps.

Skills

Platform architecture

Terraform

IaC (Infrastructure as Code)

CI/CD pipelines

Docker

Kubernetes

OpenTelemetry

SRE / DevOps

AWS

Security & compliance

Education

Bachelor's degree in Software Engineering

Tools

AWS

GitHub Actions

Jenkins

GitLab

CI/CD tooling

Terraform

Job description

Senior technical authority for a cloud platform running global, multi-tenant SaaS services. This is a hands-on individual-contributor architect role - not people management. The architect designs the platform, sets standards and reference implementations other teams build on, and still writes Terraform, builds CI/CD pipelines, and stands up the AI/ML platform personally. Defines how reliability is measured against SLOs, how releases ship, and how the AI/ML platform is built and governed while keeping the environment HIPAA-compliant and SOC 2 Type 2 audit-ready. Influences products, software, and QA through architecture and example.

Core Responsibilities

• Own platform architecture and technical roadmap for infrastructure, deployment, observability, and the AI/ML platform.
• Set engineering standards, patterns, and golden paths for Infrastructure as Code (IaC), CI/CD, and AI tooling; drive adoption through reference implementations and architecture reviews.
• Manage all cloud infrastructure as code in Terraform - reusable modules, remote state, peer-reviewed PRs, drift detection, and automated plan/apply in CI/CD.
• Enforce policy-as-code (OPA, Sentinel, or equivalent) so infrastructure changes meet security and cost guardrails before merge.
• Design and deploy AWS infrastructure across dev, UAT, staging, and production for performance, availability, recoverability, and security (CIS Critical Security Controls).
• Build and operate CI/CD pipelines for large-scale applications on AWS; own release management, rollback, blue/green, canary, and release gates.
• Package and run containerized workloads on Docker and Kubernetes (EKS).
• Lead the SLI/SLO/SLA program and modern observability using OpenTelemetry; drive down MTTD and MTTR; lead blameless post-incident reviews and participate in on-call.
• Provision and operate the AI/ML platform - Anthropic Claude via AWS Bedrock and internal MCP services - all managed as IaC.
• Build LLMOps practices: prompt versioning, evaluation pipelines, token cost attribution, guardrails, and audit logging of agent actions; enforce the PHI data boundary to BAA-covered providers only.
• Operate and evidence the platform controls required for SOC 2 Type 2 and HIPAA; own secrets management, supply-chain security (SBOM, image and dependency scanning), and FinOps.

Required Qualifications

• Bachelor's degree in Software Engineering or equivalent combination of technical education and work experience.
• 10+ years in SRE / DevOps / Platform Engineering delivering CI/CD, REST API deployment, containerization, IaaS/PaaS, data pipelines, and application observability - including time at a senior IC or architect level (Staff, Principal, or Architect).
• Proven technical authority across teams: sets architecture and standards and influences delivery through expertise and example rather than direct management.
• Demonstrated experience driving adoption of a new practice or platform (IaC, CI/CD overhaul, or an AI/ML platform) across multiple teams.
• Hands-on Terraform, including reusable modules other teams consume via self-service, remote state, and change management in a CI/CD pipeline.
• Building and operating CI/CD pipelines for large-scale applications on AWS (GitHub Actions, Jenkins, GitLab, or AWS-native).
• Running containerized workloads on Docker and Kubernetes.
• Monitoring and troubleshooting using cloud-native tooling and OpenTelemetry.
• Linux system administration, Unix scripting, and automation.
• Experience working in a HIPAA / HITECH / HITRUST / PHI / PII or PCI DSS environment.