Senior DevOps Engineer

Cacheflow; Northern, New York (KY, NY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

K Health is seeking a Senior DevOps Engineer to own and evolve our cloud infrastructure for a healthcare AI platform. You will architect and operate multi-cloud environments, drive disaster recovery, and mentor junior engineers. The role is hybrid, based in New York City with in-office work four days a week.

You will lead complex migrations, build AI-powered tooling, and partner with product and engineering teams to strengthen production reliability while meeting regulatory requirements.

Qualifications

• 5+ years of experience in DevOps, platform engineering, or SRE.
• Hands-on Kubernetes expertise and surrounding ecosystem (Helm, Helmfile, ArgoCD, Kyverno, cert-manager, NGINX Ingress).
• Extensive GCP experience (GKE, Cloud SQL, Memorystore, Cloud Storage, IAM, Workload Identity).
• Strong Terraform skills: modular architecture, multi-environment provisioning, automated testing.
• Proficiency in Python and/or Go; solid GitLab CI/CD and GitOps knowledge.

Responsibilities

• Design and evolve Kubernetes infrastructure across multi-environment deployments.
• Build and maintain Terraform modules and automated tests for GCP, Cloudflare, and AWS.
• Create and maintain GitLab CI/CD templates and pipelines for the engineering org.
• Operate self-hosted components in-cluster (GitLab, ArgoCD, Langfuse, DependencyTrack, NGINX Ingress).
• Implement security/compliance controls (secrets, container scanning, SOC2/HIPAA).
• Lead disaster recovery planning, DR tests, and runbooks.
• Mentor engineers and set engineering standards.

Skills

Kubernetes

GitLab CI/CD

Python/Go

Tools

GKE

Terraform

ArgoCD

NGINX Ingress

Helm

Job description

About the Role:

We are looking for a Senior DevOps Engineer to join our DevOps team at K Health. You will own and evolve the infrastructure underpinning a healthcare AI platform serving patients and enterprise health system partners. This is a high-ownership role: you will architect and operate cloud environments across K Health and its enterprise partners, lead complex infrastructure migrations, drive disaster recovery programs, and help build the next generation of AI-powered operations tooling. You will also mentor junior engineers and collaborate closely with product and engineering teams across the company. This is a hybrid role based in New York City (4 days/week in office) and includes participation in a daytime on-call rotation.

What you will do:

• Own the design, implementation, and evolution of our GKE-based Kubernetes infrastructure across K Health and enterprise partner environments.
• Build and maintain our Terraform modular infrastructure library, including reusable modules with automated testing, across GCP, Cloudflare, and AWS.
• Architect, build, and maintain GitLab CI/CD shared pipeline templates used by all engineering teams (build, test, security scanning, deployment).
• Own and maintain self-hosted infrastructure software running in-cluster, including GitLab, ArgoCD, Langfuse, DependencyTrack, NGINX Ingress, and others.
• Implement and support security and compliance controls across infrastructure and the software supply chain - secrets management, pipeline secret detection, container scanning, SOC2 and HIPAA.
• Drive disaster recovery readiness: design failover scenarios, author runbooks, and lead periodic DR tests.
• Lead development of AI-powered operations tooling and agentic infrastructure.
• Monitor, troubleshoot, and improve production system reliability; respond to incidents during on-call shifts.
• Mentor junior DevOps engineers and establish team-wide engineering standards.

What we are looking for:

• 5+ years of experience in DevOps, platform engineering, or site reliability engineering.
• Deep, hands-on experience with Kubernetes and the surrounding ecosystem - Helm, Helmfile, ArgoCD, Kyverno, cert-manager, and NGINX Ingress.
• Extensive experience with Google Cloud Platform - GKE, Cloud SQL, Memorystore, Cloud Storage, IAM, and Workload Identity.
• Strong Terraform expertise: modular architecture, multi-environment provisioning, and automated testing.
• Advanced knowledge of GitLab CI/CD and GitOps practices.
• Proficiency in Python and/or Go.

Plus:

• Advanced Bash scripting skills.
• Experience with secrets management solutions such as Akeyless or HashiCorp Vault.
• Experience with database administration across PostgreSQL, Redis, and MongoDB - including DR configuration and operational runbooks.
• Experience with Datadog or equivalent observability platform (APM, infrastructure, log management).
• Experience with Cloudflare for DNS, CDN, and security rules management.
• Demonstrated experience designing and executing disaster recovery programs, including failover testing and runbook authorship.

Bonus:

• Experience in highly regulated environments - SOC2 and HIPAA.
• Excellent communication skills with the ability to lead cross-functional infrastructure initiatives.
• Demonstrated leadership experience, including mentoring junior engineers.
• Experience with HPC or GPU cluster infrastructure, including Slurm..
• Experience building or operating AI agents or agentic infrastructure.
• Experience with microservices architecture and API gateway / reverse proxy patterns.
• Experience with AWS.

Who We Are:

Behind every leading health system is K Health’s AI-powered virtual care engine.

Our deeply integrated model modernizes the primary care loop by using AI to put humans first. For our patients, we offer clinical AI (i.e., PatientGPT) and unparalleled access to close care gaps around the clock. For our Providers, we deliver provider-serving agentic solutions (i.e., Perfect Note) to eliminate administrative overload and burnout. And for the health systems, we deploy our top-grade Virtualists in AI-powered virtual clinics 24/7 to capture the patients' care journeys at step one, retain the journey through the system for longitudinal care, and strengthen profitability.

We’re founded in 2016, headquartered in New York City, and backed by over $443.5M from leading investors including Valor Equity Partners, Claure Group, Mangrove Capital Partners, 14W, Notable Capital, Lerer Hippeau, Primary Venture Partners, Comcast Ventures, PICO Venture Partners, Max Ventures, and other strategic healthcare partners.

We offer competitive compensation packages based on industry benchmarks for function, level, and geographic location. Offer amounts are determined by multiple factors such as a candidate’s experience and expertise.

We are proud to be an Equal Opportunity Employer and consider applicants for employment regardless of race, ethnicity, religion, color, national origin, ancestry, disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, sexual orientation, pregnancy, childbirth and breastfeeding, age, citizenship, military or veteran status, or any other class protected by applicable federal, state, and local laws. We’re deeply committed to building teams as diverse as the patients we serve and strive to cultivate an environment where everyone can bring their most authentic self to work. We depend on our differences to make our team stronger, our workplace more dynamic, and our product accessible to all of our users.