DevOps engineer in AI infrastructure

Encord

New York (NY)

On-site

USD 180,000 - 230,000

Full time

39 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Equity
4 days in-person culture
Flexible PTO
Learning & development budget
Health, dental, and vision coverage
Travel opportunities across US, London
Bi-annual offsites

Job summary

Encord is seeking a Senior DevOps Engineer to join our platform engineering team in New York. You have 5+ years of hands‑on DevOps experience and will own deployment pipelines, review infrastructure changes, and champion best practices across the engineering group.

You will design and run cloud infrastructure on GCP and AWS, manage Kubernetes at scale, and drive automation, observability, and incident response. Expect travel across the U.S., London, and Europe.

Qualifications

  • 4+ years of hands-on DevOps, platform engineering, or SRE experience in a production environment.
  • Strong experience building and maintaining CI/CD pipelines and deployment automation at scale.
  • Proven experience with infrastructure-as-code tools (Terraform, Pulumi) and configuration management.
  • Strong fundamentals in designing, building, and maintaining resilient distributed and/or high performance systems.
  • Hands-on experience with Kubernetes and containerised workloads in cloud environments (GCP and/or AWS).
  • Solid understanding of networking, operating systems, and database technologies.
  • Experience with observability fundamentals metrics, logs, traces, and alerting.

Responsibilities

  • Own and continuously improve deployment pipelines; partner with developers to review infra changes and champion DevOps practices.
  • Design, deploy, and maintain cloud infrastructure on GCP and AWS; manage Kubernetes clusters at scale with IaC.
  • Boost developer productivity by building automation and internal tooling across the engineering group.
  • Profile and optimise services handling large-scale data pipelines; perform capacity planning for storage and compute.
  • Work with squads to establish performance benchmarks and expectations.
  • Define and own SLIs/SLOs/SLAs; build alerting, runbooks, and blameless postmortems.
  • Instrument services with tracing, logging, and metrics; ensure observability before production.

Skills

DevOps
CI/CD
Kubernetes
Terraform
Pulumi
Cloud platforms
Observability

Tools

Terraform
Pulumi
OpenTelemetry
Prometheus
Grafana
GCP
AWS

Job description

Описание:

Encord is the universal data layer for AI that helps 300+ AI teams train and run models on the right data. Our platform indexes, curates, annotates, and evaluates data across the full AI lifecycle, from development through production. We're an ambitious team of 100+ working at the frontier of AI. We're looking for a Senior DevOps Engineer with 5+ years of experience to join our growing platform engineering team in New York.

Задачи:
  • Own and continuously improve deployment pipelines; partner closely with developers to review infrastructure changes, streamline release processes, and champion DevOps best practices across the engineering group.
  • Design, deploy, and maintain cloud infrastructure on GCP and AWS; manage Kubernetes clusters, networking, and storage at petabyte scale, with infrastructure-as-code as the default.
  • Drive developer productivity by building, guiding, and reviewing automation and internal tooling efforts across the engineering group; eliminate manual toil wherever it exists.
  • Profile and optimise services handling large-scale data pipelines; perform capacity planning for storage and compute-intensive workloads.
  • Work with squads to establish performance benchmarks and expectations.
  • Define and own SLIs/SLOs/SLAs for critical services; build alerting, runbooks, and incident response processes; lead postmortems with a blameless culture.
  • Instrument services with distributed tracing, logging, and metrics (Prometheus, Grafana, OpenTelemetry, GCP Dashboards or similar); build infrastructure, define best practices, and work with each squad to ensure every service is observable before it goes to production.
Требования:
  • 4+ years of hands-on DevOps, platform engineering, or SRE experience in a production environment.
  • Strong experience building and maintaining CI/CD pipelines and deployment automation at scale.
  • Proven experience with infrastructure-as-code tools (e.g., Terraform, Pulumi) and configuration management.
  • Strong fundamentals in designing, building, and maintaining resilient distributed and/or high performance systems.
  • Hands-on experience with Kubernetes and containerised workloads in cloud environments (GCP and/or AWS).
  • Solid understanding of networking, operating systems, and database technologies.
  • Experience with observability fundamentals metrics, logs, traces, and alerting.
Условия:
  • Competitive salary, commission, and meaningful equity in a high-growth start-up
  • Clear, accelerated growth opportunities as the company scales rapidly
  • Strong in-person culture: 4 days/week
  • Flexible PTO to fully recharge
  • Annual learning & development budget
  • Comprehensive health, dental, and vision coverage
  • Frequent travel opportunities across the U.S., London, and Europe
  • Bi-annual company offsites, twice-weekly team lunches, and monthly socials
  • Compensation Range: $180K - $230K
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

DevOps & Platform Engineer — Cloud, Kubernetes, SRE
DevOps & Platform Engineer — Cloud, Kubernetes, SRE

The Consensus • San Francisco (CA)

Hybrid
USD 140,000 - 200,000
Competitive salary
Equity in hyper growth startup
Loft office in North Beach, SF
+3
Senior DevOps Engineer
Senior DevOps Engineer

Crane Venture Partners • New York (NY)

On-site
USD 140,000 - 190,000
Competitive salary & equity
In-person office 4 days a week
Learning & development budget
+3
DevOps engineer for AI inference
DevOps engineer for AI inference

Gcore • United States

Hybrid
USD 120,000 - 190,000
Competitive compensation
Hybrid or remote options
Work from anywhere for up to 45 days a
+5
DevOps engineer for AI agent platforms
DevOps engineer for AI agent platforms

EPAM • United States

Hybrid
USD 140,000 - 190,000
Office or home-friendly environment
Global mobility opportunities
Comprehensive learning resources
DevOps Engineer
DevOps Engineer

US Health Partners, LLC • New York (NY)

On-site
USD 140,000 - 200,000
Competitive salary
Equity in hyper growth startup
Loft office in North Beach, SF
+3
devops engineer for cloud data platforms
devops engineer for cloud data platforms

Addepto • United States

Remote
USD 120,000 - 170,000
Remote work
Career development
Team events
+4
DevOps/SRE Engineer (AI Inference)
DevOps/SRE Engineer (AI Inference)

Gcore • United States

Hybrid
USD 150,000 - 200,000
Гибкий график
Гибридная или удаленная работа
Медицинская страховка
+2
Engineering Manager (with DevOps background)
Engineering Manager (with DevOps background)

Patrianna Limited • United States

Remote
USD 180,000 - 240,000
Полностью удаленная работа
Щедрый отпуск и гибкий график
Возможности профессионального роста
+1
DevOps Engineer | Build AI Infrastructure from the Ground Up
DevOps Engineer | Build AI Infrastructure from the Ground Up

The Cypress Group • New York (NY)

On-site
USD 120,000 - 170,000
DevOps Engineer (CI/CD & AI-Enabled Platform)
DevOps Engineer (CI/CD & AI-Enabled Platform)

Regnology • United States

Remote
USD 150,000 - 210,000