Sr. DevOps Engineer II, AI Platforms

DoubleVerify; Northern, New York (KY, NY); Hybrid; USD 153,000 - 260,000; Full time

Benefits offered by this job

Bonus / equity

Benefits

Hybrid work

Job summary

DoubleVerify is seeking a Sr. DevOps Engineer II for its AI Platforms team in New York City. The role focuses on running and hardening the MCP gateway, advancing IAM and access control, and consolidating gateway deployments to GA with multi-region failover.

You will work across a distributed team to ensure secure, observable AI infrastructure at scale. The candidate brings 5+ years in DevOps/SRE, hands-on experience with AI infrastructure in production, and strong expertise in OAuth, JWT, and

Qualifications

• 5+ years in DevOps, Platform Engineering or SRE with production Kubernetes ownership.
• Hands-on experience managing and scaling AI infrastructure in production.
• Deep knowledge of OAuth 2.0/2.1, OIDC and JWT with token exchange and scope design.
• Experience with gateway, proxy or service mesh (Envoy or equivalent).
• Track record taking infrastructure from prototype to GA, with SLOs and failover.
• Strong collaboration in a distributed engineering group.

Responsibilities

• Run and harden the MCP gateway day to day on Envoy Gateway in GKE.
• Lead on closing the authorization gap: group-based access from JWT claims, per-tool RBAC, OAuth scopes.
• Consolidate the model gateway estate to GA with multi-region, health-checked failover.
• Advance AI observability and extend the trace pipeline across tools for cost and latency metrics.
• Build infrastructure for AI cost governance: spend caps, attribution, alerts.
• Support the registry, eval and marketplace platform and collaborate with Security on access control and supply chain review.

Skills

DevOps

Kubernetes

OAuth 2.0 / OIDC

JWT

Envoy Gateway

GKE

Cost governance

SRE

Security practices

Tools

Envoy Gateway

Keycloak

Okta

Terraform

ArgoCD

Helm

Vault

Prometheus

Grafana

Job description

## Sr. DevOps Engineer II, AI PlatformsApply: Hybrid: NYC Global HQ: Full time: Posted 3 Days Ago: JR00000999# **Who We Are**DV is the leader in digital performance solutions, helping our advertiser and agency partners Verify the quality of their digital campaigns, Optimise to improve performance and Prove that they’re achieving their business outcomes, through unbiased 3rd party data and analytics. DV’s mission is to be the definitive source of transparency and data-driven insights into the quality and effectiveness of digital advertising for the world’s largest brands, agencies, publishers, and digital ad platforms. Since 2008, DV has helped hundreds of Fortune 500 companies gain the most from their media spend by delivering best-in-class solutions across the digital advertising ecosystem, helping to build a better industry. Learn more at www.doubleverify.com.# **About the Role**Over the past year, DV built an AI platform at speed. More than 800 people now use Claude and Cursor daily against an MCP gateway that fronts 30+ internal tool backends, a gateway for model traffic, a registry where engineers publish skills and plugins, and a tracing pipeline running off every laptop. It was built by a strong, opinionated group of engineers who continue to drive it forward, and it is already in wide production use.This is the first role at DV dedicated entirely to that platform. You'll join the engineers building it today with AI infrastructure as your full focus, which means having the time to go deep on the hardest problems and keep the platform moving day to day.A lot of it is already live and needs operating and hardening. Plenty is still ahead of us: group-based authorization across the gateway, a consolidated multi-region model gateway with real failover, and cost attribution that teams can act on.## What You Will Do* Run and harden the MCP gateway day to day. It runs on Envoy Gateway on GKE, secured by Keycloak, serving 30+ backends to Claude Code, Cursor and Claude Desktop across the company, plus an externally reachable gateway. You'll be one of the first responders when it breaks.* Take the lead on closing the authorization gap: group-based access from JWT claims, per-tool RBAC, and scoped OAuth consent in place of the static user lists and broad scopes we run on today.* Help consolidate the model gateway estate onto one supported deployment and drive it to GA, with multi-region, health-checked failover and coverage beyond a single client.* Push AI observability to GA with the team. Finish the trace pipeline, extend it across tools, and give teams per-session, per-user and per-department cost and latency numbers they can trust.* Build out the infrastructure behind AI cost governance: spend caps that reflect real dollars rather than raw tokens, plus attribution, enforcement and alerting.* Support the registry, eval and marketplace platform that lets engineers publish and consume skills, plugins and MCP servers safely, and partner with Security on model and data access control, prompt injection exposure and connector supply chain review.* Work across a DevOps org spread over three regions, pairing with the engineers who built each piece.# **Who You Are**## ## Required Qualifications* 5+ years in DevOps, Platform Engineering or SRE, with production Kubernetes ownership and the software engineering habits to go with it.* Hands-on experience managing and scaling AI infrastructure in production: Demonstrated track record operating developer AI tools, model routing/gateway platforms, or LLM observability stacks at organizational scale.* Real depth in OAuth 2.0/2.1, OIDC and JWT: token exchange, scope design, claim propagation, and federation between an IdP, an authorization server and a proxy. Some of the hardest problems on this platform live here.* Production experience with a gateway, proxy or service mesh (Envoy or equivalent), and the judgment to debug a misbehaving control plane under pressure.* A track record of taking infrastructure from prototype to GA. You've set the SLOs, built the failover, written the runbooks and carried the pager.* The collaboration skills to work well inside an opinionated, distributed engineering group. You build on other people's work, disagree constructively, and write things down.## Preferred Qualifications* Upstream contributions to Envoy Gateway or a comparable open-source proxy.* LLM observability tooling (Langfuse, LangSmith, Arize Phoenix) and OTEL GenAI conventions.* Cost attribution or chargeback for a shared platform.* Keycloak or equivalent IdP engineering.* Zero-trust access platforms and secrets management.## Our StackGCP/GKE, Envoy Gateway, Keycloak, Okta, Terraform, ArgoCD, Helm, Vault, Kafka, Redis, Prometheus/Grafana/Alloy, Langfuse, LangSmith, GitLab CI, Python and Go.This position is full-time and located in our New York City headquarters offices offering a hybrid work model from office and remote.The successful candidate’s starting salary will be determined by a number of non-discriminatory factors, including qualifications for the role, level, skills, experience, location, and internal equity relative to peers at DV.The estimated salary range for this role, based on the qualifications set forth in the job description, is between $153,000 $260,000. This role will also be eligible for bonus/commission (as applicable), equity, and benefits. The range above is for the expectations as laid out in the job description; however, we are often open to a wide variety of profiles and recognize that the person we hire may be more or less experienced than this job description as posted.**Not-so-fun fact:** Research shows that while men apply to jobs when they meet an average of 60% of job criteria, women and other marginalized groups tend to only apply when they check every box. So if you think you have what it takes but you’re not sure that you check every box, apply anyway!