SVP, AI/MLOps Infra Leader (Hybrid, Equity)

Benchmark IT - Technology Talent; New York (NY); Hybrid; USD 200,000 - 230,000; Full time

Benefits offered by this job

Retirement match

Unlimited PTO

Job summary

Benchmark IT - Technology Talent is partnering with a fintech client in New York to hire a Senior SVP, Lead AI/MLOps Infrastructure Engineer. The hybrid role leads end-to-end AI/ML platform stack, sets MLOps standards, and drives cloud-native AWS infra with Terraform and Kubernetes.

Expect a strategic, hands-on leader shaping GenAI workloads and cost optimization. The role emphasizes production ML/GenAI deployments, governance, and cross-team collaboration, with strong compensation and a

Qualifications

• 15+ years of experience in DevOps, SRE, or platform engineering with AWS as primary cloud
• Hands-on experience building and operating MLOps pipelines in production
• Experience with MLOps tooling including model registries, experiment tracking, and feature stores
• Exposure to Generative AI / LLM workloads, including AWS Bedrock
• Strong IaC and scripting skills (Terraform; Python or similar)
• Solid Linux, systems, and troubleshooting fundamentals
• Excellent communicator, comfortable collaborating across teams

Responsibilities

• Own the end-to-end AI/ML platform stack: orchestration, compute (including GPU), storage, and model serving
• Build and operate MLOps pipelines across the full model lifecycle: training, validation, versioning, deployment
• Productionize AI/ML and GenAI workloads in partnership with ML engineers and data scientists
• Design and manage cloud-native AWS infrastructure using Kubernetes, and own Infrastructure as Code standards (Terraform)
• Own SLAs/SLOs for model serving and inference; lead monitoring, drift detection, and incident response
• Build internal tooling and standardized environments to boost ML engineer productivity (MLflow, Kubeflow, Weights & Biases, Ray)
• Drive data governance, privacy compliance, and cost optimization across training and inference workloads
• Set the MLOps roadmap and mentor engineers on infrastructure and MLOps best practices

Skills

AWS

MLOps

Python

Linux

DevOps

SRE

Cloud architecture

ML platform

Tools

Terraform

Kubernetes

MLflow

Kubeflow

Weights & Biases

Ray

Bedrock

Job description

Benchmark IT - Technology Talent is partnering with a fintech client in New York to hire a Senior SVP, Lead AI/MLOps Infrastructure Engineer. The hybrid role leads end-to-end AI/ML platform stack, sets MLOps standards, and drives cloud-native AWS infra with Terraform and Kubernetes.

Expect a strategic, hands-on leader shaping GenAI workloads and cost optimization. The role emphasizes production ML/GenAI deployments, governance, and cross-team collaboration, with strong compensation and a