Senior AI Platform Architect & ML Ops Leader (Remote)

Serko; Washington (District of Columbia); On-site; USD 168,000 - 230,000; Full time

Benefits offered by this job

Competitive base pay

Medical benefits

Discretionary incentive plan

Development platform access

Flexible work policy

Salary range: $168,000 - $230,000 USD

Job summary

Serko is seeking a Senior ML Platform Engineer to architect and lead the AI infrastructure that powers its evolving AI workloads. You will drive model serving, observability, and scalable pipelines, collaborating with cross-functional teams to deliver reliable, cost-efficient ML capabilities.

The role requires extensive experience in ML infra, MLOps, and building internal platforms, with leadership responsibilities to mentor senior engineers and shape the tech roadmap.

Qualifications

• 12+ years of engineering experience, with at least 4 years at Principal or Distinguished level.
• Expert-level knowledge of model serving and cloud ecosystems (AWS/GCP/Azure).
• Experience with MLOps tools: MLflow, Weights & Biases or Kubeflow.
• Strong Python and systems-thinking with Docker, Helm, and containerization.
• Hands-on experience operating LLM inference at scale.
• Track record building internal platforms to boost engineering velocity.

Responsibilities

• Architect the long-term technical roadmap for our AI platform, including model serving, feature stores, and CI/CD for ML.
• Set engineering benchmarks for deployment, versioning, A/B testing, and automated rollbacks.
• Lead strategies for GPU/compute efficiency and cost optimization for LLM inference at scale.
• Design advanced observability, monitoring, and alerting systems for AI workloads in production.
• Drive platform reliability and partner with application teams to meet evolving product needs.
• Mentor Senior engineers, lead architecture reviews, and evaluate next-gen cloud services and ML frameworks.

Skills

ML infra mastery

Python & containers

LLM inference

Internal platforms

Senior engineering

Leadership/mentoring

Tools

Kubernetes

Docker

Helm

Triton

vLLM

Ray Serve

MLflow

Weights & Biases

Kubeflow

Job description

Serko is seeking a Senior ML Platform Engineer to architect and lead the AI infrastructure that powers its evolving AI workloads. You will drive model serving, observability, and scalable pipelines, collaborating with cross-functional teams to deliver reliable, cost-efficient ML capabilities.

The role requires extensive experience in ML infra, MLOps, and building internal platforms, with leadership responsibilities to mentor senior engineers and shape the tech roadmap.