Senior AI Platform Engineer — Scalable LLM Infrastructure

Socket.dev; Seattle (WA); Hybrid; USD 152,000 - 332,000; Full time

Job summary

Zoom is seeking an experienced AI Engineer to build and scale the foundational AI Services Platform across the Zoom ecosystem. You will work at the intersection of LLM intelligence, distributed systems, and platform engineering to deliver context layers, agents, RAG pipelines, and reliable services.

You will collaborate with product and infrastructure teams, implement high-throughput AI orchestration, and shape API contracts for broad AI adoption while staying current with AI research and best

Qualifications

• This role requires 3+ years hands-on AI/ML engineering experience.
• 5+ years in distributed systems and backend engineering at scale.
• Proficiency in Python, TypeScript, Go, Java, C++, or Rust.
• Strong cloud infrastructure and Kubernetes experience.
• Bachelor's degree or equivalent practical experience.
• Experience with AI agents, prompt engineering, and evaluation.

Responsibilities

• Design and implement the AI Services Platform architecture including core infrastructure for context intelligence, agent orchestration, and RAG pipelines.
• Develop distributed systems infrastructure for high-throughput, low-latency AI service orchestration across multi-region deployments.
• Build observability, monitoring, and safety systems for reliable AI service behavior at scale.
• Create evaluation frameworks to assess AI service quality, latency, accuracy, and cost.
• Collaborate with product and infra teams to define APIs and integration patterns for AI services adoption.
• Stay current with advances in LLMs, embeddings, and AI infrastructure to improve platform capabilities.

Skills

AI/ML engineering

Distributed systems

Python

TypeScript

Go

C++

Education

Bachelor's degree in Computer Science/AI/ML or related field

Tools

Kubernetes

AWS

GCP

Azure

Job description

Zoom is seeking an experienced AI Engineer to build and scale the foundational AI Services Platform across the Zoom ecosystem. You will work at the intersection of LLM intelligence, distributed systems, and platform engineering to deliver context layers, agents, RAG pipelines, and reliable services.

You will collaborate with product and infrastructure teams, implement high-throughput AI orchestration, and shape API contracts for broad AI adoption while staying current with AI research and best