Senior AI Platform Engineer for Production-Grade Inference

Zof AI; San Francisco, Northern (CA, KY); Hybrid; USD 170,000 - 240,000; Full time

Job summary

Zof AI is seeking an AI Platform Engineer to own the platform our AI systems run on, spanning model serving, GPU compute, and reliability infrastructure. This senior role requires building observability, automating deployment, and driving cost-aware scaling in production.

You will work on-site in San Francisco with a small, high-skill team, shaping the platform for rapid experimentation and robust production workloads.

Qualifications

• Experience operating production AI/ML or high-scale backend systems.
• Strong infrastructure and systems engineering foundation.
• Experience with cloud platforms, containers, and orchestration.
• Experience with observability and reliability tooling.
• Judgment about cost, performance, and operational trade-offs.
• Clear written and verbal communication.
• Comfort operating in a fast-moving environment.
• High ownership of systems in production.

Responsibilities

• Design and operate model serving, scaling, and compute infrastructure.
• Own GPU and inference efficiency, capacity, and cost.
• Build the platform for provisioning, running, and scaling agents.
• Build observability for AI systems: tracing, monitoring, and alerting.
• Keep production AI systems stable, debuggable, and recoverable.
• Automate deployment, rollback, and environment management.
• Set reliability standards and incident practices for AI workloads.
• Partner with engineers to make the platform fast to build on.

Skills

Production AI experience

Cloud platforms

Observability tooling

Cost-performance trade-offs

Clear communication

Ownership of systems

Fast-moving environment

Tools

Kubernetes

Terraform

Containers

Job description

Zof AI is seeking an AI Platform Engineer to own the platform our AI systems run on, spanning model serving, GPU compute, and reliability infrastructure. This senior role requires building observability, automating deployment, and driving cost-aware scaling in production.

You will work on-site in San Francisco with a small, high-skill team, shaping the platform for rapid experimentation and robust production workloads.