Staff AI Platform Engineer - Lead AI Infra & Pipelines

Code Metal, Inc.; San Francisco (CA); Hybride; USD 205 000 - 250 000; Plein temps

Avantages offerts par ce poste

Health care plan for employees

401k with matching

Paid Time Off

Résumé du poste

Code Metal's engineering teams are building AI-driven code transpilation, modernization, optimization, modeling and simulation solutions. They require foundations: models to serve, agents to run, context to manage, and results to measure.

As a Staff AI Platform Engineer, you will lead the team, architect and build the AI enablement stack—from GPU inference serving through agent harnesses, context engineering, observability and experiment tracking.

Qualifications

• Production-grade Python and platform engineering fundamentals (API/service design, distributed systems, containers/Kubernetes, CI/CD, testing).
• Shipped production agentic systems with reliability considerations.
• Experience with context engineering: retrieval-augmented generation, embeddings, vector/hybrid search, memory for agents.

Responsabilités

• Set technical direction and architecture for Code Metal's AI platform; own design docs.
• Deploy, benchmark, and tune production inference for open-weight models.
• Own the model gateway with auth, routing, failover, quotas, and cost attribution.
• Design reusable agent harnesses and orchestration primitives for reliable workflows.
• Build context-engineering services for memory, retrieval, and data discovery.
• Instrument the stack end-to-end with traces/metrics and build experiment-tracking/artifact layers.
• Design for productization (APIs, security, deployment in customer environments).

Connaissances

Python

Distributed systems

Kubernetes

CI/CD

Testing

Outils

vLLM

SGLang

TensorRT-LLM

PyTorch

Hugging Face

MLflow

Weights & Biases

Description du poste

Code Metal's engineering teams are building AI-driven code transpilation, modernization, optimization, modeling and simulation solutions. They require foundations: models to serve, agents to run, context to manage, and results to measure.

As a Staff AI Platform Engineer, you will lead the team, architect and build the AI enablement stack—from GPU inference serving through agent harnesses, context engineering, observability and experiment tracking.