Staff AI Platform Engineer — Remote/Hybrid

Code Metal, Inc.; United States; In loco; USD 205.000 - 250.000; Tempo pieno

Vantaggi offerti da questo lavoro

Health care plan with 100% premium

401k with 5% matching

Paid Time Off (uncapped vacation)

Flexible hybrid or remote work

Relocation assistance for qualifying

Descrizione del lavoro

Code Metal is seeking a Staff AI Platform Engineer to lead the AI platform engineering effort. You will architect and build the AI enablement stack our engineers depend on, from GPU inference serving and model gateway up through agent harnesses, context engineering, observability, and AI experimentation management.

It is an internal platform, but we are building it to product standard. This is an engineering role first.

Competenze

• Production-grade Python and platform engineering fundamentals: API and service design, distributed systems, containers and Kubernetes, CI/CD, and testing.
• Shipped production agentic systems with reliability.
• Experience with context engineering: retrieval-augmented generation, embeddings, vector search, and memory for agents.

Mansioni

• Set the technical direction and architecture for Code Metal's AI platform and team; own design docs and RFCs.
• Deploy, benchmark, and tune elastic, production inference for open-weight models on runtimes like vLLM, SGLang, TensorRT-LLM.
• Own the model gateway with consistent auth, routing, failover, quotas, and cost attribution.
• Design reusable agent harnesses and orchestration primitives for reliable workflows.
• Build context-engineering services for memory, retrieval, and data discovery.
• Instrument end-to-end with observability; build experiment-tracking and artifact layer.
• Design for productization with versioned APIs and security for customer environments.

Conoscenze

Python

Distributed systems

Kubernetes

API design

CI/CD

Testing

Staff leadership

Strumenti

OpenTelemetry

PyTorch

Hugging Face

MLflow

Weights & Biases

vLLM

TensorRT-LLM

Descrizione del lavoro

Code Metal is seeking a Staff AI Platform Engineer to lead the AI platform engineering effort. You will architect and build the AI enablement stack our engineers depend on, from GPU inference serving and model gateway up through agent harnesses, context engineering, observability, and AI experimentation management.

It is an internal platform, but we are building it to product standard. This is an engineering role first.