Senior AI Platform Engineer

Code Metal, Inc.; Washington (District of Columbia); Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Health Insurance

Dental Insurance

Vision Insurance

401(k) With 5% Matching

Uncapped Paid Time Off

Sick Leave

Public Holidays

Flexible Hybrid or Remote Work

Relocation Assistance

Job summary

Code Metal, Inc. in Washington, DC is seeking a platform engineer to own and operate AI platform components from design through production. You will build reliable services, troubleshoot production issues, mentor teammates, review code, and help run experiments to inform platform decisions.

The role requires production-grade Python and platform engineering experience, plus expertise in model serving, observability, and ML tooling. Strong communication and collaboration are essential.

Qualifications

• Requires production-grade Python and platform engineering experience.
• Production experience in model serving, agentic infrastructure, or observability and experimentation.
• Understanding of LLMs and AI research fundamentals.
• Experience operating production services and mentoring teammates.

Responsibilities

• Own and operate AI platform components from design through production.
• Build reliable, tested services and troubleshoot production issues.
• Collaborate with internal teams and run benchmarks or experiments to inform platform decisions.
• Write design documents and review code.

Skills

Python

Platform Engineering

Distributed Systems

Kubernetes

CI/CD

LLM Inference

Model Serving

Agentic Systems

Retrieval-Augmented Generation

Observability

Experiment Tracking

PyTorch

Hugging Face

Benchmarking

Model Evaluation

Production Reliability

Job description

Own and operate AI platform components, such as model-serving systems, agent infrastructure, and observability and experimentation tools, from design through production. Build reliable, tested services, troubleshoot production issues, collaborate with internal teams, and run benchmarks or experiments to inform platform decisions.

Requirements: Requires production-grade Python and platform engineering experience, plus production experience in at least one area: model serving, agentic infrastructure, or observability and experimentation. Candidates should understand LLMs and AI research fundamentals, have experience operating production services, and be able to write design documents, review code, and mentor or onboard teammates.

Key Skills: Python, Platform Engineering, Distributed Systems, Kubernetes, CI/CD, LLM Inference, Model Serving, Agentic Systems, Retrieval-Augmented Generation, Observability, Experiment Tracking, PyTorch, Hugging Face, Benchmarking, Model Evaluation, Production Reliability

Benefits: Health Insurance, Dental Insurance, Vision Insurance, 401(k) With 5% Matching, Uncapped Paid Time Off, Sick Leave, Public Holidays, Flexible Hybrid or Remote Work, Relocation Assistance