Senior AI Platform Engineer — GPU Serving & Telemetry

Code Metal, Inc.; United States; Hybrid; USD 150,000 - 190,000; Full time

Benefits offered by this job

Health care plan (Medical, Dental &amp

401k/IRA Retirement plan

Flexible hybrid work arrangement

PTO (Uncapped Vacation, Sick & Hol

Relocation assistance

Job summary

Code Metal, Inc. is seeking an Senior Software Engineer for the AI Platform team to design, build, and operate production-grade AI enablement stack components.

You will own platform areas end to end, from design documentation to production operation, and contribute across the stack with a focus on reliability and performance. The role emphasizes model serving, agentic infrastructure, and observability with experimentation.

Qualifications

• Typically 4+ years of software engineering experience, including 2+ years building and operating ML/AI or LLM systems in production.
• Experience owning a service or component in production, including debugging and reliability improvements.
• Production-grade Python and platform engineering fundamentals: API design, distributed systems, containers and orchestration (Kubernetes), CI/CD, testing.
• Familiarity with inference optimization techniques and GPU profiling.
• Experience deploying AI systems on-prem or in regulated domains such as defense or aerospace.

Responsibilities

• Own 1 or more platform components end to end, from design to production operation.
• Build and operate the services in your focus area, and contribute across the rest of the stack.
• Review teammates’ code and designs, and help onboard new engineers.
• Run focused benchmarks and experiments when a platform decision needs evidence.
• Debug production issues such as tail latency, GPU memory pressure, or agent runs that fail or loop.

Skills

Model serving

Observability & experimentation

Production-grade Python

Agentic infrastructure

LLM systems in production

GPU memory management

Tools

PyTorch

Hugging Face

Kubernetes

MLflow

Weights & Biases

TensorRT

Job description

Code Metal, Inc. is seeking an Senior Software Engineer for the AI Platform team to design, build, and operate production-grade AI enablement stack components.

You will own platform areas end to end, from design documentation to production operation, and contribute across the stack with a focus on reliability and performance. The role emphasizes model serving, agentic infrastructure, and observability with experimentation.