Production LLM Platform Engineer

Mpathic

Bellevue (WA)

On-site

USD 150,000 - 230,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

mpathic is hiring an Applied AI Engineer to own production services built on large language models. You’ll join the platform engineering team, reporting to the CTO, and collaborate with AI/ML, research, Security and Compliance to ensure safe, auditable, and cost-effective LLM use in production.

You will start by owning LLM and inference infrastructure, shaping how we build with AI as the team grows, and ensuring all changes pass through tested, observable, and auditable paths before shipping to

Qualifications

  • 5+ years of backend software engineering in production.
  • Experience building on commercial LLM APIs with prompts and structured outputs.
  • Hands-on with evaluation pipelines and release gates in CI/CD.

Responsibilities

  • Own the LLM Gateway and Inference, design and run production path for model calls.
  • Build logging, cost attribution, PHI controls, and secure key handling.
  • Maintain approved model catalog with retention and version pinning.

Skills

Backend engineering
LLM features
Python
AWS
CI/CD
Observability
Security & Compliance

Tools

OpenTelemetry
Datadog
Terraform
Pulumi
CDK
GitHub Actions

Job description

mpathic is hiring an Applied AI Engineer to own production services built on large language models. You’ll join the platform engineering team, reporting to the CTO, and collaborate with AI/ML, research, Security and Compliance to ensure safe, auditable, and cost-effective LLM use in production.

You will start by owning LLM and inference infrastructure, shaping how we build with AI as the team grows, and ensuring all changes pass through tested, observable, and auditable paths before shipping to

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Platform Engineer - Production AI Gateway
LLM Platform Engineer - Production AI Gateway

mpathic • United States

Remote
USD 140,000 - 200,000
Production LLM Platform Engineer
Production LLM Platform Engineer

Meitner Energy • United States

On-site
USD 140,000 - 190,000
AI Engineer — LLM Production & Evaluation
AI Engineer — LLM Production & Evaluation

LawPro.ai • Virginia

On-site
USD 150,000 - 190,000
Entry-Level AI Software Engineer — LLM Platform Builder
Entry-Level AI Software Engineer — LLM Platform Builder

Patapsco.AI • Elkridge (MD)

On-site
USD 70,000 - 110,000
Equity compensation
Paid time off
Paid company holidays
Production AI Engineer: LLM Workflows & Guardrails
Production AI Engineer: LLM Workflows & Guardrails

DataDrone Inc. • United States

Remote
USD 140,000 - 230,000
Applied AI Engineer - Production LLMs & Equity
Applied AI Engineer - Production LLMs & Equity

Cordial • United States

Remote
USD 140,000 - 160,000
Equity + bonus
Medical/dental/vision/life insurance
401k match
+3
Senior AI Engineer: LLM Evaluation, Production & Optimization
Senior AI Engineer: LLM Evaluation, Production & Optimization

LawPro.ai • North Carolina

On-site
USD 140,000 - 190,000
Production AI Engineer (LLM) for Web Apps
Production AI Engineer (LLM) for Web Apps

Softadom • United States

Remote
USD 120,000 - 180,000
Senior AI Platform Lead — Production LLMs (Remote)
Senior AI Platform Lead — Production LLMs (Remote)

Everforth CyberCoders • United States

Remote
USD 180,000 - 240,000
Medical, dental, and vision benefits
HSA and FSA options
Family and pet benefits
+3
AI Platform Engineer - Production LLM & RAG Systems
AI Platform Engineer - Production LLM & RAG Systems

present of AI • San Francisco (CA)

On-site
USD 180,000 - 240,000