LLM Platform Engineer: Scale AI Infra & Grounded LLMs

Apply; California (MO); On-site; USD 245,000 - 345,000; Full time

Benefits offered by this job

Flexible time off

Health Insurance

Work From Home Support

Home office setup

Cell phone & internet

Wellness allowance

Childcare allowance

Family planning

401k matching

Dogfooding budget

Parental leave

Job summary

Whatnot is seeking an AI/ML Engineer to design and scale the core infrastructure powering large language model applications. You’ll work with ML scientists to bring cutting-edge models into production, grounding LLM responses in Whatnot’s business context and building scalable evaluation frameworks.

You’ll own the infrastructure powering LLMs across critical surfaces, deploy RAG systems, and build humane in-the-loop feedback pipelines. Remote-friendly within the US.

Qualifications

• BS in CS/related field or equivalent work experience.
• 3+ years building production systems for consumer-scale loads.
• 1+ year developing software in Python.
• Experience with databases and cloud services.
• Experience with monitoring/logging tools and reproducible work.

Responsibilities

• Own infrastructure powering LLMs across surfaces such as growth, recommendations, trust, safety, and fraud.
• Create scalable LLM evaluation frameworks and CI/CD driven quality improvements.
• Deploy RAG systems and MCP servers to ground LLM responses with PII controls.
• Design human-in-the-loop feedback pipelines for scalable evaluation.
• Bridge research and production to scale experimental ideas.
• Tackle new technical challenges as AI scales across Whatnot.

Skills

Python

Autonomous work

Communication

Leadership

ML systems

Git

CI/CD

Education

Bachelor's degree in CS/Related field

Tools

PostgreSQL

DynamoDB

Elasticsearch

Redis

DataDog

Grafana

AWS (Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS)

Apache Kafka

Flink

Job description

Whatnot is seeking an AI/ML Engineer to design and scale the core infrastructure powering large language model applications. You’ll work with ML scientists to bring cutting-edge models into production, grounding LLM responses in Whatnot’s business context and building scalable evaluation frameworks.

You’ll own the infrastructure powering LLMs across critical surfaces, deploy RAG systems, and build humane in-the-loop feedback pipelines. Remote-friendly within the US.