LLM Platform Engineer: Scale AI at a Fast-Growth Platform

Whatnot; Seattle (WA); Hybrid; USD 245,000 - 345,000; Full time

Benefits offered by this job

Health Insurance

Work From Home Support

401k with employer match

Parental Leave

Job summary

Whatnot is hiring an AI/ML Engineer to design and scale core infrastructure powering large language model applications across the company. You will work with ML scientists to productionize models and unlock new product experiences, building systems that make AI fast and dependable at scale.

You will ground LLM outputs in Whatnot’s business context, build retrieval and evaluation pipelines, and ensure robust data privacy as we expand across multiple hubs.

Qualifications

• Bachelor's degree in Computer Science or a related technical field, or equivalent work experience.
• 4+ years of professional experience developing machine learning systems and algorithms.
• 3+ years of software engineering experience building and maintaining production systems for consumer-scale loads.
• 1+ years of professional Python development.
• Experience with PostgreSQL, DynamoDB, Elasticsearch, Redis for production workloads.
• Strong debugging, documentation, and communication skills.

Responsibilities

• Own the infrastructure powering LLMs across critical business surfaces including growth, recommendations, trust and safety, and seller tooling.
• Create robust, scalable LLM evaluation frameworks to measure model performance and guide iteration via CI/CD.
• Deploy RAG systems and MCP servers to ground LLM responses in business context while enforcing PII controls.
• Design human-in-the-loop feedback pipelines for scalable LLM evaluation.
• Bridge research and production to transform experiments into scalable solutions.
• Take on new technical challenges as the AI ecosystem scales across Whatnot.

Skills

Machine learning systems

Python

Production systems

AWS cloud

CI/CD

PostgreSQL

DynamoDB

Elasticsearch

Redis

Kafka

Kinesis

S3

EKS/ECS

Grafana

DataDog

SageMaker

Lambda

EC2

Flink

Remote collaboration

Documentation

Education

Bachelor's degree in Computer Science, Statistics, Applied Mathematics or related field

Tools

PostgreSQL

DynamoDB

Elasticsearch

Redis

DataDog

Grafana

AWS SageMaker

Lambda

Kinesis

S3

EC2

EKS/ECS

Apache Kafka

Flink

Job description

Whatnot is hiring an AI/ML Engineer to design and scale core infrastructure powering large language model applications across the company. You will work with ML scientists to productionize models and unlock new product experiences, building systems that make AI fast and dependable at scale.

You will ground LLM outputs in Whatnot’s business context, build retrieval and evaluation pipelines, and ensure robust data privacy as we expand across multiple hubs.