Remote LLM Platform Engineer - AI Infra & Scale

Whatnot; San Francisco (CA); Hybrid; USD 245,000 - 345,000; Full time

Benefits offered by this job

Health insurance

Remote work options

Home office stipend

Cell phone stipend

Internet stipend

401(k) with employer match

Parental leave

Wellness allowance

Job summary

Whatnot is seeking an AI/ML Engineer to design and scale core infrastructure powering LLM applications across the company. You will work with ML scientists to productionize models, build retrieval systems, and ground model outputs in Whatnot’s context.

This role offers remote‑friendly options and requires strong Python, ML experience, and clear communication. Ideal candidates have 4+ years in ML systems, a CS/Math related degree, and hands‑on experience with cloud services, databases, and

Qualifications

• 4+ years of professional experience developing machine learning systems and algorithms.
• Bachelor’s degree in CS/Statistics/Applied Math or related field, or equivalent work experience.
• 3+ years of software engineering experience building and maintaining production systems for consumer‑scale loads.
• 1+ years of professional experience developing software in Python.
• Experience with PostgreSQL, DynamoDB, Elasticsearch, Redis.
• Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Apache Kafka, Flink.
• Exceptional documentation and communication skills.
• Ability to work autonomously and drive initiatives across multiple product areas and communicate findings with leadership and product teams.

Responsibilities

• Own the infrastructure powering LLMs across critical business surfaces—supporting growth, recommendations, trust and safety, fraud, seller tooling, and more.
• Create robust and scalable LLM evaluation frameworks to measure model performance, guide iteration, and prevent regression via CI/CD.
• Deploy RAG systems and MCP servers to ground LLM responses in Whatnot’s business context while enforcing rigorous PII controls.
• Design efficient human‑in‑the‑loop feedback pipelines that can be used to inform scalable LLM evaluation.
• Bridge the gap between research and production, helping to transform experimental ideas into scalable solutions.
• Stretch beyond your comfort zone to take on new technical challenges as we scale AI across Whatnot’s ecosystem.

Skills

Python programming

Autonomy

Documentation

Communication

Education

Bachelor's degree in Computer Science / Statistics / Applied Mathematics or related field

Tools

PostgreSQL

DynamoDB

Elasticsearch

Redis

Job description

Whatnot is seeking an AI/ML Engineer to design and scale core infrastructure powering LLM applications across the company. You will work with ML scientists to productionize models, build retrieval systems, and ground model outputs in Whatnot’s context.

This role offers remote‑friendly options and requires strong Python, ML experience, and clear communication. Ideal candidates have 4+ years in ML systems, a CS/Math related degree, and hands‑on experience with cloud services, databases, and