Remote LLM Platform Engineer: Scale AI Systems

SupportFinity™; San Francisco (CA); Hybrid; USD 245,000 - 345,000; Full time

Benefits offered by this job

Flexible time off

Health insurance

WFH support

Home office setup

Cell phone stipend

Internet stipend

Wellness allowance

Childcare allowance

Parental leave

401k match

Dogfooding budget

Global PTO

Parental leave

Job summary

Whatnot is seeking engineers to shape the future of AI/ML by building and scaling core infrastructure for LLM applications across the company. You will ground model outputs in Whatnot’s business context and develop robust evaluation frameworks.

Join a remote-friendly team with hubs across the US and beyond, delivering scalable, secure AI-powered features for a leading livestream commerce platform.

Qualifications

• Bachelor's degree or equivalent work experience in a technical field.
• 3+ years of software engineering experience building and maintaining production systems for consumer-scale loads.
• 1+ years of professional Python development.
• Ability to work autonomously and drive initiatives across multiple product areas.
• Experience with databases and monitoring/logging tools.
• Familiarity with cloud platforms and managed services.
• Strong communication and documentation skills.

Responsibilities

• Own the infrastructure powering LLMs across critical surfaces.
• Create robust and scalable LLM evaluation frameworks.
• Deploy RAG systems and MCP servers with PII controls.
• Design human-in-the-loop feedback pipelines for scalable evaluation.
• Bridge research and production to scale ideas into solutions.
• Take on new technical challenges as we scale AI across the ecosystem.

Skills

Python

Production systems

Autonomy

Communication

Cross‑team collaboration

Documentation

Monitoring/logging

Cloud platforms

Education

Bachelor's degree in CS/Math/Statistics or related

Tools

PostgreSQL

DynamoDB

Elasticsearch

Redis

DataDog

Grafana

AWS (Sagemaker/Lambda/Kinesis/S3/EC2)

EKS/ECS

Kafka

Flink

Job description

Whatnot is seeking engineers to shape the future of AI/ML by building and scaling core infrastructure for LLM applications across the company. You will ground model outputs in Whatnot’s business context and develop robust evaluation frameworks.

Join a remote-friendly team with hubs across the US and beyond, delivering scalable, secure AI-powered features for a leading livestream commerce platform.