Platform Engineer for LLM Benchmarking & Tools (SF)

Vibehackers; San Francisco, Northern (CA, KY); Hybrid; USD 140,000 - 185,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

401K plan

Housing stipend

Lunch and meals provided

Unlimited PTO

Equity

Job summary

Vals AI is seeking a Senior Platform Engineer in San Francisco to own and build the scalable infrastructure for large‑scale LLM evaluation benchmarks. You will work across distributed systems, cloud infra, and full‑stack features (Python/Django backend and React/TypeScript frontend) on an in‑person team.

Responsibilities include designing, deploying, and improving the platform, collaborating with research, and maintaining libraries.

Qualifications

• Significant professional experience with Python.
• Experience designing scalable distributed systems.
• Frontend/backend full‑stack capability (React/TypeScript + Django).
• Familiarity with LLMs and APIs.

Responsibilities

• Build distributed systems to run evaluations at scale.
• Deploy cloud infra using IaC and CI/CD pipelines.
• Develop internal/external libraries and model library.
• Implement full-stack features using React/TypeScript and Python/Django.
• Perform code/architecture reviews and define engineering best practices.
• Collaborate with research to meet evaluation needs.

Skills

Python

Django

React

TypeScript

System design

Distributed systems

Tools

AWS CDK

Job description

Vals AI is seeking a Senior Platform Engineer in San Francisco to own and build the scalable infrastructure for large‑scale LLM evaluation benchmarks. You will work across distributed systems, cloud infra, and full‑stack features (Python/Django backend and React/TypeScript frontend) on an in‑person team.

Responsibilities include designing, deploying, and improving the platform, collaborating with research, and maintaining libraries.