Founding ML Research Engineer — Shape the 1st Consumer AI

Pally; San Francisco (CA); Vor Ort; USD 200.000 - 300.000; Vollzeit

Benefits dieser Stelle

Equity

401(k)

Health insurance

Zusammenfassung

Pally is seeking a senior-to-staff level AI research/engineering role in the Bay Area. You will work hands-on in eval harnesses, training code, and the agent itself to improve Pally’s performance as a personal AI assistant.

You’ll lead evaluations, fine-tuning, model routing, and red-teaming, shaping how Pally ships models that understand and assist users daily. This is a founder-friendly position with substantial equity and a direct impact on product quality.

Qualifikationen

• 4+ years of ML or software engineering, with experience at an AI lab, AI product company, or similar.
• Hands-on experience post-training or fine-tuning LLMs (SFT, preference tuning, distillation) and shipping results to production.
• Experience designing evals, such as LLM judges, human preference data, or replay of real traffic, trusted to make ship decisions.
• Strong Python and the ML stack for training and evals, and comfortable working in TypeScript in the product codebase.
• Fluency with AI-assisted development workflows, grounded in fundamentals to verify, correct, and own everything you ship.
• You want founding-team scope and will help hire engineers who join after you.

Aufgaben

• Evaluations: build the harness that turns feedback into a numeric signal for ship decisions.
• Fine-tuning: convert conversations into training data and post-train models for production.
• Model routing: train and evaluate a router so small models handle most turns; manage latency, cost, quality.
• Red teaming: identify and defend against prompt injection and other tricks.
• Agent experience: integrate memory, retrieval, tool selection, action vs. question, and daily transcripts into evals and model changes.

Kenntnisse

ML/Software Eng experience

Python

TypeScript

Fine-tuning LLMs

Eval design

AI workflows

Jobbeschreibung

Pally is seeking a senior-to-staff level AI research/engineering role in the Bay Area. You will work hands-on in eval harnesses, training code, and the agent itself to improve Pally’s performance as a personal AI assistant.

You’ll lead evaluations, fine-tuning, model routing, and red-teaming, shaping how Pally ships models that understand and assist users daily. This is a founder-friendly position with substantial equity and a direct impact on product quality.