Research Engineer, Post-Training Evaluation & Infra

Ersilia; San Francisco (CA); Presencial; USD 150 000 - 350 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Meaningful equity grants

Health, dental, and vision coverage

Resumo da oferta

Ersilia in San Francisco is building the data and infrastructure behind frontier model training and deployed AI agents. You will own evaluation systems, ranking training tasks by value and catching drift as data and tasks evolve.

This role is hands-on and in person, six days a week, requiring strong systems engineering, RL experience, and the ability to ship production-grade evaluators tied to training pipelines.

Qualificações

• Experience building environments, evaluations, or RL pipelines in production.
• Hands-on RL research or data science experience.
• Strong systems engineering skills and the ability to ship end-to-end evaluators tied to training pipelines.

Responsabilidades

• Rank training value before spending compute and build a system to rank tasks by expected training value.
• Design scoring that runs cheaply at scale, tuned to customer-specific outcomes.
• Detect and adapt to distribution drift by updating evaluations as customer requests evolve.

Conhecimentos

RL pipelines

Systems engineering

Reward design

Ambiguous evaluation problems

Descrição da oferta de emprego

Ersilia in San Francisco is building the data and infrastructure behind frontier model training and deployed AI agents. You will own evaluation systems, ranking training tasks by value and catching drift as data and tasks evolve.

This role is hands-on and in person, six days a week, requiring strong systems engineering, RL experience, and the ability to ship production-grade evaluators tied to training pipelines.