Staff Engineer — Evals & Post-Training Product

Fireworks AI; San Mateo (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Work with cutting-edge technology

Collaborative and inclusive environment

Opportunities for growth and learning

Job summary

A leading AI Infrastructure company based in San Mateo is seeking a Member of Technical Staff, Evals & Post-Training Product to enhance their generative AI platform. The role involves building connections between evaluation processes and fine-tuning workflows to improve model quality. Ideal candidates will have a strong background in software engineering, particularly in LLM evaluations, alongside a user-centric mindset. Join a collaborative team worked on cutting-edge AI infrastructure projects.

Qualifications

• 1-7 years of software engineering experience.
• Hands-on experience with LLM evaluations and/or post-training methods.
• Ability to work across backend systems and developer-facing product surfaces.

Responsibilities

• Design and scale evaluation tooling used by internal teams.
• Build user-facing product workflows for post-training.
• Partner with customers to understand evaluation needs.

Skills

Software engineering experience

LLM evaluations and post-training methods

Product engineering skills

Understanding of the GenAI lifecycle

User-centric mindset

Job description

A leading AI Infrastructure company based in San Mateo is seeking a Member of Technical Staff, Evals & Post-Training Product to enhance their generative AI platform. The role involves building connections between evaluation processes and fine-tuning workflows to improve model quality. Ideal candidates will have a strong background in software engineering, particularly in LLM evaluations, alongside a user-centric mindset. Join a collaborative team worked on cutting-edge AI infrastructure projects.