AI Quality Engineer: Research & Prompt Optimization

gamma capital markets; San Francisco (CA); Hybrid; USD 180,000 - 340,000; Full time

Benefits offered by this job

Equity

Job summary

gamma capital markets is seeking a Research Engineer to own the quality of AI across every product the company creates. You will design evaluation frameworks, measure AI output quality, and fine-tune models to ensure millions of users get exceptional results.

This role blends research rigor with product impact: you will diagnose AI failure patterns, craft improvements through experiments, and build tools that enable rapid testing and reliable scale.

Qualifications

• 2+ years shipping production-grade AI products.
• Deep hands-on experience with prompt engineering and systematic evaluation of AI outputs.
• Strong experimental mindset to design tests, analyze results, and iterate toward quality improvements in ambiguous spaces.
• Experience with post-training techniques for LLMs including reinforcement learning and supervised fine-tuning.
• Exceptional attention to detail and quality across all output dimensions.

Responsibilities

• Design and maintain evaluation frameworks that measure AI output quality across Gamma experiences, developing metrics and benchmarks.
• Systematically improve production prompts through iterative experimentation and validation against quality benchmarks.
• Conduct rigorous experiments to understand model behavior and derive insights for prompt and model improvements.
• Build tools and workflows to support rapid experimentation and quality analysis at scale.
• Fine-tune models on targeted datasets to improve baseline performance.
• Partner with product and engineering teams to ensure AI quality improvements ship quickly and reliably.

Skills

AI systems

Prompt engineering

LLM experimentation

Experimental mindset

Post-training techniques

Attention to detail

Education

CS/ML degree

Job description

gamma capital markets is seeking a Research Engineer to own the quality of AI across every product the company creates. You will design evaluation frameworks, measure AI output quality, and fine-tune models to ensure millions of users get exceptional results.

This role blends research rigor with product impact: you will diagnose AI failure patterns, craft improvements through experiments, and build tools that enable rapid testing and reliable scale.