AI Quality Engineer: Prompting & Model Tuning

Gamma; San Francisco (CA); Hybrid; USD 180,000 - 340,000; Full time

Job summary

A tech company in San Francisco is seeking a Research Engineer to enhance AI quality across its products. This role involves designing metrics, conducting experiments, and iterating on AI outputs to improve quality. Candidates should have over two years of experience with AI systems, a strong background in prompt engineering, and a bachelor's degree in a relevant field. The position offers a competitive salary range of $180K - $340K and supports a combination of in-office and remote work.

Qualifications

• 2+ years experience with AI systems and production-grade AI products.
• Deep hands-on expertise in prompt engineering and LLM evaluation.
• Exceptional attention to detail and quality obsession.

Responsibilities

• Design and maintain evaluation frameworks for AI output quality.
• Improve production prompts through experimentation and analysis.
• Build tools to support rapid experimentation for quality analysis.

Skills

Prompt engineering

LLM experimentation

AI output evaluation

Attention to detail

Experimental mindset

Education

Bachelor's degree in Computer Science or related field

Equivalent hands-on experience with AI

Job description

A tech company in San Francisco is seeking a Research Engineer to enhance AI quality across its products. This role involves designing metrics, conducting experiments, and iterating on AI outputs to improve quality. Candidates should have over two years of experience with AI systems, a strong background in prompt engineering, and a bachelor's degree in a relevant field. The position offers a competitive salary range of $180K - $340K and supports a combination of in-office and remote work.