AI Quality & Behavior Engineer

Hack Chicago; San Francisco (CA); On-site; USD 98,000 - 140,000; Full time

Job summary

Notion in San Francisco is looking for a Quality Engineer to own the quality standards of its AI products. This role blends operational strategy and product thinking, requiring collaboration with engineering and product teams while analyzing data for insights.

The ideal candidate should have a problem-solving mindset and a keen interest in LLMs, contributing to the evaluation and launch of new models. Notion offers a competitive salary range of $98,000 to $140,000 per year.

Qualifications

• Must be proactive in identifying and solving problems.
• Must have a strong desire to explore AI capabilities and products.
• Must possess the ability to analyze large datasets effectively.

Responsibilities

• Design and iterate prompts for AI products to enhance behavior.
• Use production data to identify and resolve issues.
• Develop evaluation strategies for quality assessments.
• Collaborate with research labs to evaluate new AI models.
• Prioritize quality issues with engineering and product management.
• Create tools to support AI observability.

Skills

Problem-solving mindset

Curiosity about AI

Analytical skills

Data analysis

Communication

Experience with LLMs

Job description

Notion in San Francisco is looking for a Quality Engineer to own the quality standards of its AI products. This role blends operational strategy and product thinking, requiring collaboration with engineering and product teams while analyzing data for insights.

The ideal candidate should have a problem-solving mindset and a keen interest in LLMs, contributing to the evaluation and launch of new models. Notion offers a competitive salary range of $98,000 to $140,000 per year.