AI Content Quality Architect

Vamp; New York (NY); On-site; USD 162,000 - 227,000; Full time

Job summary

Vamp is looking for a Product Content Engineer in New York to lead content quality initiatives across Meta's products. This role involves assessing AI model performance, defining standards, and collaborating with engineers and product teams to enhance AI-driven experiences.

Applicants should bring over 5 years of experience in product collaboration and familiarity with generative AI. Compensation ranges from $162,000 to $227,000 annually, complemented by bonuses and benefits.

Qualifications

• 5+ years of experience working collaboratively with product, engineering, design, and user research teams.
• 1+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or content labeling and analysis.
• Experience designing and implementing evaluation frameworks, annotation guidelines, or quality rubrics for AI/ML systems.

Responsibilities

• Define content quality standards for AI models.
• Design evaluation frameworks integrating qualitative and quantitative signals.
• Synthesize evaluation results into structured error patterns.

Skills

Collaboration with product, engineering, and design teams

Generative AI products experience

Data analysis skills

Critical thinking

Cross-functional collaboration

Education

BA or BS in Computer Science, Data Science, Linguistics, or related field

Tools

Python

SQL

Job description

Vamp is looking for a Product Content Engineer in New York to lead content quality initiatives across Meta's products. This role involves assessing AI model performance, defining standards, and collaborating with engineers and product teams to enhance AI-driven experiences.

Applicants should bring over 5 years of experience in product collaboration and familiarity with generative AI. Compensation ranges from $162,000 to $227,000 annually, complemented by bonuses and benefits.