Staff Data Scientist, AI Evaluation & LLM Quality

Perplexity; United States; Hybrid; USD 100,000 - 150,000; Full time

Job summary

Perplexity, based in the United States, is seeking a qualified candidate to enhance our automated evaluation processes. Responsibilities include architecting evaluation pipelines and developing methods to ensure the accuracy and helpfulness of answers across our platforms.

The ideal applicant will possess a PhD or MS in a technical field, along with over 4 years of experience in data science or machine learning, and strong coding skills in Python and SQL. Experience with AWS and Databricks is preferred.

Qualifications

• PhD or MS in a technical field or equivalent experience.
• 4+ years of experience in data science or machine learning.
• Strong proficiency in Python and SQL.

Responsibilities

• Architect and maintain automated evaluation pipelines for answer quality.
• Design evaluation sets to measure the impact of tool calls on answer quality.
• Develop VLM-based solutions for visual answer evaluation.

Skills

Python

SQL

Data science

Machine learning

AWS

Databricks

Education

PhD or MS in a technical field

Job description

Perplexity, based in the United States, is seeking a qualified candidate to enhance our automated evaluation processes. Responsibilities include architecting evaluation pipelines and developing methods to ensure the accuracy and helpfulness of answers across our platforms.

The ideal applicant will possess a PhD or MS in a technical field, along with over 4 years of experience in data science or machine learning, and strong coding skills in Python and SQL. Experience with AWS and Databricks is preferred.