AI Data Quality & Evaluation Engineer

Veeva Systems, Inc.; Toronto; Hybrid; CAD 85,000 - 225,000; Full time

Job summary

A leading life sciences technology company is seeking a candidate for a mission-driven role focused on evaluating AI Agents. The ideal applicant will define comprehensive evaluation strategies, assess LLM-generated content, and curate high-fidelity datasets, leveraging strong programming skills in Python. The role allows for remote work within Canada and emphasizes a commitment to product quality and integrity. We offer competitive compensation and robust benefits, making this an excellent opportunity for driven professionals.

Benefits

Medical, dental, vision, and basic life insurance

PTO and company-paid holidays

Retirement programs

Charitable giving program

Qualifications

• Strong understanding of data validation methods.
• Ability to craft diverse test data for AI.
• Experience with automated evaluation metrics.

Responsibilities

• Define evaluation strategies for AI Agents.
• Assess LLM-generated content quality.
• Create high-fidelity datasets for testing.
• Maintain scalable evaluation pipelines.

Skills

Data quality principles

Advanced prompt engineering

Automated evaluation pipelines

Proficiency in Python

Debugging agentic systems

Education

Bachelor's degree in Data Science, Machine Learning, Computer Science, or related field

Tools

Python

Pytest

Job description

A leading life sciences technology company is seeking a candidate for a mission-driven role focused on evaluating AI Agents. The ideal applicant will define comprehensive evaluation strategies, assess LLM-generated content, and curate high-fidelity datasets, leveraging strong programming skills in Python. The role allows for remote work within Canada and emphasizes a commitment to product quality and integrity. We offer competitive compensation and robust benefits, making this an excellent opportunity for driven professionals.