Remote AI Data Engineer: LLM Evaluation & Validation

Veeva Systems; Portland (ME); Hybrid; USD 85,000 - 225,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Flexible PTO

Retirement programs

Charitable giving program

Job summary

A pioneering cloud solutions provider in the life sciences sector is seeking an AI Data Engineer. In this role, you will ensure the reliability and accuracy of AI systems through extensive evaluation methodologies. Required qualifications include 5+ years of experience in automated evaluations and proficiency in Python. The company offers flexible work arrangements and a comprehensive benefits package including competitive salary, medical, and retirement programs. You will thrive in a culture that values integrity and success.

Qualifications

• 5+ years experience in automated evaluation pipelines.
• Strong understanding of data quality principles.
• Experience with debugging agentic systems.

Responsibilities

• Define and establish evaluation strategies for AI Agents.
• Evaluate the quality of LLM-generated content.
• Design and curate diverse high-quality test data sets.

Skills

Analytical problem-solving

Technical communication

Curiosity

Attention to detail

Education

Bachelor's degree in Data Science or related field

Tools

Python

Pytest

Job description

A pioneering cloud solutions provider in the life sciences sector is seeking an AI Data Engineer. In this role, you will ensure the reliability and accuracy of AI systems through extensive evaluation methodologies. Required qualifications include 5+ years of experience in automated evaluations and proficiency in Python. The company offers flexible work arrangements and a comprehensive benefits package including competitive salary, medical, and retirement programs. You will thrive in a culture that values integrity and success.