Forward Deployed ML Engineer: Benchmarks & Evaluations

Protege; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Protege is building a platform to accelerate access to AI training data and is hiring a Forward Deployed Machine Learning Engineer for its Benchmarks and Evaluations vertical. You will work closely with the GM and researchers to scale Protege’s leadership in this space and help build the technical foundation for critical eval capabilities.

You will own data pipelines, execution environments, and benchmarking standards, collaborating with researchers to define strong evals across modalities and

Qualifications

• 4+ years of engineering experience.
• Hands-on ML work evaluating models.
• Have previously owned backend and infrastructure.
• High ambiguity tolerance and bias to action.
• Comfort working with urgency to meet the pace and volume of the market demands.
• Strong written communication.

Responsibilities

• Work on the eval foundation by defining strong evals in different domains and building benchmarks.
• Own backend infrastructure including data pipelines, execution environments, storage, and orchestration.
• Go from fast iteration to product by identifying repeatable eval patterns and engaging with DataLab on domain-specific data and research questions.

Skills

Engineering experience

Hands-on ML evaluation

Backend ownership

Ambiguity tolerance

Bias to action

Written communication

Job description

Protege is building a platform to accelerate access to AI training data and is hiring a Forward Deployed Machine Learning Engineer for its Benchmarks and Evaluations vertical. You will work closely with the GM and researchers to scale Protege’s leadership in this space and help build the technical foundation for critical eval capabilities.

You will own data pipelines, execution environments, and benchmarking standards, collaborating with researchers to define strong evals across modalities and