Open Source Evaluation Engineer

Mercor; United States; Remote; USD 90,000 - 150,000; Full time

Job summary

Mercor, a United States–based company, seeks a skilled engineer to design and oversee evaluations for coding tasks across multiple languages. You will craft robust test suites and analyze performance in diverse scenarios, collaborating with distributed teams.

You should have a strong GitHub presence and deep knowledge of software architecture, performance tuning, and scalable patterns. This role emphasizes contributing to open-source governance and autonomous improvement.

Qualifications

• Experience contributing to top OSS projects in the last 12 months.
• Strong knowledge of Python, Java, C, JavaScript, or TypeScript.
• Deep understanding of software architecture and performance tuning.

Responsibilities

• Design evaluations for coding tasks across JavaScript, TypeScript, Python, Java, and C.
• Develop test cases to assess system performance in varied engineering scenarios.
• Analyze real-world usage to identify strengths and improvement areas.
• Convey evaluation results to the research team to guide development.

Skills

Open-source

Python

JavaScript/TypeScript

C

Java

CI/CD

Job description

Mercor, a United States–based company, seeks a skilled engineer to design and oversee evaluations for coding tasks across multiple languages. You will craft robust test suites and analyze performance in diverse scenarios, collaborating with distributed teams.

You should have a strong GitHub presence and deep knowledge of software architecture, performance tuning, and scalable patterns. This role emphasizes contributing to open-source governance and autonomous improvement.