Remote C++ Bench Engineer for AI Code Evaluation

Benture; San Francisco (CA); Hybrid; USD 91,000 - 182,000; Part time

Job summary

Turing, an AI company, is hiring experienced C++ engineers to evaluate how large language models handle real code. The project combines hands‑on software engineering with AI evaluation, covering development environment automation, issue triaging, and test coverage and quality assessment.

Role focuses on analyzing issues, setting up Dockerized environments, and testing open-source projects, with a fully remote contract spanning 2–3 weeks. Strong C++ skills and OSS experience are desired.

Qualifications

• 2+ years of professional software engineering experience
• Strong C++ experience
• Git, Docker, and basic software pipeline setup experience
• Ability to navigate large codebases
• Experience with open-source projects is a plus

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries
• Set up repositories, including Dockerization and environment setup
• Evaluate unit test coverage and quality
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios
• Collaborate with researchers to identify repositories and issues that are challenging for LLMs

Skills

C++

Code triage

Open-source familiarity

Remote collaboration

Tools

Git

Docker

Job description

Turing, an AI company, is hiring experienced C++ engineers to evaluate how large language models handle real code. The project combines hands‑on software engineering with AI evaluation, covering development environment automation, issue triaging, and test coverage and quality assessment.

Role focuses on analyzing issues, setting up Dockerized environments, and testing open-source projects, with a fully remote contract spanning 2–3 weeks. Strong C++ skills and OSS experience are desired.