SWE Bench Engineer - C++

Turing Global India; United States; Remote; USD 27,000 - 41,000; Part time

Benefits offered by this job

Fully remote

Cutting-edge AI projects

Job summary

Turing Global India is seeking experienced software engineers at a tech-lead level to contribute to high-quality public GitHub repositories. The role involves hands-on software engineering, including environment automation, issue triaging, and assessing test coverage and quality.

You will analyze and triage issues across trending open-source libraries, set up repositories with Dockerization, and evaluate unit test coverage.

Qualifications

• 2+ years of overall software engineering experience.
• Strong experience with C++ or related languages.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate large, complex codebases.
• Comfortable running and testing real-world projects locally.

Responsibilities

• Analyze and triage issues across open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.
• Modify and run code locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify challenging repositories for LLMs.

Skills

C++

Git

Docker

Codebase navigation

LLM evaluation

Tools

CI/CD

Job description

About the Role:

We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands‑on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality

What does day-to-day look like:

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluating unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

Required Skills:

• Minimum 2+ years of overall experience
• Strong experience with at least one of the following languages: C++
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a plus.

Nice to Have:

• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

• Work in a fully remote environment.
• Opportunity to work on cutting‑edge AI projects with leading LLM companies.

Offer Details:

• Commitments Required: Minimum 40 hours per week with overlap of 4 hours with PST.
• Employment type : Contractor assignment (no medical/paid leave)
• Duration of contract : 2-3 weeks; [expected start date is next week]
• Payment: $15 per approved task
• Location : India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico

Evaluation Process (approximately 75 mins) :

• Assessment based review