SWE Bench Engineer - C++

Turing; United States; Remote; USD 46.000 - 68.000; Teilzeit

Benefits dieser Stelle

Fully remote

Zusammenfassung

Turing is seeking experienced software engineers for a contractor assignment to analyze GitHub issues and assess LLM performance on real code. The role emphasizes hands-on engineering, environment automation, issue triaging, and evaluating test coverage in open-source projects.

Expect 2–3 week duration with a 40-hour/overlap requirement, fully remote work, and a pay model of $25 per approved task. Start date is next week, with potential collaboration with AI researchers on repository challenges.

Qualifikationen

• 2+ years of overall software experience.
• Strong in at least one language: C++.
• Proficient with Git, Docker and basic pipeline setup.
• Able to understand and navigate complex codebases.
• Comfortable running and testing real-world projects locally.
• Experience with open-source projects is a plus.

Aufgaben

• Analyze and triage GitHub issues across trending libraries.
• Set up repos, Dockerize and configure environments.
• Evaluate unit test coverage and quality.
• Modify and run code locally to assess LLM performance.
• Collaborate with researchers to pick challenging repositories.

Kenntnisse

C++

Git

Docker

Codebase navigation

Local testing

Tools

Git

Docker

CI/CD pipelines

Jobbeschreibung

Analyze GitHub issues and assess LLM performance in real code.

About Turing
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. You’ll be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This is a unique opportunity to blend practical software engineering with AI research.

About the Role:

We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality

What does day-to-day look like:

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluating unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

Required Skills:

• Minimum 2+ years of overall experience
• Strong experience with at least one of the following languages: C++
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a plus.

Nice to Have:

• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details:

• Commitments Required: Minimum 40 hours per week with overlap of 4 hours with PST.
• Employment type: Contractor assignment (no medical/paid leave)
• Duration of contract: 2-3 weeks; [expected start date is next week]
• Payment: $25 per approved task
• Location: India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico, LATAM

Evaluation Process (approximately 75 mins) :

• Assessment based review

Skills:

C++