Remote Senior Software Engineer - 34123

Turing; Greater London; Remote; GBP 50,000 - 80,000; Part time

Job summary

A leading company in AI is seeking experienced software engineers to contribute to LLM evaluation projects. This role involves analyzing GitHub repositories, evaluating software quality, and collaborating with researchers. Ideal candidates will have a strong background in software engineering and experience with open-source contributions.

Benefits

Remote work environment

Opportunity to work on cutting-edge AI projects

Potential contract extensions based on performance

Qualifications

• Experience with high-quality public GitHub repositories (500+ stars).
• Comfortable running and modifying real-world projects locally.
• Knowledge of major programming languages is a plus.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization.
• Evaluate unit test coverage and quality.

Skills

Git

Docker

Software pipeline setup

C++

Java

Go

Complex codebases navigation

Open-source contributions

Job description

1 day ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. One of our approaches is to build verifiable SWE tasks based on public repository histories in a synthetic approach with human-in-the-loop, expanding dataset coverage across different programming languages, difficulty levels, etc.

About the Role:

We are seeking experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute to this project. Candidates should have experience with well-maintained, widely-used repositories with 500+ stars. Responsibilities include hands-on software engineering tasks such as environment automation, issue triaging, and evaluating test coverage and quality.

Why Join Us?

Turing is one of the world’s fastest-growing AI companies, advancing and deploying powerful AI systems. You'll evaluate how LLMs interact with real code, influencing the future of AI-assisted software development. This role offers a unique blend of practical software engineering and AI research.

Daily Responsibilities:

1. Analyze and triage GitHub issues across trending open-source libraries.
2. Set up and configure code repositories, including Dockerization and environment setup.
3. Evaluate unit test coverage and quality.
4. Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
5. Collaborate with researchers to identify challenging repositories and issues for LLMs.
6. Potential to lead a team of junior engineers on projects.

Required Skills:

• Knowledge of other major languages (e.g., C++, Java, Go) is a plus.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience with open-source contributions or evaluations is advantageous.

Nice to Have:

• Participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

• Remote work environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
• Potential contract extensions based on performance and project needs.
• Commitment required: 20 hours/week with some overlap with PST.
• Employment type: Contractor (no medical/paid leave).
• Contract duration: 1 month, starting next week.

Seniority level

• Entry level

Employment type

• Contract

Job function

• Engineering and Information Technology

Industry

• Software Development