Remote Senior Software Engineer - 34123

JR United Kingdom; Bradford; Remote; GBP 50,000 - 70,000; Full time

Job summary

A leading AI company seeks a Senior Software Engineer specializing in LLM Evaluation & Repository Validation. You will evaluate LLM performance and contribute to software engineering tasks in a remote environment, working closely with researchers and possibly leading a team. Ideal candidates will have experience with high-quality GitHub repositories and a strong background in code analysis and automation.

Benefits

Remote work environment

Work on cutting-edge AI projects with leading LLM companies

Qualifications

• Experience with well-maintained repositories with 500+ stars required.
• Ability to understand and navigate complex codebases is necessary.
• Experience with running, modifying, and testing projects locally.

Responsibilities

• Analyze and triage GitHub issues in trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.

Skills

Git

Docker

Software pipeline setup

Open-source contributions

Managing complex codebases

Job description

Social network you want to login/join with:

Remote Senior Software Engineer - 34123, Bradford

Client: Turing

Location: Bradford, United Kingdom

Job Category: Other

-

EU work permit required: Yes

Job Views: 2

Posted: 04.06.2025

Expiry Date: 19.07.2025

Job Description:

Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation

About the projects:

We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. Our approach involves building verifiable SWE tasks based on public repository histories with human-in-the-loop, expanding dataset coverage across programming languages and difficulty levels.

About the Role:

We seek experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute. You should have experience with repositories having 500+ stars. The role includes hands-on software engineering tasks such as environment automation, issue triaging, and evaluating test coverage and quality.

Why Join Us?

Turing is a rapidly growing AI company advancing AI systems deployment. You will evaluate how LLMs interact with real code, influencing AI-assisted software development's future. This role blends software engineering with AI research.

What does day-to-day look like:

• Analyze and triage GitHub issues in trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing.
• Collaborate with researchers to identify challenging repositories and issues for LLMs.
• Potentially lead a team of junior engineers.

Required Skills:

• Experience with well-maintained, widely-used repositories with 500+ stars.
• Proficiency with Git, Docker, and software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfort with running, modifying, and testing projects locally.
• Experience with open-source contributions is a plus.

Note: Experience with repositories having 500+ stars is required.

Nice to Have:

• Participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

• Remote work environment.
• Work on cutting-edge AI projects with leading LLM companies.
• 20 hours/week with some overlap with PST.
• Contractor role (no medical/paid leave).
• Contract duration: 1 month, starting next week.