Remote Senior Software Engineer - 34123

JR United Kingdom; Derby; Remote; GBP 50,000 - 70,000; Part time

Job summary

Join a rapidly growing AI company as a software engineer focusing on evaluating and training LLMs. This contractor role includes hands-on development, environment automation, and analyzing trends in open-source repositories. Ideal for someone experienced with well-maintained repositories and seeking a unique blend of software engineering and AI research.

Benefits

Remote work

Cutting-edge AI projects

Flexible hours with 20 hours/week overlap with PST

Contractor role with potential for extension

Qualifications

• Experience with Git and Docker is required.
• Familiarity with public repositories having 500+ stars is mandatory.
• Experience in LLM research is a nice to have.

Responsibilities

• Analyze and triage GitHub issues across trending libraries.
• Set up code repositories and Docker environments.
• Collaborate on evaluating LLM performance.

Skills

Proficiency with Git

Proficiency with Docker

Ability to understand complex codebases

Experience with well-maintained repositories

Job description

Social network you want to login/join with:

col-narrow-left

Client:

Turing

Location:

derby, United Kingdom

Job Category:

Other

-

EU work permit required:

Yes

col-narrow-right

Job Views:

2

Posted:

06.06.2025

Expiry Date:

21.07.2025

col-wide

Job Description:

About the projects:

We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. One approach involves creating verifiable SWE tasks based on public repository histories, using a synthetic, human-in-the-loop method, while expanding dataset coverage across various programming languages and difficulty levels.

About the Role:

We seek experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute. You should have experience with well-maintained repos with 500+ stars. This role includes hands-on development, environment automation, issue triaging, and evaluating test coverage and quality.

Why Join Us?

Turing is a rapidly growing AI company advancing powerful AI systems. You will evaluate how LLMs interact with real code, influencing AI-assisted software development's future. This role offers a unique blend of practical software engineering and AI research.

Day-to-day Responsibilities:

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify repositories and issues challenging for LLMs.
• Potential to lead a team of junior engineers.

Required Skills:

• Experience with well-maintained, widely-used repositories (500+ stars)
• Proficiency with Git, Docker, and software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfort with running, modifying, and testing real-world projects locally.
• Open-source contribution or evaluation experience is a plus.

Note: Experience with repositories having 500+ stars is mandatory.

Nice to Have:

• Participation in LLM research or evaluation projects.
• Experience with developer tools or automation agents.
• Perks include remote work, cutting-edge AI projects, 20 hours/week overlap with PST, contractor role (no medical/paid leave), and a 1-month contract starting next week.