Remote Senior Software Engineer - 34123

Turing; Bengaluru; Remote; INR 800,000 - 1,500,000; Part time

Benefits offered by this job

Remote work environment

Work on cutting-edge AI projects

20 hours/week commitment

Contractor role

1 month contract duration

Job summary

Turing seeks an experienced tech lead software engineer to work on LLM evaluation and training datasets, specifically through real-world GitHub repositories. This unique blend of software engineering and AI research offers a chance to shape the future of AI-assisted software development with flexible remote work options.

Qualifications

• Experience with well-maintained, popular repositories (500+ stars) is mandatory.
• Experience running, modifying, and testing real-world projects locally.

Responsibilities

• Analyze and triage GitHub issues in trending open-source projects.
• Set up and configure code repositories, including Dockerization and environment setup.
• Assess unit test coverage and quality.

Skills

Proficiency in Git

Docker

Software pipeline setup

Navigating complex codebases

Open-source contribution or evaluation experience

Job description

We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. Our approach involves creating verifiable SWE tasks from public repository histories in a synthetic manner with human-in-the-loop, expanding dataset coverage across various programming languages and difficulty levels.

About the Role:

We seek experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute to this project. Ideal candidates will have experience with well-maintained, widely-used repos with 500+ stars. The role includes hands-on software engineering tasks such as environment automation, issue triaging, and evaluating test coverage and quality.

Why Join Us?

Turing is among the world’s fastest-growing AI companies, advancing and deploying powerful AI systems. You will be at the forefront of evaluating how LLMs interact with real code, shaping the future of AI-assisted software development. This role offers a unique blend of practical software engineering and AI research.

Typical Day:

• Analyze and triage GitHub issues in trending open-source projects.
• Set up and configure code repositories, including Dockerization and environment setup.
• Assess unit test coverage and quality.
• Modify and run codebases locally to evaluate LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify challenging repositories and issues for LLMs.
• Potential to lead a team of junior engineers on projects.

Required Skills:

• Experience with well-maintained, popular repositories (500+ stars).
• Proficiency in Git, Docker, and software pipeline setup.
• Ability to navigate complex codebases.
• Experience running, modifying, and testing real-world projects locally.
• Open-source contribution or evaluation experience is a plus.

Note: Experience with repositories having 500+ stars is mandatory.

Nice to Have:

• Participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks:

• Remote work environment.
• Work on cutting-edge AI projects with leading LLM companies.
• 20 hours/week commitment, overlapping with PST hours.
• Contractor role (no medical or paid leave).
• Contract duration: 1 month, starting next week.

Seniority level

• Mid-Senior level

Employment type

• Contract

Job function

• Engineering and Information Technology

Industries

• Software Development