Remote Senior Software Engineer - 34123

Turing; Canada; Remote; CAD 80,000 - 120,000; Part time

Job summary

A leading AI company is seeking experienced software engineers at the tech lead level to contribute to LLM evaluation and training datasets. This role involves hands-on software engineering tasks such as automating environments and evaluating test coverage, offering a unique blend of practical engineering and AI research. Join Turing to shape the future of AI-assisted software development while working remotely on cutting-edge projects.

Benefits

Work remotely

Engage in cutting-edge AI projects

Potential for contract extension

Qualifications

• Experience with Git and Docker is essential.
• Knowledge of additional programming languages is a plus.
• Ability to navigate and modify real-world codebases.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization.
• Evaluate unit test coverage and quality.

Skills

Proficiency with Git

Docker

Ability to understand complex codebases

Experience with open-source projects

Knowledge of C++, Java, Go

Job description

Get AI-powered advice on this job and more exclusive features.

We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. One approach involves creating verifiable SWE tasks based on public repository histories in a synthetic manner, incorporating human-in-the-loop methods, and expanding dataset coverage across various programming languages and difficulty levels.

About the Role:

We seek experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute to this project. Candidates should have experience with well-maintained, widely-used repos with 500+ stars. The role involves hands-on software engineering tasks such as automating development environments, issue triaging, and evaluating test coverage and quality.

Why Join Us?

Turing is among the world’s fastest-growing AI companies, accelerating the development and deployment of powerful AI systems. You will be at the forefront of evaluating how LLMs interact with real code, shaping the future of AI-assisted software development. This role offers a unique blend of practical software engineering and AI research.

Day-to-Day Responsibilities:

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify repositories and issues challenging for LLMs.
• Potentially lead a team of junior engineers on projects.

Required Skills:

• Knowledge of additional major languages (e.g., C++, Java, Go) is a plus.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfort with running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is advantageous.

Nice to Have:

• Previous participation in LLM research or evaluation projects.
• Experience developing or testing developer tools or automation agents.

Perks of Freelancing With Turing:

• Work remotely.
• Engage in cutting-edge AI projects with leading LLM companies.
• Potential for contract extension based on performance and project needs.
• Commitment: 20 hours/week with some overlap with PST.
• Employment Type: Contractor (no medical/paid leave).
• Contract Duration: 1 month, starting next week.

Seniority Level

• Entry level

Employment Type

• Contract

Job Function

• Engineering and Information Technology

Industries

• Software Development