Remote Senior Software Engineer - 34123

Turing; Vancouver; Remote; CAD 125,000 - 150,000; Part time

Job summary

A rapidly growing AI company, Turing, seeks experienced Software Engineers (Tech Lead level) to contribute to LLM evaluation projects. This role involves assessing software engineering tasks related to popular public GitHub repositories and influencing AI-assisted software development. Candidates will collaborate closely with researchers and potentially lead a team of junior engineers. Flexibility with fully remote work and a commitment of 20 hours per week is required, with an initial contract duration of one month.

Benefits

Fully remote work environment

Opportunity to work on cutting-edge AI projects

Potential for contract extension based on performance

Qualifications

• Hands-on experience with software engineering tasks.
• Familiarity with public GitHub repositories.
• Experience evaluating test coverage and software quality.

Responsibilities

• Analyze and triage issues in trending open-source libraries.
• Set up code repositories and environment automation.
• Evaluate unit test coverage and quality of codebases.

Skills

Proficiency with Git

Proficiency with Docker

Ability to understand complex codebases

Experience with open-source contributions

Job description

1 day ago Be among the first 25 applicants

We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. Our approach involves creating verifiable SWE tasks based on public repository histories, using a synthetic approach with human-in-the-loop, and expanding dataset coverage across various programming languages and difficulty levels.

About the Role :

We seek experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute to this project. Candidates should have experience with well-maintained, widely-used repos with 500+ stars. Responsibilities include hands-on software engineering tasks such as environment automation, issue triaging, and evaluating test coverage and quality.

Why Join Us?

Turing is a rapidly growing AI company dedicated to advancing and deploying powerful AI systems. You will evaluate how LLMs interact with real code, influencing the future of AI-assisted software development. This role offers a unique blend of practical software engineering and AI research.

Day-to-Day Responsibilities :

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to select repositories and issues challenging for LLMs.
• Potentially lead a team of junior engineers on projects.

Required Skills :

• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfort with running, modifying, and testing real-world projects locally.
• Experience with open-source contributions or evaluations is a plus.

Nice to Have :

• Participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing :

• Fully remote work environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
• Potential for contract extension based on performance.
• Commitment : 20 hours / week, some overlap with PST.
• Employment Type : Contractor (no medical / paid leave).
• Contract Duration : 1 month, starting next week.
• Seniority level : Entry level
• Employment type : Contract
• Job function : Engineering and IT
• Industry : Software Development

J-18808-Ljbffr

Create a job alert for this search