Remote Senior Software Engineer - 34123

Turing; Vancouver; Remote; CAD 80,000 - 110,000; Part time

Job summary

A leading company in AI is seeking a Remote Senior Software Engineer to work on LLM evaluation and training datasets. This role involves hands-on engineering tasks, including automation and issue triaging, while collaborating with researchers to enhance AI-assisted software development. Ideal candidates will have experience with GitHub, Docker, and open-source contributions. Join us to influence the future of AI in software engineering!

Benefits

Fully remote work environment

Opportunity to contribute to cutting-edge AI projects

Potential for contract extension based on performance

Qualifications

• Experience contributing to or evaluating open-source projects is a strong plus.
• Comfortable running, modifying, and testing real-world projects locally.

Responsibilities

• Analyze and triage GitHub issues across open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Collaborate with researchers to identify challenging repositories and issues for LLMs.

Skills

C++

Java

Go

Git

Docker

Job description

Remote Senior Software Engineer - 34123

3 days ago Be among the first 25 applicants

We are building LLM evaluation and training datasets to train language models on realistic software engineering problems. One of our key approaches in this project is to create verifiable software engineering tasks based on public repository histories using a synthetic, human-in-the-loop process. We aim to expand dataset coverage across various programming languages, difficulty levels, and task types.

About the Role

We are looking for experienced software engineers (tech leads) familiar with public GitHub repositories to contribute to this project. The role involves hands-on software engineering work, including environment automation, issue triaging, and evaluation of test quality and coverage.

Why Join Us?

Turing is one of the world’s fastest-growing AI companies, advancing powerful AI systems. In this role, you'll evaluate how LLMs interact with real-world code, influencing AI-assisted software development. This is a unique opportunity to combine software engineering with AI research.

What Your Day-to-Day Will Look Like

• Analyze and triage GitHub issues across open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify challenging repositories and issues for LLMs.
• Lead a team of junior engineers in project work.

Required Skills

• Knowledge of major languages (e.g., C++, Java, Go) is a plus.
• Proficiency with Git, Docker, and software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a strong plus.

Nice to Have

• Prior experience in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing with Turing

• Fully remote work environment.
• Opportunity to contribute to cutting-edge AI projects with leading LLM companies.
• Potential for contract extension based on performance.
• Commitment: 20 hours/week, some overlap with PST.
• Employment Type: Contractor (no medical benefits or paid leave).
• Contract Duration: 1 month, starting next week.

Seniority level

• Mid-Senior level

Employment type

• Contract

Job function

• Engineering and IT

Industries

• Software Development