Remote Senior Software Engineer - 34123

Turing; Vancouver; Remote; CAD 70,000 - 100,000; Part time

Job summary

A leading AI company is seeking a Remote Senior Software Engineer to work on LLM evaluation and training datasets. This role involves hands-on engineering tasks, including analyzing GitHub issues and collaborating with researchers. Ideal candidates will have experience with Git, Docker, and navigating complex codebases, contributing to the future of AI-assisted software development.

Benefits

Fully remote work environment

Engagement with cutting-edge AI projects

Potential contract extension based on performance

Qualifications

• Experienced software engineer at tech lead level.
• Familiar with high-quality public GitHub repositories.
• Experience with open-source projects is advantageous.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization.
• Evaluate unit test coverage and quality.

Skills

Proficiency with Git

Proficiency with Docker

Ability to navigate complex codebases

Experience running real-world projects

Familiarity with C++, Java, Go

Job description

Remote Senior Software Engineer - 34123

Get AI-powered advice on this job and more exclusive features.

We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. Our approach involves creating verifiable SWE tasks based on public repository histories in a synthetic manner, with human-in-the-loop, expanding dataset coverage across different programming languages, difficulty levels, and more.

About the Role:

We seek experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute to this project. Candidates should have experience with well-maintained, widely-used repositories with 500+ stars. The role involves hands-on engineering work, including environment automation, issue triaging, and evaluating test coverage and quality.

Why Join Us?

Turing is a rapidly growing AI company advancing powerful AI systems. You will evaluate how LLMs interact with real code, influencing AI-assisted software development's future. This role blends practical software engineering with AI research.

Day-to-Day Responsibilities:

1. Analyze and triage GitHub issues across trending open-source libraries.
2. Set up and configure code repositories, including Dockerization and environment setup.
3. Evaluate unit test coverage and quality.
4. Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
5. Collaborate with researchers to identify repositories and issues challenging for LLMs.
6. Lead a team of junior engineers on various projects (opportunity).

Required Skills:

• Proficiency with Git, Docker, and basic software pipelines.
• Ability to navigate complex codebases.
• Experience running, modifying, and testing real-world projects locally.
• Familiarity with other major languages (e.g., C++, Java, Go) is a plus.
• Contributing to or evaluating open-source projects is advantageous.

Nice to Have:

• Participation in LLM research or evaluation projects.
• Experience with building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

• Fully remote work environment.
• Engagement with cutting-edge AI projects and leading LLM companies.
• Potential contract extension based on performance and project needs.
• Commitment: 20 hours/week, some overlap with PST.
• Employment type: Contract (no medical/paid leave).
• Duration: 1 month, starting next week.

Additional Details

• Seniority level: Entry level
• Employment type: Contract
• Job function: Engineering and IT
• Industry: Software Development