Remote Senior Software Engineer - 34123

Turing; New York (NY); Remote; USD 40,000 - 60,000; Part time

Job summary

Join a leading AI company as a Software Engineer to work on LLM evaluation and training datasets. This role combines hands-on software engineering with AI research, impacting the future of AI-assisted software development. You'll analyze GitHub issues, set up code repositories, and collaborate with researchers, all in a fully remote environment with flexible hours.

Benefits

Fully remote work environment

Opportunity to contribute to cutting-edge AI projects

Potential for contract extension

Qualifications

• Experience with Git and Docker is essential.
• Familiarity with evaluating open-source projects is a strong plus.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization.
• Collaborate with researchers to identify challenging repositories.

Skills

Git

Docker

Software Pipeline Setup

Understanding Complex Codebases

Evaluating Open-Source Projects

C++

Java

Go

Job description

Get AI-powered advice on this job and access more exclusive features.

We are building LLM evaluation and training datasets to train language models on realistic software engineering problems. Our approach involves creating verifiable software engineering tasks based on public repository histories using a synthetic, human-in-the-loop process. We aim to expand dataset coverage across various programming languages, difficulty levels, and task types.

About the Role

We seek experienced software engineers (tech leads) familiar with public GitHub repositories to contribute to this project. Responsibilities include hands-on software engineering work such as developing environment automation, issue triaging, and evaluating test quality and coverage.

Why Join Us?

Turing is one of the world’s fastest-growing AI companies, advancing and deploying powerful AI systems. In this role, you'll evaluate how LLMs interact with real-world code, directly impacting the future of AI-assisted software development. This is a unique opportunity to combine practical software engineering with AI research.

Daily Responsibilities

1. Analyze and triage GitHub issues across trending open-source libraries.
2. Set up and configure code repositories, including Dockerization and environment setup.
3. Evaluate unit test coverage and quality.
4. Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
5. Collaborate with researchers to identify repositories and issues that challenge LLM capabilities.
6. Lead a team of junior engineers in collaborative projects.

Required Skills

• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Experience working with or evaluating open-source projects is a strong plus.
• Comfort with running, modifying, and testing real-world projects locally.
• Knowledge of other major languages (e.g., C++, Java, Go) is a plus.

Nice to Have

• Experience in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing with Turing

• Fully remote work environment.
• Opportunity to contribute to cutting-edge AI projects with leading LLM companies.
• Potential for contract extension based on performance and project needs.
• Commitment: 20 hours/week, some overlap with PST.
• Employment Type: Contractor (no medical benefits or paid leave).
• Contract Duration: 1 month, starting next week.

Seniority Level

• Entry level

Employment Type

• Contract

Job Function

• Engineering and Information Technology

Industry

• Software Development