Remote Senior Software Engineer - 34123

Turing; Brasil; Teletrabalho; USD 30.000 - 50.000; Tempo parcial

Resumo da oferta

Turing is looking for experienced software engineers to contribute to LLM evaluation and training datasets. This role involves hands-on tasks like automating development environments and evaluating code quality, with opportunities to lead projects and influence AI-assisted software development.

Serviços

Remote work environment

Opportunity to work on cutting-edge AI projects

Potential contract extension based on performance

Qualificações

• Experience with high-quality public GitHub repositories.
• Hands-on software engineering tasks including automating environments.
• Experience in evaluating test coverage and quality.

Responsabilidades

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization.
• Collaborate with researchers to identify challenging repositories.

Conhecimentos

Proficiency with Git

Proficiency with Docker

Ability to understand complex codebases

Experience running real-world projects

Familiarity with C++, Java, Go

Experience with open-source projects

Descrição da oferta de emprego

1 day ago Be among the first 25 applicants

We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. One approach in this project involves creating verifiable SWE tasks based on public repository histories, using a synthetic approach with human-in-the-loop, while expanding dataset coverage across different task types, programming languages, and difficulty levels.

About the Role:

We are seeking experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute to this project. Candidates should have experience working with well-maintained, widely-used repositories with 500+ stars. The role involves hands-on software engineering tasks, including automating development environments, issue triaging, and evaluating test coverage and quality.

Why Join Us?

Turing is one of the world’s fastest-growing AI companies, accelerating the development and deployment of powerful AI systems. You will be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This role offers a unique opportunity to combine practical software engineering with AI research.

Day-to-day Responsibilities:

1. Analyze and triage GitHub issues across trending open-source libraries.
2. Set up and configure code repositories, including Dockerization and environment setup.
3. Evaluate unit test coverage and quality.
4. Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
5. Collaborate with researchers to identify repositories and issues challenging for LLMs.
6. Lead a team of junior engineers on collaborative projects (opportunity).

Required Skills:

• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Experience running, modifying, and testing real-world projects locally.
• Familiarity with other major languages (e.g., C++, Java, Go) is a plus.
• Experience contributing to or evaluating open-source projects is a plus.

Nice to Have:

• Participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

• Remote work environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
• Potential contract extension based on performance and project needs.
• Commitment: 20 hours/week with some overlap with PST.
• Employment Type: Contractor (no medical/paid leave).
• Contract Duration: 1 month, starting next week.

Seniority Level

• Entry level

Employment Type

• Contract

Job Function

• Engineering and Information Technology

Industry

• Software Development