Senior Python Developer for AI-Driven Code & LLM (Remote)

turing; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Work in a fully remote environment.

Opportunity to work on cutting-edge AI

Job summary

Turing is seeking an experienced software engineer at tech-lead level for a remote contractor role to advance LLM evaluation and synthetic SWE tasks built from public repositories. You\'ll own hands-on engineering work, automation, triaging issues, and assessing test coverage.

You will analyze GitHub issues, set up repositories with Docker, run tests locally, and collaborate with researchers to select challenging repositories for LLMs. Opportunities to lead a small team of juniors.

Qualifications

• Minimum 3+ years of overall software experience.
• Strong Python experience.
• Experience with Git and Docker and setting up basic pipelines.
• Ability to navigate large codebases and test locally.
• Experience with open-source contributions is a plus.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluating unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
• Opportunities to lead a team of junior engineers to collaborate on projects.

Skills

Python

Git

Docker

Codebase navigation

Local testing

Open-source experience

Team leadership

Tools

Docker

CI/CD basics

Environment setup

Job description

Turing is seeking an experienced software engineer at tech-lead level for a remote contractor role to advance LLM evaluation and synthetic SWE tasks built from public repositories. You\'ll own hands-on engineering work, automation, triaging issues, and assessing test coverage.

You will analyze GitHub issues, set up repositories with Docker, run tests locally, and collaborate with researchers to select challenging repositories for LLMs. Opportunities to lead a small team of juniors.