Senior Software Engineer - Remote LLM Eval

Turing

United States

Remote

USD 41,000 - 83,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote

Job summary

Turing is seeking a Senior Software Engineer for LLM Evaluation & Repository Validation. You will work remotely on high-impact AI software projects, primarily focusing on evaluating code interactions with LLMs, automating environments, and triaging issues across open-source repositories.

Responsibilities include setting up repositories, assessing test coverage, and collaborating with researchers. The role offers contractor status with flexible hours across multiple regions.

Qualifications

  • Minimum 3+ years of overall experience.
  • Strong experience with Rust.
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfortable running, modifying, and testing real-world projects locally.
  • Experience contributing to or evaluating open-source projects is a plus.

Responsibilities

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and environment setup.
  • Evaluate unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborate with researchers to design and identify repositories and issues challenging for LLMs.
  • Opportunity to lead a team of junior engineers on projects.

Skills

Rust
Git

Tools

Docker
CI/CD

Job description

Turing is seeking a Senior Software Engineer for LLM Evaluation & Repository Validation. You will work remotely on high-impact AI software projects, primarily focusing on evaluating code interactions with LLMs, automating environments, and triaging issues across open-source repositories.

Responsibilities include setting up repositories, assessing test coverage, and collaborating with researchers. The role offers contractor status with flexible hours across multiple regions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior Ruby Engineer — LLM Evaluation & Validation
Remote Senior Ruby Engineer — LLM Evaluation & Validation

Turing • United States

Remote
USD 83,000 - 124,000
Fully remote environment
Cutting-edge AI projects
Senior Software Engineer: LLM Evaluation & Repo Validation
Senior Software Engineer: LLM Evaluation & Repo Validation

Turing • United States

Remote
USD 55,000 - 83,000
Fully remote
Cutting-edge AI projects
Senior Software Engineer - LLM Code Evaluation (Remote)
Senior Software Engineer - LLM Code Evaluation (Remote)

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 110,000
LLM Evaluation Engineer — Contractor (10–40h/wk)
LLM Evaluation Engineer — Contractor (10–40h/wk)

Turing Enterprises, Inc. • San Francisco (CA)

Remote
USD 83,000 - 124,000
Senior Software Engineer – LLM Evaluation & Repository Validation
Senior Software Engineer – LLM Evaluation & Repository Validation

Turing • United States

Remote
USD 55,000 - 83,000
Fully remote
Cutting-edge AI projects
Senior Go Engineer for LLM Evaluation & Repo Validation
Senior Go Engineer for LLM Evaluation & Repo Validation

Turing • United States

Remote
USD 83,000 - 138,000
Fully remote
Cutting-edge AI projects
Senior Software Engineer, LLM Code Evaluation (Remote, Part-Time)
Senior Software Engineer, LLM Code Evaluation (Remote, Part-Time)

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
LLM Code Evaluation Engineer - Part-Time, Remote
LLM Code Evaluation Engineer - Part-Time, Remote

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
Remote work
Flexible schedule
Remote Senior Software Engineer, LLM Evaluation & QA Tools
Remote Senior Software Engineer, LLM Evaluation & QA Tools

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 124,000
Senior Software Engineer – Ruby (LLM Evaluation & Repository Validation)
Senior Software Engineer – Ruby (LLM Evaluation & Repository Validation)

Turing • United States

Remote
USD 83,000 - 124,000
Fully remote environment
Cutting-edge AI projects