Senior Code Quality Engineer – LLM Training · Turing Turing · Varies · remote · 2w ago Varies 2w ago

Benture; San Francisco (CA); Remote; USD 150,000 - 230,000; Full time

Job summary

Turing, a San Francisco–based company that accelerates AI research and helps enterprises deploy AI systems, is seeking a Senior Code Quality Engineer to support the training and evaluation of large language models. You will review AI-generated code and ensure it is correct, secure, scalable, and aligned with production engineering standards.

This role emphasizes code quality and engineering evaluation rather than traditional QA.

Qualifications

• 7+ years of professional software engineering experience.
• Proficiency in at least one language (Python/TypeScript/Java, etc.).
• Experience building and maintaining production-grade software.
• Strong understanding of software design principles and maintainability.
• Proven ability to identify issues in complex codebases.
• Strong debugging and problem-solving skills.
• Experience with code reviews and collaborative workflows.
• Familiarity with Git and modern engineering practices.
• Strong written English and ability to communicate technical feedback clearly.

Responsibilities

• Review and evaluate AI-generated code across languages and scenarios.
• Assess code for correctness, reliability, security, scalability, readability, and maintainability.
• Identify bugs, logical errors, incomplete implementations, edge-case failures, and architectural weaknesses.
• Analyze unfamiliar codebases and understand the impact of proposed changes.
• Review bug fixes, feature implementations, refactoring, API integrations, configuration changes, and database operations.
• Compare alternative implementations and determine which best satisfies the requirements.
• Rewrite or improve code to create high-quality reference solutions.
• Provide clear technical explanations for identified issues and recommended improvements.
• Develop evaluation criteria, technical annotations, and rubrics for code-quality assessment.
• Collaborate with researchers and engineering teams to design coding benchmarks and improve LLM evaluation methodologies.

Skills

Python

TypeScript

Java

Code reviews

Debugging

CI/CD

Tools

Git

CI/CD tooling

Job description

Senior Code Quality Engineer – LLM Training and Evaluation | Remote | Pay not disclosed

Turing, a San Francisco–based company that accelerates AI research and helps enterprises deploy AI systems, is hiring senior software engineers to support the training and evaluation of large language models. You will review, analyze, and improve AI-generated code, ensuring it is correct, secure, maintainable, scalable, and aligned with production engineering standards.

About the Role

This is a code quality and engineering evaluation role, not a traditional software testing or manual QA position. You will apply your software engineering judgment to assess implementation quality, identify root causes, and recommend or implement robust solutions. You will help improve AI coding capabilities by drawing on your real-world experience with production systems, code reviews, debugging, and software architecture.

What the Work Involves

• Review and evaluate AI-generated code across different programming languages and software engineering scenarios.
• Assess code for correctness, reliability, security, scalability, readability, and maintainability.
• Identify bugs, logical errors, incomplete implementations, edge-case failures, and architectural weaknesses.
• Analyze unfamiliar codebases and understand the impact of proposed changes.
• Review bug fixes, feature implementations, refactoring, API integrations, configuration changes, and database operations.
• Compare alternative implementations and determine which best satisfies the requirements.
• Rewrite or improve code to create high-quality reference solutions.
• Provide clear technical explanations for identified issues and recommended improvements.
• Develop evaluation criteria, technical annotations, and rubrics for code-quality assessment.
• Collaborate with researchers and engineering teams to design coding benchmarks and improve LLM evaluation methodologies.

Requirements

• 7+ years of professional software engineering experience.
• Strong proficiency in at least one programming language, such as Python, JavaScript/TypeScript, Java, C++, Go, C#, Ruby, PHP, or Rust.
• Significant experience building, maintaining, debugging, and reviewing production-grade software.
• Strong understanding of software design principles, clean code, modular architecture, abstraction, error handling, and maintainability.
• Proven ability to identify functional, performance, security, and design issues in complex codebases.
• Strong debugging, root-cause analysis, and problem-solving skills.
• Experience with code reviews and collaborative software development workflows.
• Familiarity with Git and modern engineering practices.
• Strong written English and the ability to communicate technical feedback clearly.
• Good understanding of data structures, algorithms, APIs, databases, and application architecture.

Interview Process

One round of interview (approximately 60 minutes, technical).

Pay and Schedule

The source listing does not state an hourly rate, schedule, or commitment details.