Senior Software Engineer - AI Code Quality & Evaluation

Braintrust; United States; Remote; USD 26,000 - 37,000; Full time

Job summary

Braintrust is seeking a Senior Software Engineer - AI Code Quality to review AI-generated code for correctness, reliability, security, performance, scalability, and maintainability. You will diagnose bugs, edge cases, and architectural weaknesses, evaluate fixes and APIs, and develop clear reference solutions for AI training.

Availability 40 hours/week with Pacific Time overlap; three-month project; include LinkedIn URL.

Qualifications

• 7+ years of professional software engineering experience building, maintaining, debugging and reviewing production software.
• Strong proficiency in at least one programming language such as Python, JavaScript/TypeScript, Java, C++, Go, C#, Ruby, PHP or Rust.
• Strong knowledge of clean code, modular architecture, abstraction, error handling and software design.
• Experience identifying functional, performance, security and design issues, with strong debugging and root-cause analysis.
• Familiarity with Git, collaborative code reviews and modern engineering practices.
• Strong knowledge of data structures, algorithms, APIs, databases and application architecture.
• Strong written English and clear technical communication.

Responsibilities

• Review AI-generated code for correctness, reliability, security, performance, scalability and maintainability.
• Diagnose bugs, incomplete implementations, edge cases and architectural weaknesses in unfamiliar codebases.
• Evaluate fixes, features, refactoring, APIs, configurations and database changes, comparing alternative solutions.
• Improve implementations and explain technical issues and recommendations clearly.
• Develop evaluation criteria, annotations and rubrics, collaborating with researchers on coding benchmarks.

Skills

Software Eng

Python

JavaScript/TypeScript

Java

C++

Go

C#

Ruby

Rust

Clean Code

Debugging

Code Review

Git

Job description

Braintrust is seeking a Senior Software Engineer - AI Code Quality to review AI-generated code for correctness, reliability, security, performance, scalability, and maintainability. You will diagnose bugs, edge cases, and architectural weaknesses, evaluate fixes and APIs, and develop clear reference solutions for AI training.

Availability 40 hours/week with Pacific Time overlap; three-month project; include LinkedIn URL.