Senior Software Engineer, AI Code Quality & Evaluation

Braintrust; Turkey; Remote; TRY 3,464,000 - 5,443,000; Full time

Job summary

Braintrust is seeking a senior software engineering professional to review AI-generated code, diagnose bugs and architectural weaknesses, and develop reference solutions for AI training. You will evaluate fixes, features, and configurations while ensuring clear communication of technical issues and recommendations.

The role requires deep debugging skills, experience with multiple languages, and a strong foundation in clean code and system design.

Qualifications

• 7+ years of professional software engineering experience building, maintaining, debugging and reviewing production software.
• Strong proficiency in at least one programming language such as Python, JavaScript/TypeScript, Java, C++, Go, C#, Ruby, PHP or Rust.
• Strong knowledge of clean code, modular architecture, abstraction, error handling and software design.
• Experience identifying functional, performance, security and design issues, with strong debugging and root-cause analysis.
• Familiarity with Git, collaborative code reviews and modern engineering practices.
• Strong knowledge of data structures, algorithms, APIs, databases and application architecture.
• Strong written English and clear technical communication.

Responsibilities

• Review AI-generated code for correctness, reliability, security, performance, scalability and maintainability.
• Diagnose bugs, incomplete implementations, edge cases and architectural weaknesses in unfamiliar codebases.
• Evaluate fixes, features, refactoring, APIs, configurations and database changes, comparing alternative solutions.
• Improve implementations and explain technical issues and recommendations clearly.
• Develop evaluation criteria, annotations and rubrics, collaborating with researchers on coding benchmarks.

Skills

7+ years software engineering

Programming languages

Debugging and root-cause analysis

APIs, data structures, databases

Tools

Python

JavaScript/TypeScript

Java

C++

Go

C#

Ruby

PHP

Rust

Job description

Braintrust is seeking a senior software engineering professional to review AI-generated code, diagnose bugs and architectural weaknesses, and develop reference solutions for AI training. You will evaluate fixes, features, and configurations while ensuring clear communication of technical issues and recommendations.

The role requires deep debugging skills, experience with multiple languages, and a strong foundation in clean code and system design.