Senior AI Code Quality Engineer - 3-Month Project

Braintrust; Colombia; Remote; COP 120,000,000 - 180,000,000; Full time

Job summary

Braintrust is seeking a production software engineer to review AI-generated code, diagnose root causes and craft reference solutions for AI training. This is a software engineering and code-evaluation role, not manual testing.

You will review correctness, reliability, security, performance and maintainability across unfamiliar codebases, identify architectural weaknesses and propose improvements. Strong debugging, English communication and collaboration with researchers are essential.

Qualifications

• 7+ years of professional software engineering experience.
• Strong proficiency in at least one listed programming language and broad software design knowledge.
• Experience debugging, performance, security and design issues with strong root-cause analysis.

Responsibilities

• Review AI-generated code for correctness, reliability, security, performance, scalability and maintainability.
• Diagnose bugs, edge cases and architectural weaknesses in unfamiliar codebases.
• Evaluate fixes, features, refactoring, APIs and configurations across codebases.
• Improve implementations and clearly explain technical issues and recommendations.
• Develop evaluation criteria, annotations and rubrics with researchers on coding benchmarks.

Skills

Python

JavaScript/TypeScript

Java

C++

Go

C#

Ruby

PHP

Rust

Tools

Git

CI/CD

Job description

Braintrust is seeking a production software engineer to review AI-generated code, diagnose root causes and craft reference solutions for AI training. This is a software engineering and code-evaluation role, not manual testing.

You will review correctness, reliability, security, performance and maintainability across unfamiliar codebases, identify architectural weaknesses and propose improvements. Strong debugging, English communication and collaboration with researchers are essential.