Senior Software Engineer - AI Code Quality

Braintrust

Brasil

Remote

BRL 809,000 - 1,156,000

Full time

1 hour ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Braintrust is seeking a senior software engineer to apply production engineering judgment to AI-generated code. You will review implementations, diagnose bugs, and develop clear reference solutions for AI training, working across languages and architectures.

The role emphasizes maintainable design, security, and performance in production software. You will collaborate with researchers, craft evaluation rubrics, and communicate findings clearly in English.

Qualifications

  • 7+ years of professional software engineering experience building, maintaining, debugging and reviewing production software.
  • Strong proficiency in at least one programming language such as Python, JavaScript/TypeScript, Java, C++, Go, C#, Ruby, PHP or Rust.
  • Strong knowledge of clean code, modular architecture, abstraction, error handling and software design.
  • Experience identifying functional, performance, security and design issues, with strong debugging and root-cause analysis.
  • Familiarity with Git, collaborative code reviews and modern engineering practices.
  • Strong knowledge of data structures, algorithms, APIs, databases and application architecture.
  • Strong written English and clear technical communication.

Responsibilities

  • Review AI-generated code for correctness, reliability, security, performance, scalability and maintainability.
  • Diagnose bugs, incomplete implementations, edge cases and architectural weaknesses in unfamiliar codebases.
  • Evaluate fixes, features, refactoring, APIs, configurations and database changes, comparing alternative solutions.
  • Improve implementations and explain technical issues and recommendations clearly.
  • Develop evaluation criteria, annotations and rubrics, collaborating with researchers on coding benchmarks.

Skills

Software engineering
Python
JavaScript/TypeScript
C++
Go
C#
Rust

Tools

Git
Code reviews
CI/CD
Databases

Job description

Apply your production engineering judgment to improve AI-generated code. You will evaluate implementations, identify root causes and develop clear reference solutions for AI training. This is a software engineering and code-evaluation role, not a manual testing position.

What You Will Do
  • Review AI-generated code for correctness, reliability, security, performance, scalability and maintainability.
  • Diagnose bugs, incomplete implementations, edge cases and architectural weaknesses in unfamiliar codebases.
  • Evaluate fixes, features, refactoring, APIs, configurations and database changes, comparing alternative solutions.
  • Improve implementations and explain technical issues and recommendations clearly.
  • Develop evaluation criteria, annotations and rubrics, collaborating with researchers on coding benchmarks.
What You Will Bring
  • 7+ years of professional software engineering experience building, maintaining, debugging and reviewing production software.
  • Strong proficiency in at least one programming language such as Python, JavaScript/TypeScript, Java, C++, Go, C#, Ruby, PHP or Rust.
  • Strong knowledge of clean code, modular architecture, abstraction, error handling and software design.
  • Experience identifying functional, performance, security and design issues, with strong debugging and root-cause analysis.
  • Familiarity with Git, collaborative code reviews and modern engineering practices.
  • Strong knowledge of data structures, algorithms, APIs, databases and application architecture.
  • Strong written English and clear technical communication.
PROJECT DETAILS

Expected project length is three months. Availability of at least 40 hours per week, 8 hours per day and four hours of daily Pacific Time overlap is required. Selection includes an approximately 20-minute client AI interview and a 45-60-minute technical delivery interview. Include your LinkedIn profile URL in your required resume.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineering AI Trainer (Brazil)
Software Engineering AI Trainer (Brazil)

Anyone AI Inc. • Brazil

Remote
BRL 165,000 - 303,000
Senior Code Engineer | $30/hr Remote
Senior Code Engineer | $30/hr Remote

Crossing Hurdles • Brazil

On-site
BRL 120,000 - 180,000
Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Copy of Senior Python Developer (AI Evaluation & Benchmarking)

Liftedanupworkcompany • Brazil

Remote
BRL 637,000 - 796,000
Backend Developer (Brazil)
Backend Developer (Brazil)

Anyone AI Inc. • Brazil

Remote
BRL 96,000 - 152,000
Backend Developer (Brazil)
Backend Developer (Brazil)

Anyone AI • São Paulo

Remote
BRL 83,000 - 165,000
Software Engineers
Software Engineers

Great Value Hiring • Brazil

On-site
BRL 247,000 - 352,000
Full-Stack Developer (Brazil)
Full-Stack Developer (Brazil)

Anyone AI Inc. • Brazil

Remote
BRL 124,000 - 207,000
Ai Engineer
Ai Engineer

Dry Ground AI • Brazil

Remote
BRL 660,000 - 991,000
Fully remote
Flexible schedule
High ownership
+2
Java Engineer
Java Engineer

SME Careers • Brazil

Remote
BRL 83,000 - 165,000
[Job-31573] AI Engineer Master
[Job-31573] AI Engineer Master

Ciandt • Brazil

On-site
BRL 180,000 - 320,000
Health and dental insurance
Meal and food allowance
Childcare assistance
+1