Remote AI Code Quality Engineer

Aston Carter

United States

Remote

USD 45,000 - 60,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aston Carter seeks a detail-oriented Software Engineering Evaluator to assess AI-generated software development work and improve code quality. You will design realistic coding tasks, evaluate AI responses for correctness and maintainability, and provide structured feedback to help achieve production-ready outcomes.

The role focuses on applying engineering judgment, reviewing diverse codebases, and collaborating with engineers to refine evaluation methodologies and quality standards across

Qualifications

  • Experience developing, testing, and maintaining software applications or systems.
  • Proficiency in at least one modern programming language such as Python, JavaScript/TypeScript, Java, Go, C++, C#, Ruby, PHP, Swift, Kotlin, Rust.
  • Strong understanding of software engineering principles, debugging techniques, testing methodologies, and version control systems.
  • Ability to quickly understand unfamiliar codebases and evaluate implementation quality.
  • Experience using tools such as Git, testing frameworks, command-line interfaces, and debugging tools.
  • Professional-level English proficiency.

Responsibilities

  • Create realistic software engineering tasks based on real-world development workflows, including technical requirements, supporting documentation, test cases, and code repositories.
  • Evaluate AI-generated code solutions against professional engineering standards for correctness, maintainability, performance, and reliability.
  • Compare outputs from different AI systems using identical requirements and environments, documenting relative strengths and areas for improvement.
  • Develop test plans, evaluation rubrics, and success criteria that clearly define expected functionality, coding standards, and edge-case handling.
  • Review code changes, implementation decisions, automated tests, and design approaches to verify technical quality and adherence to requirements.
  • Identify and document issues such as missed edge cases, incorrect or incomplete implementations, fragile code changes, ineffective testing strategies, and misinterpretation of requirements.

Skills

Python
JavaScript
TypeScript
Java
Go
C++
C#
Ruby
PHP
Swift
Kotlin
Rust

Education

Bachelor's degree in CS or related field

Tools

Git
Testing frameworks
Command-line interfaces
Debugging tools

Job description

Aston Carter seeks a detail-oriented Software Engineering Evaluator to assess AI-generated software development work and improve code quality. You will design realistic coding tasks, evaluate AI responses for correctness and maintainability, and provide structured feedback to help achieve production-ready outcomes.

The role focuses on applying engineering judgment, reviewing diverse codebases, and collaborating with engineers to refine evaluation methodologies and quality standards across

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Code Quality Engineer
Remote AI Code Quality Engineer

Aston Carter • Tampa (FL)

Remote
USD 45,000 - 60,000
Remote AI Code Auditor & Quality Engineer
Remote AI Code Auditor & Quality Engineer

Aston Carter • Dallas (TX)

Remote
USD 45,000 - 60,000
Remote AI Design Quality Specialist
Remote AI Design Quality Specialist

Aston Carter • United States

Remote
USD 45,000 - 60,000
Remote AI Code Evaluator & DevOps Engineer
Remote AI Code Evaluator & DevOps Engineer

Turing • United States

Remote
USD 11,000 - 22,000
Fully remote
Freelance contractor role
Remote AI Coding Evaluator – Software Quality
Remote AI Coding Evaluator – Software Quality

Turing • United States

Remote
USD 3,300 - 5,000
Fully remote
Cutting-edge AI projects
Remote AI Design Evaluator & Visual Quality Lead
Remote AI Design Evaluator & Visual Quality Lead

Aston Carter • Miami (FL)

Remote
USD 45,000 - 60,000
Remote AI Design Critique Lead — UI/UX Quality Evaluator
Remote AI Design Critique Lead — UI/UX Quality Evaluator

Aston Carter • Boston (MA)

Remote
USD 45,000 - 60,000
Remote AI Design Quality Evaluator
Remote AI Design Quality Evaluator

Aston Carter • Atlanta (GA)

Remote
USD 45,000 - 60,000
Remote AI Code Evaluator - Junior Software Engineer
Remote AI Code Evaluator - Junior Software Engineer

Our Client • United States

Remote
USD 207,000 - 276,000
Remote contract
Competitive hourly rate
Collaborate with AI researchers
Remote AI Coding Evaluator — Software Engineering QA
Remote AI Coding Evaluator — Software Engineering QA

agency • United States

Remote
USD 11,000 - 90,000
Remote contract work