Remote AI Code Quality Engineer

Aston Carter

Tampa (FL)

Remote

USD 45,000 - 60,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aston Carter is seeking a Software Engineering Evaluator to assess AI-generated software development work and improve code quality. You will design realistic coding tasks, evaluate solutions, and provide structured feedback on correctness, performance, and maintainability.

You will collaborate with engineers and reviewers to refine tasks, develop evaluation rubrics, and ensure high-quality outcomes across projects. This role offers remote work options and fully contract opportunities.

Qualifications

  • Experience developing, testing, and maintaining software applications or systems.
  • Proficiency in multiple modern programming languages and debugging techniques.
  • Excellent written communication skills and professional-level English.

Responsibilities

  • Create realistic software engineering tasks with requirements, tests, and repos.
  • Evaluate AI-generated code against professional standards for correctness and maintainability.
  • Compare outputs from AI systems and document strengths/areas for improvement.
  • Develop test plans, rubrics, and success criteria for functionality and edge cases.
  • Review code changes and automated tests to verify quality and adherence to requirements.
  • Collaborate with engineers and reviewers to refine tasks and methodologies.

Skills

Software Development
Code Review
Quality Assurance
Test Design
Debugging
Git & Version Control
Software Architecture
Technical Documentation
Analytical Thinking
AI-Assisted Development
Full-Stack Development
Problem Solving
English Proficiency

Education

Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related discipline

Job description

Aston Carter is seeking a Software Engineering Evaluator to assess AI-generated software development work and improve code quality. You will design realistic coding tasks, evaluate solutions, and provide structured feedback on correctness, performance, and maintainability.

You will collaborate with engineers and reviewers to refine tasks, develop evaluation rubrics, and ensure high-quality outcomes across projects. This role offers remote work options and fully contract opportunities.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Code Quality Engineer
Remote AI Code Quality Engineer

Aston Carter • United States

Remote
USD 45,000 - 60,000
Remote AI Code Auditor & Quality Engineer
Remote AI Code Auditor & Quality Engineer

Aston Carter • Dallas (TX)

Remote
USD 45,000 - 60,000
Remote AI Design Quality Specialist
Remote AI Design Quality Specialist

Aston Carter • United States

Remote
USD 45,000 - 60,000
Remote AI Coding Evaluator – Software Quality
Remote AI Coding Evaluator – Software Quality

Turing • United States

Remote
USD 3,300 - 5,000
Fully remote
Cutting-edge AI projects
Remote AI Design Evaluator & Visual Quality Lead
Remote AI Design Evaluator & Visual Quality Lead

Aston Carter • Miami (FL)

Remote
USD 45,000 - 60,000
Remote AI Coding Evaluator — Software Engineering QA
Remote AI Coding Evaluator — Software Engineering QA

agency • United States

Remote
USD 11,000 - 90,000
Remote contract work
Remote AI Code Evaluator - Junior Software Engineer
Remote AI Code Evaluator - Junior Software Engineer

Our Client • United States

Remote
USD 207,000 - 276,000
Remote contract
Competitive hourly rate
Collaborate with AI researchers
Remote AI Design Critique Lead — UI/UX Quality Evaluator
Remote AI Design Critique Lead — UI/UX Quality Evaluator

Aston Carter • Boston (MA)

Remote
USD 45,000 - 60,000
Remote AI Design Quality Evaluator
Remote AI Design Quality Evaluator

Aston Carter • Atlanta (GA)

Remote
USD 45,000 - 60,000
Senior AI Coding Evaluation Engineer — Remote Contract
Senior AI Coding Evaluation Engineer — Remote Contract

G2i • United States

Remote
USD 138,000 - 276,000