Remote AI Code Auditor & Quality Engineer

Aston Carter

Dallas (TX)

Remote

USD 45,000 - 60,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aston Carter is seeking a meticulous Software Engineering Evaluator to assess AI-generated code quality and reliability across real-world development scenarios. In this role, you will design tasks, evaluate AI outputs, and provide structured feedback to improve software quality.

This fully remote position offers a competitive salary range and the opportunity to influence AI-assisted development across diverse technologies.

Qualifications

  • Experience developing, testing, and maintaining software applications or systems.
  • Proficiency in at least one modern programming language such as Python, JavaScript/TypeScript, Java, Go, C++, C#, Ruby, PHP, Swift, Kotlin, or Rust.
  • Strong understanding of software engineering principles, debugging techniques, testing methodologies, and version control systems.
  • Ability to quickly understand unfamiliar codebases and evaluate implementation quality.
  • Experience using tools such as Git, testing frameworks, command-line interfaces, and debugging tools.

Responsibilities

  • Create realistic software engineering tasks based on real-world development workflows, including technical requirements, supporting documentation, test cases, and code repositories.
  • Evaluate AI-generated code solutions against professional engineering standards for correctness, maintainability, performance, and reliability.
  • Compare outputs from different AI systems using identical requirements and environments, documenting strengths and weaknesses.
  • Develop test plans, evaluation rubrics, and success criteria that clearly define expected functionality, coding standards, and edge-case handling.
  • Review code changes, implementation decisions, automated tests, and design approaches to verify technical quality and adherence to requirements.
  • Identify and document issues such as missed edge cases, incorrect or incomplete implementations, fragile code changes, and ineffective testing strategies.
  • Collaborate with engineers and reviewers to refine evaluation tasks, improve assessment methodologies, and maintain quality standards across projects.
  • Contribute technical expertise across a variety of technologies, platforms, and software development environments.

Skills

Software Development
Code Review
Quality Assurance
Test Design & Validation
Debugging & Troubleshooting
Git & Version Control
Software Architecture
Technical Documentation
Analytical Thinking
AI-Assisted Development
Backend, Frontend, and Full-Stack Dev
Problem Solving

Education

Bachelor's degree or equivalent in CS/SE/IS

Tools

Git
Testing Frameworks
Command-Line Interfaces
Debugging Tools

Job description

Aston Carter is seeking a meticulous Software Engineering Evaluator to assess AI-generated code quality and reliability across real-world development scenarios. In this role, you will design tasks, evaluate AI outputs, and provide structured feedback to improve software quality.

This fully remote position offers a competitive salary range and the opportunity to influence AI-assisted development across diverse technologies.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Code Quality Engineer
Remote AI Code Quality Engineer

Aston Carter • Tampa (FL)

Remote
USD 45,000 - 60,000
Remote AI Code Quality Engineer
Remote AI Code Quality Engineer

Aston Carter • United States

Remote
USD 45,000 - 60,000
Remote AI Design Quality Specialist
Remote AI Design Quality Specialist

Aston Carter • United States

Remote
USD 45,000 - 60,000
Remote AI Design Evaluator & Visual Quality Lead
Remote AI Design Evaluator & Visual Quality Lead

Aston Carter • Miami (FL)

Remote
USD 45,000 - 60,000
Remote AI Coding Evaluator – Software Quality
Remote AI Coding Evaluator – Software Quality

Turing • United States

Remote
USD 3,300 - 5,000
Fully remote
Cutting-edge AI projects
Remote AI Design Quality Evaluator
Remote AI Design Quality Evaluator

Aston Carter • Atlanta (GA)

Remote
USD 45,000 - 60,000
Remote AI Design Critique Lead — UI/UX Quality Evaluator
Remote AI Design Critique Lead — UI/UX Quality Evaluator

Aston Carter • Boston (MA)

Remote
USD 45,000 - 60,000
Remote AI Code Evaluator - Junior Software Engineer
Remote AI Code Evaluator - Junior Software Engineer

Our Client • United States

Remote
USD 207,000 - 276,000
Remote contract
Competitive hourly rate
Collaborate with AI researchers
Remote AI Code Evaluator & Prompt Engineer
Remote AI Code Evaluator & Prompt Engineer

Alignerr Corp. • Portland (OR)

Remote
USD 55,000 - 110,000
Fully Remote Work
Flexible Schedule
Freelance Autonomy
+2
Remote Healthcare Operations AI Evaluator
Remote Healthcare Operations AI Evaluator

Talentify • New York (NY)

Remote
USD 40,000 - 60,000