Remote AI Software Engineer - Code & Model Evaluator

Turing; New York (NY); Remote; USD 55,104 - 110,208; Full time

Job summary

Turing is seeking a Software Engineering Evaluator to create cutting‑edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.

This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross‑functional teams to enhance

Qualifications

• 3+ years of software engineering experience.
• Strong expertise in building full‑stack applications and deploying scalable, production‑grade software using modern languages and tools.
• Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
• Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

• Curate code examples across Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go for AI model training.
• Evaluate and refine AI-generated code to ensure it is efficient, scalable, and reliable.
• Collaborate with cross‑functional teams to enhance AI‑driven coding solutions against industry performance benchmarks.
• Build agents that verify code quality and identify error patterns.
• Hypothesize on steps in the software engineering cycle and evaluate model capabilities on them.
• Design verification mechanisms that automatically verify solutions to software tasks.

Skills

Software engineering

Full-stack

Architecture

Communication

Job description

Turing is seeking a Software Engineering Evaluator to create cutting‑edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.

This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross‑functional teams to enhance