AI Code Evaluator & Data Curation Engineer

Turing; Austin (TX); On-site; USD 69,000 - 117,000; Part time

Job summary

Turing, based in San Francisco, is seeking a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models, collaborating closely with researchers.

You will curate code examples, provide precise solutions, and make corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability.

Qualifications

• 3+ years of software engineering experience.
• Strong expertise in building full-stack applications and deploying scalable, production-grade software using modern languages and tools.
• Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
• Excellent oral and written communication skills for clear, structured evaluation rationales.

Responsibilities

• Curate code examples and solutions across Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with cross-functional teams to improve enterprise AI-driven coding solutions.
• Build verification agents to assess code quality and detect error patterns.
• Hypothesize software engineering process steps and evaluate model capabilities on them.
• Design automated verification mechanisms for software engineering tasks.

Skills

Full-stack development

Software architecture

Code quality

Communication skills

Tools

Git

Docker

CI/CD

ReactJS

Job description

Turing, based in San Francisco, is seeking a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models, collaborating closely with researchers.

You will curate code examples, provide precise solutions, and make corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability.