AI Data & Code Engineer — Contract, Remote

HumanitApp; United States; Remote; USD 83,000 - 165,000; Part time

Job summary

Turing is seeking a Software Engineering Evaluator based in the United States to create and curate datasets for training and benchmarking large language models. You will work with researchers to build code examples, provide precise solutions, and correct defects in production-grade software.

You should have 3+ years of software engineering experience, strong Python skills, and experience delivering full-stack, scalable systems.

Qualifications

• 3+ years of software engineering experience.
• Strong expertise in Python with production-grade software.
• Experience building full-stack applications and deploying scalable software.
• Deep understanding of software architecture, design, debugging, and code quality/review assessment.
• Excellent oral and written communication skills for clear, structured evaluation rationales.
• Commitment: flexible engagement, 10–40 hrs/week.
• Type: Contractor (no medical/paid leave)
• Duration: 1 month (potential extensions)
• Location: United States-based candidates only.

Responsibilities

• As a Software Engineering evaluator, you will create datasets for training, benchmarking, and advancing large language models.
• Build agents and automated verification tools in Python to verify code quality and identify error patterns.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with researchers and cross-functional teams on AI-driven coding solutions against performance benchmarks.
• Hypothesize steps in the software engineering cycle and evaluate model capabilities on them.
• Design verification mechanisms that auto-verify solutions to software tasks.

Skills

Python

Full-stack

Software architecture

Code quality

Communication

Contract work

Tools

Python frameworks

CI/CD tools

Job description

Turing is seeking a Software Engineering Evaluator based in the United States to create and curate datasets for training and benchmarking large language models. You will work with researchers to build code examples, provide precise solutions, and correct defects in production-grade software.

You should have 3+ years of software engineering experience, strong Python skills, and experience delivering full-stack, scalable systems.