Remote Python AI Engineer - Data & Model Evaluation

turing; San Francisco (CA); Remote; USD 83,000 - 138,000; Part time

Job summary

Turing, based in San Francisco, seeks a Software Engineering evaluator to curate coding datasets and assess AI-generated code across Python and other languages. You will work with researchers to improve benchmarks and production-grade pipelines while focusing on scalability, reliability, and maintainability.

The role emphasizes collaboration with cross-functional teams and clear technical rationales, with a flexible contractor engagement and 10–40 hours per week.

Qualifications

• Several years of software engineering experience (3+ years).
• Strong Python expertise with production-grade software practices.
• Experience building full-stack applications and deploying scalable software.
• Deep understanding of architecture, design, debugging, and code quality.
• Excellent written and spoken communication for clear evaluation rationales.

Responsibilities

• Curate and evaluate Python-based code examples and solutions for AI model training.
• Collaborate with researchers to develop datasets and evaluation benchmarks.
• Assess AI-generated code for efficiency, scalability, and reliability.
• Build verification tools and automation to validate software tasks.
• Contribute to cross-functional projects across engineering, ML, and data teams.
• Document evaluation rationales and findings clearly for stakeholders.

Skills

Python

Full-stack

Software architecture

Code quality

Communication

Job description

Turing, based in San Francisco, seeks a Software Engineering evaluator to curate coding datasets and assess AI-generated code across Python and other languages. You will work with researchers to improve benchmarks and production-grade pipelines while focusing on scalability, reliability, and maintainability.

The role emphasizes collaboration with cross-functional teams and clear technical rationales, with a flexible contractor engagement and 10–40 hours per week.