C++ Software Engineer - AI Data & Code Evaluation Contract

turing; United States; Remote; USD 55,000 - 110,000; Part time

Job summary

Turing in San Francisco, CA, seeks a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples and provide precise solutions primarily in C/C++, with Python, JavaScript (ReactJS), Java, Rust, and Go, evaluating AI-generated code for efficiency and scalability.

You'll collaborate with researchers and cross-functional teams to build verification mechanisms and develop agents that verify code quality and

Qualifications

• 3+ years of software engineering experience.
• Experience building full-stack applications and deploying production-grade software.
• Strong understanding of software architecture, design, development, debugging, and code quality.
• Excellent written and verbal communication for clear evaluation rationales.

Responsibilities

• Curate code examples and provide precise solutions in multiple languages.
• Evaluate and refine AI-generated code for efficiency and scalability.
• Collaborate with researchers to enhance AI-driven coding solutions.
• Build agents to verify code quality and identify error patterns.
• Hypothesize software engineering steps and evaluate model capabilities.
• Design verification mechanisms that automatically verify solutions.

Skills

Software engineering

Full-stack development

Code quality/review

Communication skills

Job description

Turing in San Francisco, CA, seeks a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples and provide precise solutions primarily in C/C++, with Python, JavaScript (ReactJS), Java, Rust, and Go, evaluating AI-generated code for efficiency and scalability.

You'll collaborate with researchers and cross-functional teams to build verification mechanisms and develop agents that verify code quality and