AI Software Evaluation Engineer (Contract)

Turing Enterprises, Inc.; Boston (MA); Remote; USD 69.000 - 124.000; Teilzeit

Zusammenfassung

Turing Enterprises, Inc. is seeking a Software Engineering evaluator to help create cutting-edge datasets for training and benchmarking large language models.

You will curate code examples and provide precise solutions across Python, JavaScript/ReactJS, C/C++, Java, Rust, and Go, while evaluating AI-generated code for quality and reliability. You will collaborate with researchers and cross-functional teams, design verification mechanisms, and build agents to verify code quality.

Qualifikationen

• 3+ years of software engineering experience.
• Strong expertise in full-stack application development and deployment.
• Deep understanding of software architecture, design, debugging and code quality.
• Excellent oral and written communication for clear evaluation rationales.

Aufgaben

• Curate code examples and build solutions in Python, JavaScript (ReactJS), C/C++, Java, Rust and Go.
• Evaluate AI-generated code for efficiency, scalability and reliability.
• Collaborate with cross-functional teams to improve AI-driven coding solutions.
• Build agents that verify code quality and identify error patterns.
• Hypothesize software engineering steps and evaluate model capabilities.
• Design verification mechanisms to auto-verify solutions.

Kenntnisse

Software engineering

Full-stack development

System architecture

Code quality

Communication

Jobbeschreibung

Turing Enterprises, Inc. is seeking a Software Engineering evaluator to help create cutting-edge datasets for training and benchmarking large language models.

You will curate code examples and provide precise solutions across Python, JavaScript/ReactJS, C/C++, Java, Rust, and Go, while evaluating AI-generated code for quality and reliability. You will collaborate with researchers and cross-functional teams, design verification mechanisms, and build agents to verify code quality.