Remote AI-Focused Full-Stack Engineer (Contract)

HumanitApp; San Francisco (CA); Remote; USD 55,000 - 124,000; Part time

Job summary

Turing, based in San Francisco, is seeking a Software Engineering Evaluator contractor to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and correct across the full stack.

Daily work includes evaluating AI-generated code across backend and frontend, collaborating with researchers, and building verification mechanisms to assess software engineering tasks.

Qualifications

• 3+ years of software engineering experience.
• Experience deploying scalable, production-grade software.
• Deep understanding of software architecture, design, development, debugging and code quality.
• Excellent oral and written communication skills for clear evaluation rationales.

Responsibilities

• Evaluate AI-generated code across backend and frontend contexts for efficiency and scalability.
• Collaborate with researchers to improve AI-driven coding solutions against benchmarks.
• Build verification mechanisms to automatically assess solutions and identify error patterns.

Skills

Software engineering

Production-grade systems

Code quality & review

Strong communication

Job description

Turing, based in San Francisco, is seeking a Software Engineering Evaluator contractor to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples, provide precise solutions, and correct across the full stack.

Daily work includes evaluating AI-generated code across backend and frontend, collaborating with researchers, and building verification mechanisms to assess software engineering tasks.