Tooling Engineer

AI Work Expert; San Francisco (CA); Hybrid; USD 55,000 - 83,000; Full time

Job summary

Based in San Francisco, Turing is a leading research accelerator for frontier AI labs. The Tooling Engineer will create complex, domain-specific prompts to test LLM capabilities and evaluate AI-generated responses for factual accuracy, reasoning, and relevance.

You will identify errors, design challenging test cases, and provide clear, evidence-based feedback to improve model performance. This full-time remote role offers independent contractor engagement through Turing with pay by the hour.

Qualifications

• Master’s degree or higher in a relevant field.
• At least three years of professional, research, or teaching experience.
• Excellent written English communication skills.
• Strong analytical and critical-thinking abilities.
• Exceptional attention to detail.
• Experience working with LLMs or Generative AI.
• Familiarity with prompt engineering, AI evaluation, or model testing.

Responsibilities

• Create complex, domain-specific prompts to test LLM capabilities.
• Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.
• Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.
• Develop challenging test cases and edge cases that expose model limitations.
• Provide clear, detailed, and evidence-based feedback to improve model performance.

Skills

Business Analysis

Excellent written English

Strong analytical thinking

Attention to detail

Experience with LLMs/Generative AI

Prompt engineering familiarity

Education

Master’s degree or higher in a relevant field

Job description

# Tooling Engineerper hourFull-time Remote Last verified 1 Nov 2026Listed on Turing turing.comApplyApplyReferral link. You pay nothing; we may earn a fee.Affiliate disclosureWork Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Turing. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →Apply within 30 days of clicking - Turing only credits applications inside its 30-day attribution window.## About the RoleBased in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.## What You'll Do* Create complex, domain-specific prompts to test LLM capabilities.* Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.* Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.* Develop challenging test cases and edge cases that expose model limitations.* Provide clear, detailed, and evidence-based feedback to improve model performance.## You're a Good Fit If You* Required skills: Business Analysis* Master’s degree or higher in a relevant field.* At least three years of professional, research, or teaching experience.* Excellent written English communication skills.* Strong analytical and critical-thinking abilities.* Exceptional attention to detail.* Experience working with LLMs or Generative AI.* Familiarity with prompt engineering, AI evaluation, or model testing.Get ready for TuringDesign a resume for Turing Prepare for the Turing interview## Role HighlightsPayPay not listedContractFull-timeLocationRemoteCategoryCodingPosted3 days agoJob IDTUR-114435## Pay & PayoutIndependent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.