Remote AI Prompt Engineer – LLM Testing

AI Work Expert; San Francisco (CA); Hybrid; USD 55,000 - 83,000; Full time

Job summary

Based in San Francisco, Turing is a leading research accelerator for frontier AI labs. The Tooling Engineer will create complex, domain-specific prompts to test LLM capabilities and evaluate AI-generated responses for factual accuracy, reasoning, and relevance.

You will identify errors, design challenging test cases, and provide clear, evidence-based feedback to improve model performance. This full-time remote role offers independent contractor engagement through Turing with pay by the hour.

Qualifications

• Master’s degree or higher in a relevant field.
• At least three years of professional, research, or teaching experience.
• Excellent written English communication skills.
• Strong analytical and critical-thinking abilities.
• Exceptional attention to detail.
• Experience working with LLMs or Generative AI.
• Familiarity with prompt engineering, AI evaluation, or model testing.

Responsibilities

• Create complex, domain-specific prompts to test LLM capabilities.
• Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.
• Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.
• Develop challenging test cases and edge cases that expose model limitations.
• Provide clear, detailed, and evidence-based feedback to improve model performance.

Skills

Business Analysis

Excellent written English

Strong analytical thinking

Attention to detail

Experience with LLMs/Generative AI

Prompt engineering familiarity

Education

Master’s degree or higher in a relevant field

Job description

Based in San Francisco, Turing is a leading research accelerator for frontier AI labs. The Tooling Engineer will create complex, domain-specific prompts to test LLM capabilities and evaluate AI-generated responses for factual accuracy, reasoning, and relevance.

You will identify errors, design challenging test cases, and provide clear, evidence-based feedback to improve model performance. This full-time remote role offers independent contractor engagement through Turing with pay by the hour.