Remote LLM Analytics Methodology SME (Contract)

confidential

United States

Remote

USD 83,000 - 165,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Zekai is seeking a Data Science & Analytic Methodology SME to support a customer project focused on advanced analytic pipelines and large language models. This remote contractor role emphasizes training next-generation AI systems with high-quality real-world input.

You will map analyses, author analytic cases, evaluate responses, and identify edge cases, providing actionable recommendations for continuous improvement. Prior AI domain experience not required; domain knowledge matters.

Qualifications

  • Experience integrating LLMs into data or analytic pipelines.
  • Experience with automated analysis and evaluation metrics.
  • Track record in teaching, mentoring, or technical leadership in data science.
  • Strong written English for technical documentation.
  • Exposure to design of evaluation frameworks or benchmark systems.
  • Familiarity with defense, intelligence, or government analytic domains is highly valued.
  • Ability to operate effectively in distributed, international project environments with minimal clearance constraints.

Responsibilities

  • Map scaled-analysis and pipeline-integration scenarios to an established taxonomy across key evaluation areas.
  • Author detailed analytic cases reflecting authentic deployment patterns, including automated triage and analysis-at-scale.
  • Evaluate and grade responses based on criteria such as source handling, reasoning, and practical utility.
  • Identify and flag instances of model over-refusal that could hinder analytic workflows or disrupt pipeline continuity.
  • Document challenging edge cases and provide actionable recommendations for continuous improvement.
  • Contribute clear, insightful written and verbal feedback to support iterative project outcomes.

Skills

LLM integration
Analysis at scale
Technical leadership
Written English
Evaluation frameworks
Defense/government domain
Distributed teams

Job description

Zekai is seeking a Data Science & Analytic Methodology SME to support a customer project focused on advanced analytic pipelines and large language models. This remote contractor role emphasizes training next-generation AI systems with high-quality real-world input.

You will map analyses, author analytic cases, evaluate responses, and identify edge cases, providing actionable recommendations for continuous improvement. Prior AI domain experience not required; domain knowledge matters.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Data Science & Analytics Methodology SME (LLMs)
Remote Data Science & Analytics Methodology SME (LLMs)

Micro1 • United States

Remote
USD 83,000 - 165,000
Data Science & Analytic Methodology SME
Data Science & Analytic Methodology SME

confidential • United States

Remote
USD 83,000 - 165,000
Remote Data Science & Analytic Methodology Expert
Remote Data Science & Analytic Methodology Expert

Remotebridge • United States

Remote
USD 83,000 - 138,000
Data Science & Analytic Methodology SME
Data Science & Analytic Methodology SME

Remotebridge • United States

Remote
USD 83,000 - 138,000
Data Science & Analytic Methodology SME
Data Science & Analytic Methodology SME

Micro1 • United States

Remote
USD 83,000 - 165,000
Remote Data Science & Analytics Methodology SME (Contract)
Remote Data Science & Analytics Methodology SME (Contract)

Crossing Hurdles • United States

Remote
USD 83,000 - 138,000
Data Scientist | Remote
Data Scientist | Remote

Crossing Hurdles • United States

Remote
USD 83,000 - 138,000
Remote Data Science Methodology Specialist (Contractor)
Remote Data Science Methodology Specialist (Contractor)

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 138,000
Remote Senior Data Analyst - AI QA & Data Privacy
Remote Senior Data Analyst - AI QA & Data Privacy

Confidential • United States

Remote
USD 96,000 - 152,000
Remote work
Remote English Linguistics Evaluator for AI Research
Remote English Linguistics Evaluator for AI Research

Confidential • United States

Remote
USD 55,000 - 96,000