Data Science & Analytic Methodology SME

micro1; United States; Remote; USD 83,000 - 165,000; Part time

Job summary

micro1 is seeking a Data Science & Analytic Methodology SME for a remote contracting engagement focused on advanced analytic pipelines and large language models (LLMs). You will contribute expertise to a high-impact project and help shape how models learn, reason, and perform through real-world input.

No prior AI project experience is required beyond strong domain knowledge; you will map, evaluate, and document methodology patterns, while providing clear feedback to guide ongoing improvement and

Qualifications

• Experience integrating LLMs into complex data pipelines.
• Experience with evaluation metrics for AI systems.
• Ability to communicate in clear written English.

Responsibilities

• Map scaled-analysis and pipeline-integration scenarios to an established taxonomy across key evaluation areas.
• Author detailed analytic cases reflecting authentic deployment patterns, including automated triage, enrichment, and analysis-at-scale.
• Evaluate and grade responses based on source handling, reasoning, limitations, and practical utility.
• Identify and flag instances of model over-refusal that could hinder analytic workflows.
• Document challenging edge cases, emerging methodology concerns, and provide actionable recommendations for improvement.
• Provide clear, insightful written and verbal feedback to support iterative project outcomes.

Skills

Mentoring

Technical leadership

Written English

Data science

Job description

Role Title: Data Science & Analytic Methodology SME

Role Type: Contractor

Location: Remote

micro1 is engaging Data Science & Analytic Methodology SMEs to contribute expertise to a customer's high-impact project focused on advanced analytic pipelines and large language models (LLMs).

In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.

No prior experience in AI is required - your domain knowledge is what matters.

Scope of Work

• Map scaled-analysis and pipeline-integration scenarios to an established taxonomy across key evaluation areas.
• Author detailed analytic cases that reflect authentic deployment patterns, including automated triage, enrichment, and analysis-at-scale, as well as representative failure modes in real-world settings.
• Evaluate and grade responses based on criteria such as source handling, reasoning, understanding of limitations, and practical utility.
• Identify and flag instances of model over-refusal that could hinder legitimate analytic workflows or disrupt pipeline continuity.
• Document challenging edge cases, emerging methodology concerns, and provide actionable recommendations for continuous improvement.
• Contribute clear, insightful written and verbal feedback that supports iterative, high-quality project outcomes.

Preferred Qualifications

• Demonstrated experience integrating LLMs-such as government GPT variants-into complex data or analytic pipelines.
• Proven capability in conducting analysis at scale, with an understanding of automation failure modes and relevant evaluation metrics.
• Track record of teaching, mentoring, or technical leadership in data science or related analytic disciplines.
• Expertise in authoring clear, concise technical documentation and conveying complex concepts through strong written English.
• Exposure to the design of evaluation frameworks or benchmark systems.
• Familiarity with defense, intelligence, or government analytic domains is highly valued.
• Ability to operate effectively in distributed, international project environments with minimal clearance constraints.

Originally posted on Himalayas