Training Specialist

HumanSignal Services (formerly Erud AI); San Francisco (CA); On-site; USD 60,000 - 125,000; Full time

Job summary

HumanSignal Services (formerly Erud AI) is seeking a skilled individual contributor in San Francisco, CA, for a role focused on designing and delivering training materials for AI data-labeling programs. The selected candidate will manage complex data programs, ensuring timely and high-quality data delivery.

The ideal candidate has over 3 years of experience in instructional design and technical content development. Compensation ranges from $60,000 to $125,000, reflecting the critical nature of this operational role.

Qualifications

• 3+ years in instructional design, training, or technical content creation.
• Proven ability to simplify complex concepts for non-expert audiences.
• Strong written communication and structured thinking.

Responsibilities

• Design and deliver project-specific training collateral within tight timelines.
• Develop training materials translating complex requirements into clear instructions.
• Analyze learner performance data to identify training gaps.
• Train operations staff on instructional design principles and feedback techniques.
• Build reusable content templates for consistency across projects.
• Track training effectiveness via quality metrics and iterate quickly.

Skills

Instructional design

Training development

Strong written communication

Data-driven analysis

Education

STEM degree or technical fluency

Tools

LMS platforms

Annotation tooling

Job description

About HumanSignal

Real‑world data is the competitive edge in AI. HumanSignal is a human data partner for companies building AI models and products. Our customers ship better AI, faster, because we partner with their researchers from real‑world data creation to annotation to delivery. We design and create datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform, Label Studio, the open‑source standard for data labeling and evaluation, used by over 1 million practitioners worldwide. We specialize in the operationally complex: real‑world data collection, multimodal pipelines, and multistep workflows. Advanced ML and AI teams use our enterprise platform to run their own data factories, and our services team to extend their reach where in‑house capacity runs out.

Role Overview

HumanSignal specializes in operationally complex, multimodal data collection and annotation — delivering the datasets that frontier AI research requires and remote workforce marketplaces can't. This role sits at the operational core of that delivery engine — responsible for ensuring our clients get the highest‑quality data on time, every time. You will own complex, high‑stakes data programs end‑to‑end, managing expert workforces, navigating shifting customer requirements, and holding quality and delivery timelines simultaneously. There is no playbook handed to you. You will build it, break it, and rebuild it better.

What You’ll Do

• Design and deliver project‑specific training collateral within tight timelines (often 24–48 hours) for new AI data‑labeling programs.
• Develop training materials — written guides, annotated examples, rubrics, and assessments — that translate complex technical task requirements into clear contributor instructions.
• Analyze learner performance data, error patterns, and quality issues to identify training gaps and design targeted interventions.
• Train and coach operations staff (SPLs, Ops Associates) on instructional design principles, feedback techniques, and quality assessment methods.
• Build reusable content templates, frameworks, and self‑serve resources to maintain training consistency across projects and customers.
• Continuously track training effectiveness via quality metrics, completion rates, and satisfaction scores — and iterate quickly.
• Collaborate with Product and Engineering to surface tooling improvements that support contributor learning at scale.

Required Qualifications

• 3+ years in instructional design, training, or technical content creation.
• Proven ability to simplify complex concepts for non‑expert audiences.
• Experience developing training materials under tight timelines.
• Strong written communication and structured thinking.
• Data‑driven: comfortable analyzing performance metrics to improve programs.

Preferred Qualifications

• AI/ML background or strong understanding of AI training methodologies (SFT, RLHF, model evaluation).
• STEM degree or technical fluency (CS, Data Science, or related field).
• Experience with LMS platforms or annotation tooling (Scale, Labelbox, Prodigy, etc.).
• Background in customer success enablement, sales enablement, or technical consulting.

Additional Information

Level: Individual Contributor
Compensation: $60,000 – $125,000
Location: San Francisco, CA