Human Data Architect — Design Scalable AI Data Pipelines

Surge AI; United States; Remote; USD 120,000 - 210,000; Full time

Job summary

Surge AI is seeking a Human Data Architect to design systems governing how human data is collected, structured, and delivered to train frontier AI models. You will shape task design, evaluation strategy, and data pipelines to ensure high-quality training signals for SFT, RLHF, and model evaluation.

You will collaborate with engineering and product teams to optimize data throughput while maintaining data integrity, with a strong emphasis on scalable, reliable collection processes.

Qualifications

• Experience designing human data collection at scale (e.g., cognitive science, HCI, crowdsourcing).
• Working familiarity with ML post-training paradigms (SFT, RL) and data-quality mapping to model outcomes.
• Strong ability to design across data pipelines, not just endpoints.
• Systems-level thinking about how task design affects training data.
• Excellent communication skills for explaining measurements to engineers and researchers.

Responsibilities

• Architect end-to-end data workflows from task design to delivery for SFT, RL, and model evaluation.
• Design collection structures and task frameworks translating client needs into scalable data generation processes.
• Build and monitor data quality frameworks to catch issues before client delivery.
• Collaborate with engineering and product teams to improve data pipelines and throughput without sacrificing quality.
• Translate data patterns and project structure into actionable insights for project design and product development.

Skills

Data pipelines

System design

Communication

ML post-training

Quality assurance

Job description

Surge AI is seeking a Human Data Architect to design systems governing how human data is collected, structured, and delivered to train frontier AI models. You will shape task design, evaluation strategy, and data pipelines to ensure high-quality training signals for SFT, RLHF, and model evaluation.

You will collaborate with engineering and product teams to optimize data throughput while maintaining data integrity, with a strong emphasis on scalable, reliable collection processes.