Senior AI Data-Prep Platform Engineer (SageMaker)

Socket.dev; Seattle (WA); On-site; USD 168,000 - 227,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Parental leave

Job summary

Amazon Web Services (AWS) in Seattle is seeking a Senior Software Development Engineer to help build next-generation data preparation and evaluation systems for ML pipelines. You will work at the intersection of AI research and production infrastructure, delivering scalable, secure software that combines auto-labeling, human-in-the-loop workflows, and LLM-as-Judge techniques.

You’ll mentor engineers, shape design reviews, and own architectural decisions across distributed data processing and ML

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming with at least one software programming language experience.
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• Experience as a mentor, tech lead or leading an engineering team.

Responsibilities

• Data Preparation Platform: Design and deliver core components of data preparation journey to customize and fine-tune LLMs in SageMaker, designing systems that provide customers with high‑quality, reliable data for their ML workflows.
• Drive Innovation in Data Preparation: Build and scale systems leveraging auto‑labeling and LLM-as-Judge techniques to automatically detect, diagnose, and remediate data quality issues.
• Agent & Model Quality: Establish quality standards and evaluation frameworks for AI agents and models, implementing continuous improvement processes.
• Human-in-the-Loop Services: Lead the evolution of our HITL suite, enabling seamless human feedback loops for data labeling, annotation quality assurance, and ground truth generation.
• Technical Leadership: Mentor engineers, drive design reviews, and raise the engineering quality bar across the team. Influence technical direction without formal authority.
• Architecture & Strategy: Make high-judgment architectural decisions across distributed systems, data processing, and ML infrastructure. Own the technical roadmap for your area.

Skills

Software development

Leadership

Architecture design

Mentoring

Education

Bachelor's degree in computer science

Tools

LLMs

ML pipelines

Job description

Amazon Web Services (AWS) in Seattle is seeking a Senior Software Development Engineer to help build next-generation data preparation and evaluation systems for ML pipelines. You will work at the intersection of AI research and production infrastructure, delivering scalable, secure software that combines auto-labeling, human-in-the-loop workflows, and LLM-as-Judge techniques.

You’ll mentor engineers, shape design reviews, and own architectural decisions across distributed data processing and ML