Senior AI Data Prep & ML Infra Engineer

Amazon Web Services (AWS); Seattle (WA); On-site; USD 168,000 - 227,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Development Center U.S., Inc. in Seattle, WA, is seeking a seasoned software leader to build and scale data preparation platforms within SageMaker.

You will help customize and fine-tune LLMs, implement auto-labeling, and drive data quality improvements across ML workflows. You will mentor engineers, lead architecture discussions, and steer cross-team initiatives to elevate the quality and reliability of our AI data infrastructure.

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems.
• Bachelor's degree in computer science or equivalent.
• Experience building ML pipelines, data processing systems, or evaluation infrastructure at scale.
• Hands-on experience with LLMs (prompting, fine-tuning, structured output, confidence calibration).

Responsibilities

• Data Preparation Platform: Design and deliver core components of data preparation journey to customize and fine-tune LLMs in SageMaker, designing systems that provide customers with high-quality, reliable data for their ML workflows.
• Drive Innovation in Data Preparation: Build and scale systems leveraging auto-labeling and LLM-as-Judge techniques to automatically detect, diagnose, and remediate data quality issues.
• Agent & Model Quality: Establish quality standards and evaluation frameworks for AI agents and models, implementing continuous improvement processes.
• Human-in-the-Loop Services: Lead the evolution of our HITL suite, enabling seamless human feedback loops for data labeling, annotation quality assurance, and ground truth generation.
• Technical Leadership: Mentor engineers, drive design reviews, and raise the engineering quality bar across the team. Influence technical direction without formal authority.
• Architecture & Strategy: Make high-judgment architectural decisions across distributed systems, data processing, and ML infrastructure. Own the technical roadmap for your area.

Skills

Software development

Architecture leadership

Mentorship

Programming languages

Education

Bachelor's degree in CS or equivalent

Tools

LLMs

ML pipelines

Data processing systems

Job description

Amazon Development Center U.S., Inc. in Seattle, WA, is seeking a seasoned software leader to build and scale data preparation platforms within SageMaker.

You will help customize and fine-tune LLMs, implement auto-labeling, and drive data quality improvements across ML workflows. You will mentor engineers, lead architecture discussions, and steer cross-team initiatives to elevate the quality and reliability of our AI data infrastructure.