AI Data Platform Engineer: Scalable Systems

Amazon; Palo Alto (CA); On-site; USD 165,000 - 224,000; Full time

Job summary

Amazon in Palo Alto is seeking a Software Development Engineer to help build scalable data platforms for AI models and large language models. You will own data ingestion, behavioral analysis, dataset generation, and experimentation for model training and evaluation.

You will collaborate with applied scientists and engineers to turn research into production systems, enabling automated workflows for continuous model improvement while prioritizing privacy, security, and reliability.

Qualifications

• > 3+ years of non-internship professional software development experience
• > 2+ years of non-internship design or architecture of new and existing systems
• > Experience programming with at least one software programming language
• > Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques

Responsibilities

• Design, build, and operate scalable systems that transform real customer interactions into high-quality datasets, behavioral signals, and actionable insights for model training, post-training, and evaluation.
• Develop data intelligence capabilities to analyze customer behavior, identify meaningful patterns and model quality gaps, and discover signals that improve large language models and agentic systems.
• Build reliable pipelines and self-service tools for data ingestion, filtering, sampling, aggregation, dataset generation, quality validation, and exploratory analysis.
• Partner with applied scientists to define metrics, analyze experiments, evaluate training data effectiveness, and translate findings into improved data recipes and learning signals.
• Develop automated and agent-driven workflows for data curation, anomaly detection, experimentation, evaluation, and continuous model improvement while maintaining high standards for privacy, security, scalability, and operational excellence.

Skills

Software development

System design

Programming

Machine learning basics

Tools

Spark

Flink

SQL

Distributed storage

Workflow orchestration

JAX

PyTorch

vLLM

SGLang

Dynamo

TorchXLA

TensorRT

Job description

Amazon in Palo Alto is seeking a Software Development Engineer to help build scalable data platforms for AI models and large language models. You will own data ingestion, behavioral analysis, dataset generation, and experimentation for model training and evaluation.

You will collaborate with applied scientists and engineers to turn research into production systems, enabling automated workflows for continuous model improvement while prioritizing privacy, security, and reliability.