Senior AI Data Platform Engineer

Amazon; Palo Alto (CA); On-site; USD 193,000 - 262,000; Full time

Benefits offered by this job

Health insurance

RSUs (restricted stock units)

401(k) matching

Paid time off

Parental leave

Job summary

Amazon in Palo Alto seeks a Senior Software Development Engineer to lead design and development of data and distributed-systems capabilities at the center of future AI. You will own areas from data ingestion to evaluation for large language models, translating research needs into durable production systems.

Collaborate with scientists and product teams to drive automated workflows for continuous model improvement.

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming with at least one software programming language experience.
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• Experience as a mentor, tech lead or leading an engineering team.
• Experience with vLLM, SGLang, TensorRT or similar platforms in production environments.
• Experience with CUDA kernels or ML/low-level kernels.

Responsibilities

• Lead the architecture, design, and delivery of scalable systems that transform real customer interactions into high-quality datasets, behavioral signals, and actionable insights for model training, post-training, and evaluation.
• Define and drive technical direction for data intelligence capabilities that analyze customer behavior, identify model quality gaps, and discover signals that improve large language models and agentic systems.
• Build and evolve reliable, self-service platforms for data ingestion, filtering, sampling, aggregation, dataset generation, quality validation, and exploratory analysis, with a focus on extensibility and long-term scalability.
• Partner deeply with applied scientists to define metrics, evaluate experiments and training data effectiveness, and translate scientific needs into scalable data recipes, learning signals, and production capabilities.
• Drive automated and agent-driven workflows for data curation, anomaly detection, experimentation, evaluation, and continuous model improvement, while maintaining high standards for privacy, security, reliability, and operational excellence.
• Raise the engineering bar by mentoring other engineers, reviewing designs, simplifying complex systems, and influencing technical decisions across team boundaries.

Skills

Software development

System design/architecture

Mentoring/leadership

Data ingestion/engineering

Experimentation/evaluation

Education

Bachelor's degree in Computer Science or equivalent

Tools

vLLM

SGLang

TensorRT

CUDA kernels

Job description

Amazon in Palo Alto seeks a Senior Software Development Engineer to lead design and development of data and distributed-systems capabilities at the center of future AI. You will own areas from data ingestion to evaluation for large language models, translating research needs into durable production systems.

Collaborate with scientists and product teams to drive automated workflows for continuous model improvement.