Software Dev Engineer II, Stores Foundational AI -SFAI

Amazon; Palo Alto (CA); On-site; USD 165,000 - 224,000; Full time

Job summary

Amazon in Palo Alto is seeking a Software Development Engineer to help build scalable data platforms for AI models and large language models. You will own data ingestion, behavioral analysis, dataset generation, and experimentation for model training and evaluation.

You will collaborate with applied scientists and engineers to turn research into production systems, enabling automated workflows for continuous model improvement while prioritizing privacy, security, and reliability.

Qualifications

• > 3+ years of non-internship professional software development experience
• > 2+ years of non-internship design or architecture of new and existing systems
• > Experience programming with at least one software programming language
• > Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques

Responsibilities

• Design, build, and operate scalable systems that transform real customer interactions into high-quality datasets, behavioral signals, and actionable insights for model training, post-training, and evaluation.
• Develop data intelligence capabilities to analyze customer behavior, identify meaningful patterns and model quality gaps, and discover signals that improve large language models and agentic systems.
• Build reliable pipelines and self-service tools for data ingestion, filtering, sampling, aggregation, dataset generation, quality validation, and exploratory analysis.
• Partner with applied scientists to define metrics, analyze experiments, evaluate training data effectiveness, and translate findings into improved data recipes and learning signals.
• Develop automated and agent-driven workflows for data curation, anomaly detection, experimentation, evaluation, and continuous model improvement while maintaining high standards for privacy, security, scalability, and operational excellence.

Skills

Software development

System design

Programming

Machine learning basics

Tools

Spark

Flink

SQL

Distributed storage

Workflow orchestration

JAX

PyTorch

vLLM

SGLang

Dynamo

TorchXLA

TensorRT

Job description

Join us in building the systems that enable Amazon’s AI to learn from real-world customer behavior and continuously improve at massive scale. As a Software Development Engineer, you will solve challenging data and distributed-systems problems at the center of Amazon’s next-generation shopping AI. You will build scalable data platforms and intelligence capabilities that transform billions of customer interactions into high-quality training data, learning signals, and insights that directly improve large language models, agentic systems, and customer experiences.

You will own important components spanning data ingestion, behavioral analysis, dataset generation, and experimentation and evaluation for large language models and AI agents. Working closely with applied scientists and experienced engineers, you will turn complex research and product needs into reliable production systems and help pioneer automated, agent-driven workflows for continuous model improvement.

Key job responsibilities

• Design, build, and operate scalable systems that transform real customer interactions into high-quality datasets, behavioral signals, and actionable insights for model training, post-training, and evaluation.
• Develop data intelligence capabilities to analyze customer behavior, identify meaningful patterns and model quality gaps, and discover signals that improve large language models and agentic systems.
• Build reliable pipelines and self-service tools for data ingestion, filtering, sampling, aggregation, dataset generation, quality validation, and exploratory analysis.
• Partner with applied scientists to define metrics, analyze experiments, evaluate training data effectiveness, and translate findings into improved data recipes and learning signals.
• Develop automated and agent-driven workflows for data curation, anomaly detection, experimentation, evaluation, and continuous model improvement while maintaining high standards for privacy, security, scalability, and operational excellence.

Preferred Qualifications

1. Experience building large-scale data platforms, analytical systems, or data products using technologies such as Spark, Flink, SQL, distributed storage, or workflow orchestration systems.
2. Experience analyzing large and complex datasets to identify customer behavior patterns, data quality issues, and opportunities to improve machine learning models.
3. Experience defining metrics and building data quality monitoring, anomaly detection, or self-service analytics capabilities.
4. Knowledge of experimental design, statistical analysis, sampling methodologies, and techniques for measuring the impact of data or model changes.
5. Experience partnering with applied scientists, data scientists, or machine learning engineers to translate ambiguous analytical requirements into scalable production systems.
6. Knowledge of machine learning and large language model workflows, including training data preparation, post-training, experimentation, evaluation, model behavior analysis, agentic systems, and feedback loops.

Basic Qualifications

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience programming with at least one software programming language
• Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques

Preferred Qualifications

• Knowledge of ML frameworks including JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, and TensorRT
• Knowledge of system performance, memory management, and parallel computing principles
• Experience with CUDA/C++/Kernel development

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, CA, Palo Alto - 165,200.00 - 223,600.00 USD annually

USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually