Senior Data Engineer - Data Platform & Forecasting

Amazon Web Services, Inc.; Seattle (WA); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Web Services is seeking a Senior Data Engineer within the AWS Specialist and Partner Organization to shape the data backbone for an internal deal intelligence platform that guides partnerships and portfolio decisions.

You will own data ingestion, entity resolution, vendor modeling, and build scalable pipelines on AWS using Glue, Spark, Airflow, Iceberg, and Athena, ensuring data quality and governance.

Qualifications

• 5+ years of data engineering experience.
• Experience with data modeling, warehousing, and building ETL pipelines.
• Experience with distributed data processing using Spark (or equivalent) and workflow orchestration such as Airflow.
• Strong SQL skills and proficiency in at least one scripting language (Python preferred) for data manipulation and pipeline development.
• Experience designing data schemas and operating data stores in support of analytics and downstream consumers.
• Experience working with cloud data services, with AWS preferred.

Responsibilities

• Own the data architecture for your domain areas such as ingestion, entity resolution, and vendor relationship modeling, while contributing to broader platform architecture decisions.
• Deliver solutions with limited guidance when end-to-end data models and data flows are not yet defined.
• Onboard and integrate disparate data sources across Amazon (AWS, Retail, Procurement, Finance, vendor systems); resolve conflicts and drive cross-team alignment on data definitions and ownership.
• Evolve data sourcing and modeling toward governed, reusable data products and migrate within your domains without disrupting downstream consumers.
• Build and operate pipelines across distributed processing and orchestration on an open-lakehouse foundation on AWS (Glue/Spark, Airflow, Iceberg, Athena), governed by Lake Formation and cross-account IAM.
• Raise operational excellence with incremental, retry-safe loads, atomic publication, dependency-aware scheduling, and data-quality validation.
• Design data systems within your scope to support diverse access patterns, including batch analytics, governed BI, and ML training datasets.
• Partner with the science team to build data infrastructure for forecasting and reinforcement-learning work, including feature pipelines, training datasets, decision logs, and reward signals.
• Drive engineering and operational excellence best practices across the data infrastructure.
• Mentor and develop peers within the team.
• Balance short-term delivery needs with long-term architectural scalability.

Skills

Data engineering

Data modeling

ETL pipelines

Spark

SQL

Python

AWS

Tools

Glue

Spark

Airflow

Iceberg

Athena

Lake Formation

S3

IAM

ElasticSearch

EMR

EC2

Lambda

Hudi

Delta Lake

Python

SQL

Job description

Amazon Web Services is seeking a Senior Data Engineer within the AWS Specialist and Partner Organization to shape the data backbone for an internal deal intelligence platform that guides partnerships and portfolio decisions.

You will own data ingestion, entity resolution, vendor modeling, and build scalable pipelines on AWS using Glue, Spark, Airflow, Iceberg, and Athena, ensuring data quality and governance.