Data Engineer – Streaming Analytics & Data Pipelines

Prime Video & Amazon MGM Studios; New York (NY); On-site; USD 145,000 - 197,000; Full time

Job summary

Amazon.com Services LLC in New York is seeking a Data Engineer to design scalable data pipelines and data products for Prime Video Commerce Analytics. You will work in a large, complex data warehouse environment, integrating multiple heterogeneous data sources and delivering data to 50+ downstream teams for reporting, analysis and ML models.

You will leverage AWS technologies like Redshift, EMR, Spark, and Andes to ensure data quality, timeliness and robust orchestration, collaborating with

Qualifications

• 3+ years of data engineering experience.
• Experience with data modeling, warehousing and building ETL pipelines.
• Experience with SQL.

Responsibilities

• Design complex data pipelines and models powering subscription, transaction, and device registration datasets.
• Deliver scalable data solutions on native AWS infrastructure.
• Develop data quality validation frameworks and monitoring solutions ensuring data integrity and timeliness.
• Build and optimize batch and near real-time processing workflows using Spark, Redshift, and Andes.
• Create robust orchestration and monitoring for workflows with complex dependencies.
• Collaborate with cross-functional teams to onboard new data sources.

Skills

Data engineering

Data modeling

Warehousing

ETL pipelines

SQL

Tools

Redshift

S3

AWS Glue

EMR

Kinesis

Firehose

Lambda

IAM

Job description

Amazon.com Services LLC in New York is seeking a Data Engineer to design scalable data pipelines and data products for Prime Video Commerce Analytics. You will work in a large, complex data warehouse environment, integrating multiple heterogeneous data sources and delivering data to 50+ downstream teams for reporting, analysis and ML models.

You will leverage AWS technologies like Redshift, EMR, Spark, and Andes to ensure data quality, timeliness and robust orchestration, collaborating with