Data Engineer, Amazon Last Mile - Routing and Planning - DE

Amazon; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Amazon's Last Mile Science & Technology org is seeking a Data Engineer to partner with Product Managers, Data Scientists, and Software Engineers to improve the Last Mile delivery network in Hyderabad. You will craft data pipelines, model data, and drive insights across end-to-end planning systems using Python, AWS services, and SQL.

You will work with business owners to define key questions, build scalable data processes, and guide other engineers on best practices in a fast-paced environment.

Qualifications

• 3+ years of data engineering experience.
• 4+ years of SQL experience.
• Experience with data modeling, warehousing and building ETL pipelines.

Responsibilities

• Design, implement, and support data warehouse / data lake infrastructure using AWS big data stack, Python, Redshift, Quicksight, Glue/lake formation, EMR/Spark/Scala, Athena etc.
• Extract huge volumes of structured and unstructured data from various sources and construct complex analyses.
• Develop and manage ETLs to source data from various systems and create unified data model for analytics and reporting
• Perform detailed source-system analysis, source-to-target data analysis, and transformation analysis
• Participate in the full development cycle for ETL: design, implementation, validation, documentation, and maintenance.

Skills

AWS

Python

SQL

ETL pipelines

Data modeling

Big data

Tools

Redshift

S3

Glue

EMR

Kinesis

Lambda

IAM roles

Job description

Description
As part of the Last Mile Science & Technology organization, you’ll partner closely with Product Managers, Data Scientists, and Software Engineers to drive improvements in Amazon's Last Mile delivery network. You will leverage data and analytics to generate insights that accelerate the scale, efficiency, and quality of the routes we build for our drivers through our end-to-end last mile planning systems. You will develop complex data engineering solutions using AWS technology stack (S3, Glue, IAM, Redshift, Athena). You should have deep expertise and passion in working with large data sets, building complex data processes, performance tuning, bringing data from disparate data stores and programmatically identifying patterns. You will work with business owners to develop and define key business questions and requirements. You will provide guidance and support for other engineers with industry best practices and direction. Analytical ingenuity and leadership, business acumen, effective communication capabilities, and the ability to work effectively with cross-functional teams in a fast-paced environment are critical skills for this role.

Description
As part of the Last Mile Science & Technology organization, you’ll partner closely with Product Managers, Data Scientists, and Software Engineers to drive improvements in Amazon's Last Mile delivery network. You will leverage data and analytics to generate insights that accelerate the scale, efficiency, and quality of the routes we build for our drivers through our end-to-end last mile planning systems. You will develop complex data engineering solutions using AWS technology stack (S3, Glue, IAM, Redshift, Athena). You should have deep expertise and passion in working with large data sets, building complex data processes, performance tuning, bringing data from disparate data stores and programmatically identifying patterns. You will work with business owners to develop and define key business questions and requirements. You will provide guidance and support for other engineers with industry best practices and direction. Analytical ingenuity and leadership, business acumen, effective communication capabilities, and the ability to work effectively with cross-functional teams in a fast-paced environment are critical skills for this role.

Key job responsibilities

• Design, implement, and support data warehouse / data lake infrastructure using AWS big data stack, Python, Redshift, Quicksight, Glue/lake formation, EMR/Spark/Scala, Athena etc.
• Extract huge volumes of structured and unstructured data from various sources (Relational /Non-relational/No-SQL database) and message streams and construct complex analyses.
• Develop and manage ETLs to source data from various systems and create unified data model for analytics and reporting
• Perform detailed source-system analysis, source-to-target data analysis, and transformation analysis
• Participate in the full development cycle for ETL: design, implementation, validation, documentation, and maintenance.

Basic Qualifications

• 3+ years of data engineering experience
• 4+ years of SQL experience
• Experience with data modeling, warehousing and building ETL pipelines

Preferred Qualifications

• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
• Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Company - ADCI HYD 13 SEZ

Job ID: A10457351