Data Engineer, Conversational Shopping Data Engineering

Amazon; India; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Amazon is seeking a Data Engineer to design and maintain scalable data pipelines and analytics capabilities. You will build data models, automate ETL processes, and develop dashboards to empower decision-making across business units.

The role emphasizes collaboration with analysts, engineers, and product teams to optimize data infrastructure using AWS data services. The ideal candidate will have hands-on experience with Hadoop, Spark, Hive, and EMR, along with strong SQL programming and data

Qualifications

• Experience in building and maintaining data pipelines and analytics applications.
• Knowledge of data warehousing and ETL concepts and tools.
• Strong SQL and scripting skills (Python preferred).
• Experience with big data technologies (Hadoop, Spark, Hive, EMR).

Responsibilities

• Design data schema and operate internal data warehouses and SQL/NOSQL database systems.
• Design data models, implement, automate, optimize and monitor data pipelines.
• Own the design, development and maintenance of metrics, reports, and dashboards to drive decisions.
• Interface with cross-functional teams to extract/transform/load data from various sources.

Skills

Data modeling

Warehousing

ETL pipelines

SQL

Python

Big data concepts

Data analysis

Communication

Tools

Hadoop

Hive

Spark

EMR

Informatica

ODI

SSIS

Datastage

BODI

SQL/PLSQL

Job description

Data Engineer, Conversational Shopping Data Engineering

As a Data Engineer, you will be working on building and maintaining complex data pipelines, assemble large and complex datasets to generate business insights and to enable data driven decision making and support the rapidly growing and dynamic business demand for data. Data Engineers help us design, manage, and continuously enhance our Analytics needs. You will develop and deliver analytics applications including metrics generation, metrics correlation, modeling, and many other use cases to help improve process effectiveness, customer experience, and automation. As a DE, you will deal with technical aspects of data warehousing (Redshift, Spectrum, EMR, ETL), infrastructure and build data pipelines, tools, and reports that enable program managers, analysts, BIE’s, solution architects, and executives to design and deliver bench marking services for Amazon’s business units. We want to you to feel welcomed, included and valued right from the start. We know that your experiences will help us build a better world.

Key job responsibilities

• Design data schema and operate internal data warehouses and SQL/NOSQL database systems.
• Design data models, implement, automate, optimization and monitor data pipelines
• Own the design, development and maintenance of ongoing metrics, reports, analyses, dashboards, etc. to drive key business decisions
• Analyze and solve problems at their root, stepping back to understand the broader context
• Manage Redshift/Spectrum/EMR infrastructure, and drive architectural plans and implementation for future data storage, reporting, and analytic solutions
• Work on different AWS technologies such as S3, Redshift, Lambda, Glue, etc.. and Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency
• Work on data lake platform and different components in the data lake such as Hadoop, Amazon S3 etc.
• Work on SQL technologies on Hadoop such as Spark. Hive, Impala etc.
• Recognize and adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation.
• Must possess verbal and written communication skills, be self-driven, and deliver high quality results in a fast-paced environment.
• Conduct rapid prototyping and proof of concepts
• Conceptualize and develop automation tools for bench marking data collection and analytics
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies

• 1+ years of data engineering experience
• Experience with data modeling, warehousing and building ETL pipelines
• Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
• Experience with one or more scripting language (e.g., Python, KornShell)

• Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
• Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.