Data Engineer, Conversational Shopping Data Engineering

Amazon; Bengaluru; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

Amazon in Bengaluru is seeking a Data Engineer to build and maintain complex data pipelines and data warehouses. You will design schemas, develop ETL processes, and deliver dashboards and metrics to support business decisions in a fast-moving environment.

You will work with AWS technologies (S3, EMR, Redshift, Glue) and collaborate with analysts, PMs, and engineers to enable data-driven decision making across Amazon's diverse teams.

Qualifications

• 1+ years of data engineering experience.
• Experience with data modeling, warehousing and building ETL pipelines.
• Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala) and scripting (Python).
• Experience with big data technologies such as Hadoop, Hive, Spark, EMR.

Responsibilities

• Design data schema and operate internal data warehouses and SQL/NOSQL database systems.
• Design data models, implement, automate, optimization and monitor data pipelines
• Own the design, development and maintenance of ongoing metrics, reports, analyses, dashboards, etc. to drive key business decisions
• Analyze and solve problems at their root, stepping back to understand the broader context
• Manage AWS infrastructure and data services (Redshift/Spectrum/EMR) and drive architectural plans for future data storage and analytics
• Work with data lake components (Hadoop, S3) and SQL on Hadoop (Spark, Hive, Impala)
• Ensure data integrity, testing, validation and documentation

Skills

Data Engineering

SQL

Python

ETL

AWS

Tools

Hadoop

Spark

Hive

EMR

S3

Job description

Data Engineer, Conversational Shopping Data Engineering

Job ID: 10500469 | ADCI - Karnataka

Description

As a Data Engineer, you will be working on building and maintaining complex data pipelines, assemble large and complex datasets to generate business insights and to enable data driven decision making and support the rapidly growing and dynamic business demand for data. Data Engineers help us design, manage, and continuously enhance our Analytics needs. You will develop and deliver analytics applications including metrics generation, metrics correlation, modeling, and many other use cases to help improve process effectiveness, customer experience, and automation. As a DE, you will deal with technical aspects of data warehousing (Redshift, Spectrum, EMR, ETL), infrastructure and build data pipelines, tools, and reports that enable program managers, analysts, BIEs, solution architects, and executives to design and deliver bench marking services for Amazon's business units. We want to you to feel welcomed, included and valued right from the start. We know that your experiences will help us build a better world

Key job responsibilities

• Design data schema and operate internal data warehouses and SQL/NOSQL database systems.
• Design data models, implement, automate, optimization and monitor data pipelines
• Own the design, development and maintenance of ongoing metrics, reports, analyses, dashboards, etc. to drive key business decisions
• Analyze and solve problems at their root, stepping back to understand the broader context
• Manage Redshift/Spectrum/EMR infrastructure, and drive architectural plans and implementation for future data storage, reporting, and analytic solutions
• Work on different AWS technologies such as S3, Redshift, Lambda, Glue, etc.. and Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency
• Work on data lake platform and different components in the data lake such as Hadoop, Amazon S3 etc.
• Work on SQL technologies on Hadoop such as Spark. Hive, Impala etc.
• Recognize and adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation.
• Must possess verbal and written communication skills, be self-driven, and deliver high quality results in a fast-paced environment.
• Conduct rapid prototyping and proof of concepts
• Conceptualize and develop automation tools for bench marking data collection and analytics
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies

A day in the life

0

Basic Qualifications

• 1+ years of data engineering experience
• Experience with data modeling, warehousing and building ETL pipelines
• Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
• Experience with one or more scripting language (e.g., Python, KornShell)

Preferred Qualifications

• Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
• Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Job details

• Location: IND, KA, Bengaluru
• Job category: Database Administration