Data Engineer I

Amazon.com; Bengaluru; Presencial; INR 1.200.000 - 1.800.000; Jornada completa

Descripción de la vacante

Amazon.com in Bengaluru, India, is seeking a Data Engineer to design data ingress flows and model large, evolving datasets. You will implement efficient distributed storage and query techniques, and integrate data from a wide range of sources.

You will collaborate with SDEs and stakeholders, write robust code with thorough documentation, and build test automation for ETL processes using a mix of AWS services and legacy tools.

Formación

• 1+ year of data engineering experience.
• Experience with data modeling, warehousing and building ETL pipelines.
• Experience with one or more query languages (e.g., SQL, HiveQL, SparkSQL).
• Experience with one or more scripting languages (e.g., Python, KornShell).

Responsabilidades

• Design data ingress flow with SDE teams and business stakeholders.
• Lead design, modeling, and implementation of large, evolving datasets.
• Evaluate and implement distributed storage and query techniques.
• Integrate with internal/external teams to load data from diverse sources.
• Write robust, maintainable code with documentation.
• Implement unit and integration tests for code you deliver.
• Work with NAWS services and legacy ETL tools within Amazon.

Conocimientos

Data modeling

Warehousing

ETL pipelines

SQL

Scripting (Python)

Scripting (KornShell)

Herramientas

Hadoop

Hive

Spark

EMR

Informatica

ODI

SSIS

Datastage

Descripción del empleo

Do you have the technical skill to build BI solutions that process billions of rows a day using AWS technologies? Do you want to create next-generation tools for intuitive data access? Do you wake up in the middle of the night with new ideas that will benefit your customers? Are you persistent in bringing your ideas to fruition?
First things first, you know SQL and data modelling like the back of your hand. You also need to know Big Data and MPP systems. You have a history of coming up with innovative solutions to complex technical problems. You are a quick and willing learner of new technologies and have examples to prove your aptitude. You are not tool-centric; you determine what technology works best for the problem at hand and apply it accordingly. You can explain complex concepts to your non-technical customers in simple terms.

Key job responsibilities

• Work with SDE teams and business stakeholders to understand data requirements and design data ingress flow for team
• Lead the design, model, and implementation of large, evolving, structured, semi-structured and unstructured datasets
• Evaluate and implement efficient distributed storage and query techniques
• Interact and integrate with internal and external teams and systems to extract, transform, and load data from a wide variety of sources
• Implement robust and maintainable code with clear and maintained documentation
• Implement test automation on code implemented through unit testing and integration testing
• Work in a tech stack which is a mix of NAWS services and legacy ETL tools within Amazon

About the team

Data Insights, Metrics & Reporting team (DIMR) is the central data engineering team in Amazon Warehousing & Distribution org which is responsible for 4 things mainly -

• Building and maintaining data engineering and reporting infrastructure using NAWS to support internal/external data use-cases.
• Building data ingestions pipelines from any kind of upstream data sources which include (but not limited to) real time event streaming services, data lakes, manual file uploads, etc.
• Building mechanisms to vend data to internal team members or external sellers with right data handling techniques in place.
• Build robust data mart to support diverse use-cases powered by GenAI tool.

Basic Qualifications

• 1+ years of data engineering experience
• Experience with data modeling, warehousing and building ETL pipelines
• Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
• Experience with one or more scripting language (e.g., Python, KornShell)

Preferred Qualifications

• Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
• Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.