Data Engineer I, Data Engineering India

Amazon; London; On-site; GBP 45,000 - 80,000; Full time

Job summary

Join a forward-thinking team as a Data Engineer, where you'll design and build robust data pipelines to support machine learning models. This role offers a unique opportunity to work with cutting-edge big data technologies in a dynamic environment. You'll collaborate with talented engineers to drive operational excellence and simplify data-driven decision-making. If you're passionate about data engineering and eager to make a significant impact, this position is perfect for you. Embrace the chance to grow your skills and contribute to innovative solutions in a leading global company.

Qualifications

• 2+ years of data engineering experience with a strong technical background.
• Proficient in SQL and experienced with big data technologies.

Responsibilities

• Design and build end-to-end data pipelines for ML & LLM models.
• Collaborate with technology teams to ensure data availability.

Skills

SQL

Python

TypeScript

JavaScript

Apache Spark (PySpark, Spark SQL)

ML/LLM models

Education

Bachelor's degree in Computer Science or related field

Tools

AWS

Hadoop

Hive

EMR

Job description

Job Description: Data Engineer, IN Data Engineering & Analytics (IDEA) Team

IN Data Engineering & Analytics (IDEA) Team is seeking a talented Data Engineer to develop data pipelines and support ML models for Amazon India businesses.

Team Overview

The IDEA team serves as the central Data Engineering and Analytics unit for all Amazon India businesses. Its responsibilities include providing a Unified Data and Analytics Infrastructure (UDAI), managing a Petabyte-scale Redshift data warehouse, and enabling analytics and self-service data applications for various business streams such as Payments, Finance, Consumer, and Delivery Experience.

Role Overview

The Data Engineer will focus on data extraction, transformation, and pipeline management to ensure data availability for ML & LLM models. This role offers opportunities for growth, impact, and collaboration with seasoned business leaders.

Ideal Candidate Profile

• Strong technical background in SQL, scripting languages (Python, TypeScript, JavaScript), databases, ML/LLM models, and big data technologies like Apache Spark (PySpark, Spark SQL).
• Self-starter with the ability to work from requirements to solutions.
• Effective communicator, passionate learner, and accountable owner of deliverables.
• Customer-focused, impact-driven, and results-oriented.

Key Responsibilities

1. Design and build end-to-end data pipelines for ML & LLM models.
2. Set up data infrastructure, pipelines, and permissions for ML training and inference.
3. Collaborate with technology teams to extract, transform, and load data using SQL, scripting, and AWS big data tools.
4. Communicate effectively and deliver high-quality results in a fast-paced environment.
5. Drive operational excellence through automation and process improvements.
6. Work closely with a team of talented engineers.

Daily Operations

The IDEA team aims to simplify and accelerate data-driven decision-making by providing cost-effective, timely, and high-quality data access through UDAI, supporting ingestion, storage, processing, and analysis to empower business insights.

Minimum Qualifications

• 2+ years of data engineering experience.
• Proficiency with SQL.
• Experience with scripting languages such as Python or KornShell.
• Knowledge of query languages like SQL, PL/SQL, HiveQL, SparkSQL, Scala.
• Experience with big data technologies such as Hadoop, Hive, Spark, EMR.

Additional Information

Amazon's inclusive culture empowers employees to deliver exceptional results. For workplace accommodations during the application process, visit https://amazon.jobs/content/en/how-we-hire/accommodations. If your region isn't listed, contact your Recruiting Partner.