Sr. Data Engineer

Amazon Inc.; Bengaluru; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Amazon Inc. in Bengaluru is seeking a Senior Data Engineer with 4+ years of experience to design, develop, and optimise high-performance data systems.

You will architect real-time and batch pipelines, ingest, transform, and model data for analytics and ML applications. You will collaborate across product, analytics, and infra teams, ensuring data reliability and scalable solutions while mentoring junior engineers and leading design reviews.

Qualifications

• 4+ years of experience in data engineering, backend development, or large-scale data systems.
• Strong proficiency in Python; experience with Java or Scala is a plus.
• Hands-on experience with real-time processing frameworks such as Kafka, Spark Streaming, or Flink.
• Solid understanding of data modelling, distributed systems, and API integrations.
• Proficiency with SQL and NoSQL databases and working experience on AWS (S3 EMR, Redshift, Glue, Kinesis).
• Familiarity with web scraping frameworks (Scrapy, Selenium, Playwright) or similar data acquisition tools.
• Experience in optimising ETL pipelines and handling large-scale datasets.

Responsibilities

• Design, build, and maintain real-time and batch data pipelines for structured and unstructured datasets.
• Develop scalable data ingestion, transformation, and processing frameworks for high-volume data environments.
• Collaborate with product, analytics, and infrastructure teams to ensure data reliability, availability, and performance.
• Build APIs and data models that support large-scale analytics and machine learning applications.
• Optimise query performance, storage systems, and ETL workflows for massive datasets.
• Mentor junior engineers, contribute to best practices, and lead design reviews for critical data infrastructure.

Skills

Python

Java/Scala

Kafka

Spark Streaming

Flink

SQL/NoSQL

AWS

Data Modelling

Distributed Systems

APIs

Tools

Scrapy

Selenium

Playwright

Airflow

Step Functions

Job description

We are seeking a Senior Data Engineer with 4+ years of experience in building scalable, distributed, and high-performance data systems. In this role, you will architect, develop, and optimise real-time pipelines and analytical systems that enable Amazon teams to extract actionable insights and power intelligent decision-making across the organisation.

Responsibilities

• Design, build, and maintain real-time and batch data pipelines for structured and unstructured datasets.
• Develop scalable data ingestion, transformation, and processing frameworks for high-volume data environments.
• Collaborate with product, analytics, and infrastructure teams to ensure data reliability, availability, and performance.
• Build APIs and data models that support large-scale analytics and machine learning applications.
• Optimise query performance, storage systems, and ETL workflows for massive datasets.
• Mentor junior engineers, contribute to best practices, and lead design reviews for critical data infrastructure.

Requirements

• 4+ years of experience in data engineering, backend development, or large-scale data systems.
• Strong proficiency in Python; experience with Java or Scala is a plus.
• Hands-on experience with real-time processing frameworks such as Kafka, Spark Streaming, or Flink.
• Solid understanding of data modelling, distributed systems, and API integrations.
• Proficiency with SQL and NoSQL databases and working experience on AWS (S3 EMR, Redshift, Glue, Kinesis).
• Familiarity with web scraping frameworks (Scrapy, Selenium, Playwright) or similar data acquisition tools.
• Experience in optimising ETL pipelines and handling large-scale datasets.

Preferred Qualifications

• Experience in AI/ML data pipelines or analytical dashboarding.
• Exposure to workflow orchestration tools (Airflow, Step Functions, or similar).
• Experience mentoring engineers or leading small technical teams.