Data Engineer

BMW TechWorks India Pvt Ltd.; Pune District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

BMW TechWorks India Pvt Ltd. in Pune invites a data engineer to design and build scalable data pipelines, enabling large-scale batch and streaming workloads across production environments. You will implement ETL/ELT processes, ensure data quality, and optimize storage and performance.

You will collaborate with engineering, analytics and business stakeholders to implement robust data models, monitor pipeline health with alerts, and resolve complex data issues using SQL and Python.

Qualifications

• 4–6 years of data engineering experience.
• Strong SQL and Python for pipeline development.
• Hands-on with ETL/ELT systems.
• Experience with cloud platforms (AWS/Azure/GCP).
• Familiarity with Spark, Kafka, and data warehouses.

Responsibilities

• Design and construct data pipelines capable of handling high volumes across production environments.
• Develop ETL and ELT frameworks to process, move and transform data at scale.
• Engineer solutions for batch processing workloads and real-time data streaming.
• Maintain data quality through validation checks, monitoring and remediation.
• Optimize query performance and data storage across warehouses and lakes.

Skills

SQL

Python

ETL/ELT

Cloud platforms

Spark

Kafka

Airflow

Data warehouse/lake

Tools

Airflow

Snowflake

Databricks

Kafka

Job description

Batch: 2020/2021/2022.

About the role:

• Design and construct data pipelines capable of handling high volumes of data across production environments
• Develop ETL and ELT frameworks to process, move and transform data at scale
• Engineer solutions for batch processing workloads and real-time data streaming
• Maintain data quality through validation checks, monitoring and remediation of issues in live systems
• Optimize query performance and data storage across warehouses and lakes
• Troubleshoot pipeline failures and performance bottlenecks in production

What you'll work on:

• Building robust extraction, transformation and loading processes for enterprise datasets
• Working with distributed processing frameworks and modern data platforms
• Collaborating across engineering teams, analytics functions and business stakeholders to deliver data infrastructure
• Implementing data models that support both analytical and operational use cases
• Creating monitoring and alerting systems to track pipeline health and data freshness

What we're looking for:

• 4–6 years of experience in data engineering or a closely related field
• Advanced proficiency in SQL and Python for data manipulation and pipeline development
• Hands‑on experience building and maintaining ETL and ELT systems
• Working knowledge of cloud platforms including AWS, Azure or GCP
• Familiarity with distributed data processing tools such as Spark, Databricks or Kafka
• Experience with data warehouse or data lake technologies and orchestration tools like Airflow or Snowflake
• Strong analytical skills and the ability to debug complex data issues
• Clear communication and teamwork across technical and non-technical stakeholders