Senior Data Engineer

dentsu; Mumbai; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Merkle's DGS India in Mumbai–Thane Ashar IT Park is seeking a Senior Data Engineer with 5+ years of hands-on experience in building data pipelines and analytics infrastructure. The role emphasizes Databricks, Spark SQL, PySpark, SQL, and Python for end-to-end data processing.

Responsibilities include developing ETL/ELT pipelines, monitoring jobs, ensuring data quality, collaborating with data science and analytics teams, and documenting architecture and runbooks for operational excellence.

Qualifications

• 5+ years of professional experience in data engineering, ETL development, or data analytics engineering.
• Strong proficiency in Databricks (Spark SQL, PySpark) with real-world pipeline development experience.
• Solid SQL skills including query optimization, joins, aggregations, and window functions.
• Hands-on experience with Python for data processing and scripting.
• Experience with cloud platforms such as Azure Data Factory, AWS Glue, or similar ETL services.
• Understanding of data architecture, data modeling, and relational databases.
• Strong problem-solving skills with attention to data quality and accuracy.

Responsibilities

• Develop and deploy ETL/ELT pipelines using Databricks, PySpark, and SQL for data ingestion, transformation, and loading.
• Write clean, efficient SQL and Python code for data processing, validation, and analytics.
• Support data pipeline maintenance, monitor job executions, and troubleshoot data quality issues within SLA timelines.
• Collaborate with Senior Engineers, Data Scientists, and Analytics teams to understand requirements and deliver solutions.
• Implement data validation, error handling, and logging mechanisms to ensure pipeline reliability.
• Document code, architecture decisions, and runbooks for operational excellence.
• Participate in code reviews and contribute to knowledge sharing within the engineering team.

Skills

Databricks

SQL

Python

ETL development

Data pipelines

Data quality

Tools

Azure Data Factory

AWS Glue

Apache Airflow

Git

CI/CD

Job description

## Senior Data EngineerApply: DGS India - Mumbai - Thane Ashar IT Park: Full time: Posted Today: R1132330**Job Description:**# JOB DESCRIPTIONSData Engineering Roles | Databricks & SQL Focus# SENIOR DATA ENGINEER (5 Years Experience)## Position OverviewWe are seeking a Data Engineer with 5 years of experience to develop and maintain robust data pipelines and analytics infrastructure. This role focuses on hands-on implementation using Databricks and SQL, contributing to data platform initiatives while continuously growing technical expertise in cloud-native data solutions.## Key Responsibilities* Develop and deploy ETL/ELT pipelines using Databricks, PySpark, and SQL for data ingestion, transformation, and loading* Write clean, efficient SQL and Python code for data processing, validation, and analytics* Support data pipeline maintenance, monitor job executions, and troubleshoot data quality issues within SLA timelines* Collaborate with Senior Engineers, Data Scientists, and Analytics teams to understand requirements and deliver solutions* Implement data validation, error handling, and logging mechanisms to ensure pipeline reliability* Document code, architecture decisions, and runbooks for operational excellence* Participate in code reviews and contribute to knowledge sharing within the engineering team## Required Skills & Experience* 5+ years of professional experience in data engineering, ETL development, or data analytics engineering* Strong proficiency in Databricks (Spark SQL, PySpark) with real-world pipeline development experience* Solid SQL skills including query optimization, joins, aggregations, and window functions* Hands-on experience with Python for data processing and scripting* Experience with cloud platforms such as Azure Data Factory, AWS Glue, or similar ETL services* Understanding of data architecture, data modeling, and relational databases* Strong problem-solving skills with attention to data quality and accuracy## Required Certifications (Nice to Have)* Databricks Certified Data Engineer (Associate) OR* Snowflake SnowPro Core Certified OR* AWS Certified Data Engineer (Associate) OR equivalent professional data engineering certification## Preferred Qualifications* Experience with orchestration tools (Apache Airflow, Tidal, Control-M, etc.)* Familiarity with cloud data warehousing (Snowflake, Redshift, BigQuery)* Experience with Git, CI/CD pipelines, and version control* Knowledge of Agile methodologies and experience working in cross-functional teams* Background in data validation frameworks and data quality testing**Location:**DGS India - Mumbai - Thane Ashar IT Park**Brand:**Merkle**Time Type:**Full time**Contract Type:**Consultant