Senior Data Engineer

Dentsuaegis; Mumbai, Thane; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Merkle in Mumbai seeks a Senior Data Engineer with 5+ years of hands-on experience to build and maintain robust data pipelines using Databricks and SQL. You will implement cloud-native data solutions, ensure data quality and collaborate with cross-functional teams to derive analytics insights.

The role emphasizes Databricks, Spark SQL, PySpark, and Python, with responsibilities for pipeline reliability, documentation, and knowledge sharing within the engineering team.

Qualifications

• 5+ years in data engineering or analytics engineering.
• Proficiency with Databricks Spark SQL and PySpark in real pipelines.
• Strong SQL optimization, joins, aggregations and window functions.
• Python for data processing and scripting.
• Experience with cloud ETL services and data architecture.

Responsibilities

• Develop and deploy ETL/ELT pipelines using Databricks and SQL.
• Write clean Python and SQL code for data processing and analytics.
• Monitor jobs, troubleshoot data quality issues, and meet SLAs.
• Collaborate with engineers, scientists and analytics teams.
• Implement validation, error handling and logging for reliability.
• Document code, architecture decisions and runbooks.

Skills

Databricks

PySpark

SQL

Python

Cloud ETL

Data modeling

Data quality

Code reviews

Tools

Azure Data Factory

AWS Glue

SQL tooling

Job description

Job Description:

JOB DESCRIPTIONS

Data Engineering Roles | Databricks & SQL Focus

SENIOR DATA ENGINEER (5 Years Experience)

Position Overview

We are seeking a Data Engineer with 5 years of experience to develop and maintain robust data pipelines and analytics infrastructure. This role focuses on hands‑on implementation using Databricks and SQL, contributing to data platform initiatives while continuously growing technical expertise in cloud‑native data solutions.

Key Responsibilities

• Develop and deploy ETL/ELT pipelines using Databricks, PySpark, and SQL for data ingestion, transformation, and loading
• Write clean, efficient SQL and Python code for data processing, validation, and analytics
• Support data pipeline maintenance, monitor job executions, and troubleshoot data quality issues within SLA timelines
• Collaborate with Senior Engineers, Data Scientists, and Analytics teams to understand requirements and deliver solutions
• Implement data validation, error handling, and logging mechanisms to ensure pipeline reliability
• Document code, architecture decisions, and runbooks for operational excellence
• Participate in code reviews and contribute to knowledge sharing within the engineering team

Required Skills & Experience

• 5+ years of professional experience in data engineering, ETL development, or data analytics engineering
• Strong proficiency in Databricks (Spark SQL, PySpark) with real-world pipeline development experience
• Solid SQL skills including query optimization, joins, aggregations, and window functions
• Hands-on experience with Python for data processing and scripting
• Experience with cloud platforms such as Azure Data Factory, AWS Glue, or similar ETL services
• Understanding of data architecture, data modeling, and relational databases
• Strong problem-solving skills with attention to data quality and accuracy

Required Certifications (Nice to Have)

• Databricks Certified Data Engineer (Associate) OR
• Snowflake SnowPro Core Certified OR
• AWS Certified Data Engineer (Associate) OR equivalent professional data engineering certification

Preferred Qualifications

• Experience with orchestration tools (Apache Airflow, Tidal, Control-M, etc.)
• Familiarity with cloud data warehousing (Snowflake, Redshift, BigQuery)
• Experience with Git, CI/CD pipelines, and version control
• Knowledge of Agile methodologies and experience working in cross-functional teams
• Background in data validation frameworks and data quality testing

Location:

DGS India - Mumbai - Thane Ashar IT Park

Brand:

Merkle

Time Type:

Full time

Contract Type:

Consultant