Data Engineer

Expleo Group; Chennai District; On-site; INR 1,600,000 - 2,600,000; Full time

Job summary

Expleo Group in Chennai is seeking a skilled Data Engineer to design, build and maintain scalable data pipelines and platforms. You will work closely with data scientists, analysts, and business stakeholders to ensure reliable, high-quality data across our ecosystem.

Responsibilities include designing and developing robust ETL/ELT pipelines with PySpark and SQL, managing Databricks workflows, collaborating with analytics and ML teams, and implementing data governance across the platform.

Qualifications

• 4–6 years of hands-on data engineering experience.
• Strong PySpark experience for large-scale processing.
• Advanced SQL skills including window functions and joins.
• Solid Databricks experience (Delta Lake, workflows) preferred.
• Experience with AWS or Azure cloud platforms.

Responsibilities

• Design and develop robust ETL/ELT pipelines using PySpark/SQL.
• Build and optimise data workflows on Databricks notebooks, jobs, and clusters.
• Collaborate with analytics and ML teams to deliver clean datasets.
• Monitor pipeline performance, troubleshoot failures, ensure data quality.
• Define data governance and best practices across the data platform.
• Participate in design reviews and contribute to architectural decisions.

Skills

PySpark

SQL

Databricks

AWS

Azure

Python

Git

Job description

4–6 Years Experience / Chennai

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms. You will work closely with data scientists, analysts, and business stakeholders to ensure reliable, high-quality data across our ecosystem.

Responsibilities

• Design and develop robust ETL/ELT pipelines using PySpark and SQL for large-scale data processing.
• Build, manage, and optimise data workflows on Databricks, including notebooks, jobs, and cluster configurations.
• Collaborate with analytics and ML teams to deliver clean, well-documented datasets.
• Monitor pipeline performance, troubleshoot failures, and ensure data quality and integrity.
• Define and implement data governance and best practices across the data platform.
• Participate in design reviews and contribute to architectural decisions.

Requirements

• 4–6 years of hands-on experience in data engineering or a related role.
• Strong proficiency in PySpark for large-scale distributed data processing.
• Advanced SQL skills — query optimisation, window functions, CTEs, and complex joins.
• Solid experience with Databricks — Delta Lake, workflows, Unity Catalog preferred.
• Experience working with cloud platforms (AWS/Azure).

Core skills

PySpark/SQL/Databricks/AWS / Azure /Python/Git

Nice to have

• Experience with streaming frameworks such as Apache Kafka or Spark Streaming.
• Exposure to ML pipelines and feature engineering workflows.