Lead Data Engineer

Lumiq.ai; Dadri; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Lumiq.ai is seeking an experienced Lead Data Engineer to join our growing team in India. The successful candidate will lead a team of Data Engineers, design scalable cloud-based data solutions on AWS, and drive end-to-end data pipelines and models with a strong focus on quality, security, and performance.

Ideal candidates have 6-10 years in Data Engineering, hands-on expertise with AWS, PySpark, Airflow, and SQL, and experience mentoring engineers while collaborating with cross-functional teams

Qualifications

• 6-10 years of experience in Data Engineering.
• Strong hands-on experience with AWS, PySpark, Airflow, and SQL.
• Expertise in building ETL/ELT pipelines and data platforms.
• Experience with Docker, Kubernetes, Hadoop, Spark.
• Knowledge of Data Warehousing, Data Lakes, and modern data architectures.

Responsibilities

• Lead and mentor a team of Data Engineers.
• Design and develop scalable cloud-based data solutions on AWS.
• Build and optimise data pipelines, ETL processes, and data models.
• Ensure data quality, security, and performance.
• Collaborate with cross-functional teams to deliver business-critical data solutions.

Skills

Leadership

Mentoring

Stakeholder management

Problem solving

Tools

AWS

PySpark

Airflow

SQL

Docker

Kubernetes

Hadoop

Spark

Delta Lake

Job description

We are looking for an experienced Lead Data Engineer to join our growing team. The ideal candidate will have strong expertise in AWS, PySpark, Airflow, SQL, and Data Engineering, along with experience leading engineering teams and delivering scalable cloud-based data solutions.

Responsibilities:

• Lead and mentor a team of Data Engineers.
• Design and develop scalable cloud-based data solutions on AWS.
• Build and optimise data pipelines, ETL processes, and data models.
• Ensure data quality, security, and performance.
• Collaborate with cross-functional teams to deliver business-critical data solutions.

Requirements:

• 6-10 years of experience in Data Engineering.
• Strong hands-on experience with AWS, PySpark, Airflow, and SQL.
• Expertise in building ETL/ELT pipelines and data platforms.
• Experience with Docker, Kubernetes, Hadoop, Spark.
• Knowledge of Data Warehousing, Data Lakes, and modern data architectures.
• Exposure to Hudi, Iceberg, or Delta Lake is preferred.
• Prior experience leading and mentoring a team of Data Engineers.
• Strong problem-solving and stakeholder management skills.