Senior Data Engineer

Consult Asia; Chandigarh; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Consult Asia is seeking an Experienced Data Engineer in Chandigarh with 6–9 years of hands-on experience in Spark, Python/Scala and SQL. You will migrate and develop data pipelines, moving Hive/Control-M jobs to Airflow/DBT, and integrate with Kafka, S3/MinIO, deploying on Kubernetes for scalable, production-ready solutions.

The role requires independent delivery capabilities and strong data lakehouse tooling experience, working across data ingestion, processing and orchestration.

Qualifications

• 6–9 years of data engineering experience.
• Strong Spark, Python/Scala and SQL skills.
• Hands-on with Airflow, DBT, Kafka and Kubernetes.

Responsibilities

• Develop and migrate data pipelines using Spark and Python/Scala.
• Move Hive and Control-M jobs to Airflow/DBT and integrate with Kafka, S3/MinIO.
• Deliver scalable, production-ready solutions with independent delivery.

Skills

Spark

Python/Scala

SQL

Tools

Airflow

DBT

Kafka

Kubernetes

Job description

Required Candidate profile

Develop and migrate data pipelines using Spark, Python/Scala. Move Hive and Control-M jobs to Airflow/DBT. Integrate with Kafka, Solace, S3, MinIO, and deploy on Kubernetes ensuring scalable, automated, production-ready solutions.

Experienced Data Engineer (6–9 yrs) with strong Spark, Python/Scala, and SQL skills. Hands‑on in Airflow, DBT, Kafka, Kubernetes, and data lakehouse tools.Capable of independent delivery and migration