Senior Data Engineer

Consult Asia; Thane; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Consult Asia in India is seeking an experienced Data Engineer to develop and migrate data pipelines using Spark and Python/Scala, moving Hive and Control-M jobs to Airflow/DBT, and integrating with Kafka, Solace, S3, MinIO, and deploying on Kubernetes for scalable, automated, production-ready solutions.

The role requires hands-on expertise in data lakehouse tools and the ability to deliver and migrate independently across environments.

Qualifications

• 6–9 years of experience as Data Engineer with Spark, Python/Scala and SQL.
• Hands-on experience with Airflow, DBT, Kafka, Kubernetes and data lakehouse tools.
• Capable of independent delivery and migration.

Skills

Spark

Python/Scala

SQL

Airflow

Kafka

Kubernetes

Tools

DBT

S3

MinIO

Solace

Hive

Control-M

Job description

Required Candidate profile

Develop and migrate data pipelines using Spark, Python/Scala. Move Hive and Control-M jobs to Airflow/DBT. Integrate with Kafka, Solace, S3, MinIO, and deploy on Kubernetes ensuring scalable, automated, production-ready solutions.

Experienced Data Engineer (6–9 yrs) with strong Spark, Python/Scala, and SQL skills. Hands‑on in Airflow, DBT, Kafka, Kubernetes, and data lakehouse tools.Capable of independent delivery and migration