Data engineer (Apache Hadoop, Python and PySpark)

Tekskills Inc.; Mumbai; On-site; INR 600,000 - 1,100,000; Full time

Job summary

Tekskills Inc. is seeking a data engineer with 4–10 years of hands-on experience to design and maintain data pipelines in a modern lakehouse ecosystem. You will work with Apache Spark (batch and streaming), Hive, and multiple programming languages including Python, Scala or Java.

You will also handle orchestration with Airflow or Control-M, implement SQL transformations with DBT, and work with Kafka/Solace and object stores like S3 or MinIO. Docker/Kubernetes familiarity is a plus.

Qualifications

• 4 to 10 years of hands-on data engineering experience.
• Proficiency in Spark, Hive, and multiple programming languages.
• Experience with Kafka/Solace and object stores like S3 or MinIO.
• Experience with Docker/Kubernetes for deployment and Lakehouse formats Iceberg/Delta/Hudi.

Skills

Apache Spark

Hive

Python

Scala

Java

Tools

Airflow

Control-M

DBT

Kafka

Solace

S3

MinIO

Docker

Kubernetes

Iceberg

Delta Lake

Hudi

Job description

• 4 to 10 years of hands-on data engineering experience.
• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).