Data engineer (Apache Hadoop, Python and PySpark)

Tekskills Inc.; Delhi; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Tekskills Inc. seeks a hands-on Data Engineer with 4-10 years of experience to design and build scalable data pipelines using Spark, Hive, and Lakehouse formats. You will work with streaming and batch processing, orchestrate with Airflow or Control-M, and implement DBT transformations.

Proficiency in Python/Scala/Java and familiarity with Kafka, Solace, and cloud object stores is required. You will also gain exposure to Docker/Kubernetes for deployment and handling modern data lakehouse

Qualifications

• 4 to 10 years of hands-on data engineering experience.
• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Skills

Spark

Hive

Python/Scala/Java

Tools

Airflow

Control-M

DBT

Kafka

Solace

S3/MinIO

Docker/Kubernetes

Iceberg/Delta Lake/Hudi

Job description

• 4 to 10 years of hands-on data engineering experience.
• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).