Data engineer (Apache Hadoop, Python and PySpark)

Tekskills; Bengaluru; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Tekskills in Bengaluru is seeking an experienced data engineer to design and implement data pipelines using Spark (batch and streaming) and Hive. The role involves building robust data processing frameworks with DBT, Kafka, and object stores, while deploying via Docker/Kubernetes.

The ideal candidate has hands-on experience with Iceberg, Delta Lake, and Hudi, and is proficient in Python, Scala, or Java. Join a hands-on team focused on scalable data lakehouse solutions.

Qualifications

• Hands-on data engineering experience required.
• Proficiency in Spark (batch + streaming) and Hive.

Skills

Apache Spark

Hive

Python

Scala

Java

Tools

Airflow

Control-M

DBT

Kafka

Solace

S3

MinIO

Docker

Kubernetes

Iceberg

Delta Lake

Hudi

Job description

4 to 10 years of hands-on data engineering experience.

• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).