Data engineer (Apache Hadoop, Python and PySpark)

Tekskills Inc.; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tekskills Inc. in Bengaluru seeks an experienced data engineer to design and optimize scalable data pipelines using Spark (batch and streaming) and Hive. You will work with Python, Scala, or Java to implement transformations and ensure robust data delivery across the data platform.

Proficiency with Kafka, Solace, and object stores (S3, MinIO) is required, along with Docker/Kubernetes deployment experience. Knowledge of Lakehouse formats (Iceberg, Delta Lake, Hudi) is essential for modern data

Qualifications

• 4 to 10 years of hands-on data engineering experience.
• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Skills

4 to 10 years experience

Tools

Spark

Hive

Python

Scala

Java

Airflow

Control-M

DBT

Kafka

Solace

S3

MinIO

Docker

Kubernetes

Iceberg

Delta Lake

Hudi

Job description

• 4 to 10 years of hands-on data engineering experience.
• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).