Data engineer (Apache Hadoop, Python and PySpark)

Tekskills Inc.; Hyderabad; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

Tekskills Inc. is seeking a seasoned data engineer in Hyderabad, India, to design and implement data pipelines using Spark, Hive, and modern Lakehouse formats.

You will work with Python/Scala/Java to build robust ingestion and transformation tasks, integrating Kafka and messaging systems for streaming data. The role requires experience with orchestration tools like Airflow or Control-M and SQL-based transformation frameworks such as DBT, plus familiarity with Docker and Kubernetes for deployment

Qualifications

• 4 to 10 years of hands-on data engineering experience.
• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Tools

Apache Spark

Hive

Python

Scala

Java

Airflow

Control-M

DBT

Kafka

Solace

S3

MinIO

Docker

Kubernetes

Iceberg

Delta Lake

Hudi

Job description

• 4 to 10 years of hands-on data engineering experience.
• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).