Opening For Data engineer (Apache Hadoop, Python and PySpark)

Tekskills Inc.; Chennai; On-site; INR 1,500,000 - 2,700,000; Full time

Job summary

Tekskills Inc. is seeking a data engineer with 4–10 years of hands-on experience in data engineering. The role emphasizes Spark (batch + streaming), Hive, and strong programming skills in Python, Scala, or Java. You will work with orchestration tools such as Airflow and Control-M, and DBT for SQL transformations.

Additional focus includes Kafka, Solace, and object stores like S3/MinIO, plus Docker/Kubernetes for deployment and Lakehouse formats such as Iceberg, Delta Lake, or Hudi.

Qualifications

• 4–10 years of hands-on data engineering experience.
• Strong expertise in Spark and Hive, with practical batch and streaming work.
• Proficiency in Python, Scala or Java for data processing and ETL.
• Experience with orchestration and SQL transformation tools such as Airflow and DBT.
• Knowledge of Kafka, Solace, and object stores (S3/MinIO); exposure to containerized deployments.

Skills

Apache Spark

Hive

Python

Scala

Java

Airflow

Control-M

DBT

Kafka

Solace

S3

MinIO

Docker/Kubernetes

Iceberg

Delta Lake

Hudi

Tools

Spark SQL

Airflow

Control-M

DBT

Kafka

Solace

S3/MinIO

Docker/Kubernetes

Iceberg

Delta Lake

Hudi

Job description

4 to 10 years of hands-on data engineering experience.

• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).