Opening For Data engineer (Apache Hadoop, Python and PySpark)

Tekskills Inc.; Bengaluru; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Tekskills Inc. is seeking a seasoned data engineer with 4 to 10 years of hands-on experience to design, build, and optimize large-scale data pipelines. The role requires strong Spark expertise (batch and streaming), Hive proficiency, and fluency in Python, Scala, or Java.

You will work with Airflow for orchestration, DBT for transformations, and modern lakehouse formats. Additionally, experience with Kafka, Solace, and object stores (S3/MinIO) is preferred, along with containerized deployments

Qualifications

• 4 to 10 years of hands-on data engineering experience.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Skills

Spark expertise

Python/Scala/Java

SQL transformation

Data engineering fundamentals

Tools

Apache Hive

Airflow

Docker

Kubernetes

DBT

Kafka

S3/MinIO

Job description

4 to 10 years of hands-on data engineering experience.

• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).