Opening For Data engineer (Apache Hadoop, Python and PySpark)

Tekskills Inc.; Dadri; Presencial; INR 1 200 000 - 2 800 000; Tempo integral

Resumo da oferta

Tekskills Inc. is seeking a hands-on Data Engineer with 4–10 years of experience to design and optimize large-scale data pipelines in India. You will work with Spark, Hive and lakehouse formats to enable reliable analytics and ML-ready data.

Required skills include Python/Scala/Java, Airflow, DBT, Kafka, object stores (S3/MinIO), and containerized deployments with Docker/Kubernetes.

Qualificações

• Hands-on data engineering experience
• Strong expertise in Apache Spark (batch + streaming) and Hive
• Proficiency in Python, Scala, or Java
• Knowledge of orchestration tools (Airflow / Control-M) and DBT
• Experience with Kafka, Solace, and object stores (S3, MinIO)
• Exposure to Docker/Kubernetes for deployment
• Hands on experience with Lakehouse formats (Iceberg, Delta Lake, Hudi)

Conhecimentos

Spark

Hive

Python

Scala

Java

Airflow

DBT

Kafka

SQL

Docker

Kubernetes

Iceberg

Delta Lake

MinIO

S3

Ferramentas

Spark

Hive

Airflow

DBT

Kafka

Docker

Kubernetes

Iceberg

Delta Lake

MinIO

S3

Descrição da oferta de emprego

4 to 10 years of hands-on data engineering experience.

• Strong expertise in Apache Spark (batch + streaming) and Hive.
• Proficiency in Python, Scala, or Java.
• Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
• Experience working with Kafka, Solace, and object stores (S3, MinIO).
• Exposure to Docker/Kubernetes for deployment.
• Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).