F2F Drive -24thOCT- Bangalore& Chennai-PySpark Developer-5+ Years

Tekgence, Inc.; Chennai, Bengaluru; Hybrid; INR 1,500,000 - 2,400,000; Full time

Job summary

Tekgence, Inc. is seeking a Pyspark Developer (Big Data) to design, build, and optimize scalable data pipelines within Hadoop ecosystem technologies. The role involves batch and streaming processing, data integration, performance tuning, and collaboration with business teams.

The candidate will work on ETL/ELT pipelines, write complex HiveQL, and ingest data from multiple sources including Kafka and Sqoop. Location options include Bangalore or Chennai with full-time permanent employment.

Qualifications

• 3-8 years of hands-on experience in Pyspark/big data development.
• Strong knowledge of HDFS, Hive, Spark.
• Python/Scala knowledge.
• Strong SQL and data modelling fundamentals.
• Knowledge with workflow orchestration tools (Airflow).
• Good understanding of Linux, shell scripting, and distributed systems.
• Familiarity with version control (Git) and Agile delivery practices.

Responsibilities

• Design and develop robust ETL/data pipelines using Hadoop ecosystem tools.
• Build and optimize large-scale data processing jobs using Spark and/or Hive.
• Write complex SQL/HiveQL for data transformation and reporting needs.
• Ingest structured and unstructured data from multiple sources (Kafka, Sqoop, APIs, files).
• Ensure data quality, lineage, and governance standards are followed.
• Monitor, troubleshoot, and tune jobs for performance and scalability.
• Create technical documentation and follow coding best practices.

Skills

PySpark

Spark

Hive

SQL

Airflow

Linux

Git

Agile

Tools

Hadoop ecosystem tools

Job description

Position: Pyspark Developer (Bigdata)

Relevant Experience: 5+ Years

Client: One of our Prestigious client

Locations: Bangalore/Chennai

Mode of hiring: Full time/Permanent

Notice Period: 0-30 days (Immediate), Only Serving notice period (last working day confirmation required), No Bench/Probation

Mode of Interview: Face to face on 24th OCT - Bangalore(Bellandur) & Chennai(Sholinganallur, Elcot Sez)

Note: only shortlisted profiles will get interview call letter

JD for Pyspark + Python + SQL:

Job Summary

Seeking a Pyspark Developer with 4-10 years of experience in big data engineering to design, build, and optimize scalable data pipelines on Hadoop ecosystem technologies. The role involves batch/stream processing, data integration, performance tuning, and close collaboration with business teams.

Key Responsibilities

• Design and develop robust ETL/data pipelines using Hadoop ecosystem tools.
• Build and optimize large-scale data processing jobs using Spark and/or Hive.
• Write complex SQL/HiveQL for data transformation and reporting needs.
• Ingest structured and unstructured data from multiple sources (Kafka, Sqoop, APIs, files).
• Ensure data quality, lineage, and governance standards are followed.
• Monitor, troubleshoot, and tune jobs for performance and scalability.
• Create technical documentation and follow coding best practices.

Required Skills

• 3-8 years of hands-on experience in Pyspark/big data development.
• Strong knowledge of HDFS, Hive, Spark,
• String knowledge in Python/Scala
• Strong SQL and data modelling fundamentals.
• Knowledge with workflow orchestration tools (Airflow).
• Good understanding of Linux, shell scripting, and distributed systems.
• Familiarity with version control (Git) and Agile delivery practices.