Hiring Bigdata Engineer - Python Spark Developer - Chennai/ Bangalore

Tech Mahindra; Chennai, Bengaluru; Hybrid; INR 1,200,000 - 2,400,000; Full time

Job summary

Tech Mahindra in Chennai (Sholinganallur) is hiring a Python Data Engineer with 3–12 years of experience for hybrid work 3 days a week.

The role focuses on Python and Spark programming, building data pipelines, ETL/ELT, and working with Hadoop ecosystem. Proficiency in Pandas and PySpark is essential, with exposure to Tableau/Dataiku/MSTR a plus.

You will develop scalable data solutions, debug and optimize code, and collaborate with cross‑functional teams across analytics and engineering.

Qualifications

• Hands-on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code.
• Experience with Pandas for data manipulation and analysis.
• Hands-on in Big Data Toolset such as Hadoop, HDFS, HIVE, KAFKA, SPARK, Bash Scripting.
• Familiar with building ELT/ETL pipelines in Hadoop and reporting tools is a plus.

Responsibilities

• Sr Big Data Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process.
• Strong proficiency in Python and Spark programming.
• Pandas: experience with data manipulation and analysis.
• Hands-on with PySpark and Pandas/Polars for data manipulation.
• Hands on in Hadoop ecosystem (Hadoop, HDFS, HIVE) and Kafka.
• Familiar with reporting tools like Tableau, Dataiku, or MSTR.

Skills

Python

PySpark

Scala

Spark

Big Data

Java

SQL

Pandas

Bash scripting

ETL/ELT

Data pipeline development

Migration automation

Azure DevOps

Control M

Hadoop

HDFS

Hive

Kafka

Tools

Tableau

Dataiku

MSTR

Azure DevOps

Control-M

Job description

Primary Skill Python, Hadoop, Spark, Hive, Unix, Airflow/ Control M, SQL

• Skill – Python Data Engineer role
• Exp – 3 - 12 Yrs
• Location – Chennai – Sholinganallur / Bangalore – RMZ Ecoworld – Bellandur
• Hybrid Mode – 3 Days a week as per organization policy

Through and hands on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code.

Primary Skills:

• Python, PySpark, Scala, Spark, Big Data
• Java, SQL
• Data pipeline development, ETL/ELT
• Migration automation, accelerator/utilities development
• Solid understanding in the python concepts

Well versed with: ---

• As Sr Big Data Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process.
• Very good proficiency in Python and Spark programming.
• Pandas: Experience with data manipulation and analysis using Pandas.
• Strong proficiency in programming with hands-on experience with relevant frameworks/libraries.
• Experience with PySpark and Pandas/Polars for data manipulation.
• Hands-on in Big Data Toolset such as Hadoop, HDFS, HIVE, KAFKA, SPARK, Bash Scripting. Hands-on in SQL
• Hands on in any reporting tool (e.g. Tableau, Dataiku, MSTR etc.) is a plus
• Familiar with Enterprise Data Warehouse and Reference Data Management is a plus
• Familiar with Control M (or other job orchestration tool) is a plus
• Familiar with building ELT/ETL pipeline in Hadoop is a plus
• Familiar with Azure DevOps is a plus.