Sr. Software Engineer - Python Pysaprk

Tech Mahindra; Chennai District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Tech Mahindra in Chennai is seeking a Data Engineer with a strong Python foundation to design and maintain data pipelines and architectures. The role focuses on transforming raw data into actionable insights, ensuring data quality, and supporting data-driven decision making across the organization.

The ideal candidate will have 2–5 years of data engineering experience, proficiency in Python, SQL, and cloud platforms, and the ability to work with stakeholders to deliver high-quality data

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 2–5 years of experience in data engineering.
• Strong analytical and problem solving skills.
• Excellent communication and collaboration abilities.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes to support data integration and analytics.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.
• Implement data models and structures that optimize data storage and retrieval.
• Monitor and troubleshoot data pipeline performance, ensuring data accuracy and reliability.
• Utilize Python to automate data processing tasks and improve data workflows.
• Document data engineering processes, data flows, and system architecture for future reference.
• Stay updated with industry trends and best practices in data engineering and analytics.

Skills

Python

Data manipulation

Education

Bachelor's degree

Tools

SQL

MySQL

PostgreSQL

Snowflake

Redshift

Apache Airflow

Luigi

AWS

Azure

GCP

Job description

A Bachelor’s or Higher Degree is the minimum entry required for the position

We are seeking a skilled Data Engineer with a strong foundation in Python to join our dynamic team at TechM in Chennai. The ideal candidate will have 2 5 years of experience in data engineering, with a proven ability to design, develop, and maintain data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, ensuring data quality, and supporting data driven decision making across the organization.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes to support data integration and analytics.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.
• Implement data models and structures that optimize data storage and retrieval.
• Monitor and troubleshoot data pipeline performance, ensuring data accuracy and reliability.
• Utilize Python to automate data processing tasks and improve data workflows.
• Document data engineering processes, data flows, and system architecture for future reference.
• Stay updated with industry trends and best practices in data engineering and analytics.

Mandatory Skills:

• Strong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.
• Experience with SQL and relational databases (e.g., MySQL, PostgreSQL).
• Familiarity with data warehousing concepts and tools (e.g., Snowflake, Redshift).
• Knowledge of data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
• Understanding of data modeling and data architecture principles.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus.

Preferred Skills:

• Experience with big data technologies (e.g., Hadoop, Spark).
• Familiarity with data visualization tools (e.g., Tableau, Power BI).
• Knowledge of machine learning concepts and frameworks.
• Experience with version control systems (e.g., Git).

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 2 5 years of experience in data engineering or a related role.
• Strong analytical and problem solving skills.
• Excellent communication and collaboration abilities.