Sr. Software Engineer

Tech Mahindra; India; On-site; INR 1,200,000 - 2,500,000; Full time

Job summary

Tech Mahindra seeks a capable Data Engineer with strong Python skills to design and maintain data pipelines and workflows. The role involves working with Airflow, SQL, and databases like Postgres, Iceberg, and StarRocks to deliver scalable data solutions.

The ideal candidate will collaborate with data scientists and analysts, optimize workflows for performance, and contribute to data governance and quality initiatives. A Bachelor's degree and 5–7 years of experience are expected.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5–7 years of experience in data engineering or related role.
• Strong analytical and problem solving skills.
• Excellent communication and teamwork abilities.
• Ability to work in a fast paced environment and manage multiple priorities.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes using Airflow and Python.
• Implement data models and manage data storage solutions using Iceberg and StarRocks DB.
• Write efficient SQL queries for data extraction, transformation, and loading.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet business needs.
• Monitor and optimize data workflows for performance and reliability.
• Document data processes and maintain data quality standards.
• Participate in code reviews and contribute to best practices in data engineering.

Skills

Python

Data pipelines

ETL

Education

Bachelor's degree in Computer Science/Information Technology or related field

Tools

Airflow

Iceberg

StarRocks DB

Postgres

Shell scripting

Scala

Job description

A Bachelor’s or Higher Degree is the minimum entry required for the position

We are seeking a skilled Data Engineer with a strong background in Python and experience in data processing and management. The ideal candidate will be responsible for designing, implementing, and maintaining data pipelines and workflows using various technologies including Airflow, Shell Scripting, SQL, and databases such as StarRocks and Postgres. This role requires a proactive individual who can work collaboratively within a team to deliver high quality data solutions.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes using Airflow and Python.
• Implement data models and manage data storage solutions using IceBerg and StarRocks DB.
• Write efficient SQL queries for data extraction, transformation, and loading.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet business needs.
• Monitor and optimize data workflows for performance and reliability.
• Document data processes and maintain data quality standards.
• Participate in code reviews and contribute to best practices in data engineering.

Mandatory Skills:

• Proficient in Python programming.
• Experience with Apache Airflow for workflow management.
• Strong knowledge of SQL and experience with relational databases (Postgres).
• Familiarity with data lake technologies, specifically IceBerg.
• Experience with data warehousing solutions, particularly StarRocks DB.

Preferred Skills:

• Experience with Shell scripting for automation tasks.
• Knowledge of Scala for data processing.
• Familiarity with cloud platforms (AWS, GCP, or Azure).
• Understanding of data governance and data quality frameworks.
• Experience with version control systems (e.g., Git).

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5 7 years of experience in data engineering or a related role.
• Strong analytical and problem solving skills.
• Excellent communication and teamwork abilities.
• Ability to work in a fast paced environment and manage multiple priorities.