Senior Data Engineer

Evoke HR Solutions Pvt. Ltd.; Chennai, Bengaluru; Hybrid; INR 4,500,000 - 8,000,000; Full time

Job summary

Evoke HR Solutions Pvt. Ltd. in Chennai is seeking an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines. You will work with Python, PySpark, SQL, and Unix/Linux to ensure data quality and performance across large datasets.

You will mentor teammates, review code, and establish best practices while collaborating with analytics and engineering teams to deliver robust data solutions.

Qualifications

• 10+ years of experience in data engineering or related roles.
• Hands-on expertise in Python and PySpark.
• Advanced SQL skills, including query optimization and performance tuning.
• Strong knowledge of Unix/Linux commands and shell scripting.
• Experience with ETL/ELT processes and large-scale data processing.
• Excellent problem-solving, debugging, and analytical skills.
• Ability to work independently and provide technical guidance to the team.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and PySpark.
• Write complex SQL queries and optimize database performance.
• Build and enhance ETL/ELT workflows for data extraction, transformation, and loading.
• Process and transform large volumes of structured and unstructured data.
• Use Unix/Linux commands and shell scripting for automation, job scheduling, and monitoring.
• Troubleshoot complex data pipeline issues and improve performance and reliability.
• Ensure data quality, consistency, and integrity across data processing workflows.
• Collaborate with business, analytics, and engineering teams to deliver data solutions.
• Mentor team members, review code, and establish best practices for data engineering.

Skills

Python

PySpark

SQL

Unix/Linux commands

ETL/ELT

Data pipelines

Job description

We are looking for an experienced Senior Data Engineer with strong expertise in Python, PySpark, SQL, and Unix. The candidate will be responsible for designing, developing, and optimizing scalable data pipelines, handling large datasets, and ensuring high performance and data quality.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and PySpark.
• Write complex SQL queries and optimize database performance.
• Build and enhance ETL/ELT workflows for data extraction, transformation, and loading.
• Process and transform large volumes of structured and unstructured data.
• Use Unix/Linux commands and shell scripting for automation, job scheduling, and monitoring.
• Troubleshoot complex data pipeline issues and improve performance and reliability.
• Ensure data quality, consistency, and integrity across data processing workflows.
• Collaborate with business, analytics, and engineering teams to deliver data solutions.
• Mentor team members, review code, and establish best practices for data engineering.

Required Skills

• 10+ years of experience in data engineering or related roles.
• Strong hands-on expertise in Python and PySpark.
• Advanced SQL skills, including query optimization and performance tuning.
• Strong knowledge of Unix/Linux commands and shell scripting.
• Experience with ETL/ELT processes and large-scale data processing.
• Excellent problem-solving, debugging, and analytical skills.
• Ability to work independently and provide technical guidance to the team.