Senior Data Engineer

Virtusa; Hyderabad, Chennai District, Bengaluru; Hybrid; INR 2,600,000 - 4,400,000; Full time

Job summary

Virtusa in Hyderabad is seeking a Senior Data Engineer to lead complex data engineering projects, design scalable data architectures, and optimize data workflows that align with business needs.

The role demands hands-on expertise with Python, PySpark, SQL, and AWS data services (S3, Redshift, Lambda, EMR, Airflow, Glue), plus Bash scripting, agile collaboration, and domain knowledge of healthcare insurance to guide data pipelines from conception through production.

Qualifications

• 8+ years IT experience with at least 5 years in data engineering roles.
• Hands-on with Python, PySpark, SQL and AWS data services.

Responsibilities

• Leads development of data pipelines and architectures for large-scale datasets.
• Designs, constructs, and tests data architectures aligned with business requirements.
• Provides technical leadership for data projects and ensures high-quality data solutions.
• Collaborates with product, finance, and other units to meet business data needs.
• Oversees development enabling predictive and prescriptive analytics.
• Ensures data solutions are robust across environments.
• Aligns data architecture to Healthfirst solution architecture.

Skills

Python PySpark

SQL / Big data

AWS data services

Bash/Shell scripting

Healthcare domain knowledge

Team leadership

Agile methodology

Communication

Job description

Senior Data Engineer

Position Summary

The Senior Data Engineer leads complex data engineering projects, working on designing data architectures that align with business requirements. This role focuses on optimizing data workflows, managing data pipelines, and ensuring the smooth operation of data systems.

Minimum Qualifications

• 8+ Years overall IT experience with minimum 5 years of work experience in below tech skills

Tech Skills

• Strong experience in Python Scripting and PySpark for data processing
• Proficiency in SQL, dealing with big data processing
• Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Glue)
• Expertise in BASH/Shell scripting
• Strong understanding of healthcare insurance domain and experience leading data engineering teams
• Experience in Agile environments.
• Excellent problem-solving skills and attention to detail.
• Effective communication and collaboration skills.

Responsibilities

• Leads development of data pipelines and architectures that handle large-scale data sets.
• Designs, constructs, and tests data architecture aligned with business requirements.
• Provides technical leadership for data projects, ensuring best practices and high-quality data solutions.
• Collaborates with product, finance, and other business units to ensure data pipelines meet business requirements.
• Oversees development of data solutions that enable predictive and prescriptive analytics.
• Ensures the technical quality of solutions, managing data as it moves across environments.
• Aligns data architecture to Healthfirst solution architecture.