Lead Software Engineer

Virtusa; Los Angeles (CA); On-site; USD 120,000 - 170,000; Full time

Job summary

Virtusa in Los Angeles is seeking an experienced SDET to ensure the quality of ETL processes and data integration workflows. The role focuses on designing automated tests for data transformations, migrations, and data quality issues, collaborating with data engineers and developers to enhance pipeline performance.

The ideal candidate brings extensive ETL testing expertise, strong SQL and PySpark skills, and experience with cloud services (AWS).

Qualifications

• 8+ years of IT experience with at least 5 years in ETL testing and automation.
• Proficient in SQL and large-scale data processing.
• Hands-on experience with PySpark and cloud-based data services (AWS).
• Experience leading testing efforts in Agile environments.

Responsibilities

• Review requirements, specs, and technical designs to understand the project.
• Develop and implement test strategies for complex ETL initiatives.
• Plan, prioritize, and coordinate testing activities.
• Design, develop and execute automation scripts.
• Identify and track defects with thorough documentation.
• Perform regression testing and assess data quality.
• Collaborate with data engineers and developers to resolve issues.
• Liaise with cross-functional teams to define system requirements.
• Monitor QA metrics and improve testing processes.

Skills

ETL Testing

Automation scripting

SQL

PySpark

AWS testing

Big Data

Test Automation

DevOps practices

Agile testing

Data validation

Tools

Informatica

DBT

Job description

Position Summary

The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows. This role involves designing and implementing automated tests to validate data transformation and migration, as well as collaborating with data engineers and developers to identify and resolve data quality issues. The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.

Minimum Qualification

At least 8 years of IT experience with minimum 5 years of experience in below skills:

• Tech Skills
• Proficiency in ETL Testing and developing automation framework & testcases in atleast one scripting language.
• Strong SQL skills, with experience in handling big data using ETL tools (e.g., Informatica).
• Mandatory work experience with PySpark
• Testing experience in cloud environment (AWS) S3, SSS, Glue, EMR, Data Catalog, Crawler, SQS, ETL Jobs, Event Bridge, Athena, Redshift Spectrum Databases.
• AWS Commands for running the jobs, file process and movements.
• Experience with Test Automation and DevOps practices in ETL and Cloud Systems.
• Experience with Test Automation and DevOps practices in ETL and Cloud
• Work experience in a Big Data ecosystem processing data in data lakehouse.
• Familiarity with DBT (Data Build Tool) or similar data transformation tools is a plus
• Experience providing testing oversight in Agile team

Responsibilities

• Review requirements, specifications, and technical design documents to understand and feedback.
• Experience in developing and implementing test strategies for complex initiatives.
• Estimate, prioritize, plan and coordinate testing activities
• Design, develop and execute automation scripts.
• Identify, record, document thoroughly and track bugs.
• Strong problem-solving skills, troubleshooting, and root cause analysis skills.
• Perform thorough regression testing when bugs are resolved.
• Develop and apply testing processes for new and existing features to meet client needs.
• Liaise with cross functional teams to identify system requirements.
• Track quality assurance metrics, like defect densities and open defect counts.
• Stay up to date with new testing tools and test strategies requirements