A complete application in a minute — tailored resume and cover letter, ready to send.
Qualys in Pune, Maharashtra invites an experienced QA Automation Engineer to join the Big Data Platform team. You will build and maintain automated tests for API-based data access and Spark data processing jobs, collaborating with data engineers to ensure data pipelines are accurate, reliable, and performant.
Responsibilities include debugging customer issues, creating automated test scripts, validating Spark outputs, and end-to-end data pipeline verification.
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
We are looking for an QA Automation Engineer to join our Big Data Platform team. You will build and maintain automated tests for API-based data access and Spark data processing jobs, working with data engineers to ensure our data pipelines are accurate, reliable, and performant.
Debugging - Debug and resolve customer issues
Build and maintain automated test scripts for REST/API-based data access services
Maintain and release hot fixes in a dedicated cadence.
Help with appropriate product documentation
Test Spark job outputs for correct transformations, aggregations, and schema
Validate data pipelines end-to-end for completeness, accuracy, and consistency
Write SQL queries to verify data in databases/data lakes against expected results
Work with data engineers/PMs to define test scope from pipeline requirements
Log and track defects (e.g., JIRA) and support root cause analysis
Debug and analyze logs to identify failure root cause and enable resolution
Integrate automated tests into CI/CD pipelines
Maintain deployment pipelines and workloads for QA environments