Senior Data Pipeline QA Engineer (Spark/Kafka/Backend)

Apple Inc.; Seattle (WA); On-site; USD 138,000 - 251,000; Full time

Benefits offered by this job

Stock programs

Medical and dental coverage

Tuition reimbursement

Relocation assistance

Job summary

Apple Inc. in Seattle, WA is seeking a senior test automation engineer to build and maintain automated validation for large-scale data systems powering App Store analytics.

You will design strategies, develop data and UI test automation, and integrate tests into CI/CD to ensure data quality from ingestion to reporting dashboards. The role requires strong Python/Java skills, experience with Spark/Kafka/Flink/Hadoop/Hive/Iceberg, and a track record in end-to-end validation across backend and

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or similar fields.
• At least 7+ years industry experience in a similar role.
• Strong proficiency in Python and/or Java for backend, frontend, data pipeline test automation.
• Working knowledge of SQL and large-scale dataset validation across distributed storage or data lake environments.
• Experience with REST API testing and test automation.
• Experience with UI testing and test automation.
• Experience with CI/CD pipelines and continuous testing frameworks.
• Proven experience implementing Shift-Left testing practices and embedding automation early in the SDLC.
• Strong analytical, debugging, and communication skills.

Responsibilities

• Design, implement, and maintain automated validation frameworks for data pipelines, backend and frontend App Analytics.
• Integrate automated tests into CI/CD pipelines to ensure continuous validation, early defect detection, and continuous deployment.
• Validate data pipelines built on Spark, Kafka, Flink, Hive, Hadoop, and Iceberg, ensuring correctness, completeness, and performance.
• Develop scalable utilities for schema validation, data comparison, and regression checks across distributed datasets.
• Conduct functional, regression, and data integrity testing across multiple storage and compute layers.
• Build monitoring and alerting mechanisms for pipeline health and data quality KPIs.
• Investigate, isolate, and debug complex data issues across client, backend, and frontend layer.
• Design and document test strategies, automation architecture, and validation reports.
• Partner with data, backend, and frontend engineers to shift quality left by embedding testability into data workflows, APIs, and UI early in the development lifecycle.
• Leverage GenAI to improve testing efficiency and effectiveness.

Skills

Python

Java

REST API testing

UI testing

CI/CD

Shift-Left

Data pipelines

Big Data

Education

Bachelor’s degree in Computer Science, Engineering, or similar field

Tools

Spark

Kafka

Flink

Hadoop

Hive

Iceberg

Job description

Apple Inc. in Seattle, WA is seeking a senior test automation engineer to build and maintain automated validation for large-scale data systems powering App Store analytics.

You will design strategies, develop data and UI test automation, and integrate tests into CI/CD to ensure data quality from ingestion to reporting dashboards. The role requires strong Python/Java skills, experience with Spark/Kafka/Flink/Hadoop/Hive/Iceberg, and a track record in end-to-end validation across backend and