Senior Data QC Engineer: SQL/ETL & GCP Pipelines

SoftServe; Town of Poland (NY); On-site; USD 120,000 - 170,000; Full time

Job summary

SoftServe seeks a Quality Engineer to ensure the quality and reliability of enterprise-scale Data Products within a modern GCP-based data ecosystem. You will validate complex data pipelines, transformations, governance processes, and metadata quality while collaborating with Data and Platform Engineers.

There is also an opportunity to expand toward Data Engineering. The role emphasizes hands-on SQL validation, BigQuery/Spanner/Cloud Composer usage, and contributing to test automation, CI/CD, and

Qualifications

• 3+ years in Quality Control or Quality Engineering, preferably with data-intensive or large-scale cloud-based systems
• Strong hands-on experience with GCP data services, particularly BigQuery, Spanner, and Cloud Composer
• Advanced SQL skills with experience writing complex analytical queries, preferably using BigQuery SQL
• Strong experience in data validation and data quality testing, including schema validation, metadata checks, data lineage, and functional validation
• Solid understanding of functional, integration, regression, and non-functional testing approaches
• Experience creating and maintaining structured test documentation, including test plans, test cases, and test reports
• Experience validating data pipelines and ETL/ELT processes
• Strong analytical and problem-solving skills with the ability to investigate complex data quality issues
• Strong communication skills, a proactive and consultative mindset, and proficiency in English
• Interest in expanding technical expertise toward Data Engineering
• Experience with Google Dataplex, including data governance rules, cataloging, metadata management, and data quality policies
• Familiarity with IBM Netezza
• Experience with GCP monitoring and logging tools, including Cloud Logging, Cloud Monitoring, and Error Reporting
• Experience validating AI/ML components integrated into data platforms, including AI-driven transformations, analysis, and predictions
• Understanding of data mesh principles and enterprise data platform concepts

Responsibilities

• Design and execute comprehensive testing strategies for enterprise-scale Data Products, covering data ingestion, transformation, modelling, quality, governance, and publishing
• Validate large-scale datasets using complex SQL queries, ensuring data accuracy, completeness, consistency, schema integrity, and metadata quality
• Test data pipelines and ETL/ELT workflows across GCP services, including BigQuery, Spanner, and Cloud Composer
• Perform functional, integration, regression, and non-functional testing to ensure reliable data processing across the platform
• Investigate data quality and pipeline issues using monitoring and logging capabilities, collaborating with Data and Platform Engineers to identify root causes
• Build and maintain structured test documentation, including test plans, test cases, validation scenarios, and test reports
• Contribute to data governance and quality practices, including validation of metadata, lineage, cataloging, and data quality rules
• Validate AI/ML-enabled data capabilities, including AI-driven transformations, analysis, and predictions, with a focus on data quality, accuracy, and logic correctness
• Contribute to continuous improvements in test automation, CI/CD, quality engineering practices, and overall platform reliability

Skills

Quality testing

SQL querying

GCP data services

Data validation

Test documentation

Analytical thinking

Communication (English)

AI/ML data capabilities

Tools

BigQuery

Spanner

Cloud Composer

Dataplex

Cloud Logging

Cloud Monitoring

Error Reporting

Job description

SoftServe seeks a Quality Engineer to ensure the quality and reliability of enterprise-scale Data Products within a modern GCP-based data ecosystem. You will validate complex data pipelines, transformations, governance processes, and metadata quality while collaborating with Data and Platform Engineers.

There is also an opportunity to expand toward Data Engineering. The role emphasizes hands-on SQL validation, BigQuery/Spanner/Cloud Composer usage, and contributing to test automation, CI/CD, and