Data Quality Engineer (UK IT Services, Hybrid)

ConnectOS; Mandaluyong; Hybrid; PHP 600,000 - 900,000; Full time

Benefits offered by this job

Medical & dental coverage

Paid vacation & sick leave

Annual appraisal

Financial assistance program

13th month pay

Sleeping quarters

Office fitness & wellness facilities

Regular company events

Metro Manila location at Mega Tower

Job summary

ConnectOS is seeking a Data QA professional to validate data across products and platforms in a hybrid setup based in Mandaluyong. You will design tests for ingestion, transformation, enrichment, and consumption while performing source-to-target reconciliation with SQL.

The role requires strong Python skills for data validation, experience with Databricks notebooks, and a solid understanding of CI/CD pipelines to ensure quality throughout development and releases.

Qualifications

• 3+ years of experience in Data QA, Data Quality Engineering role.
• Strong SQL skills for data validation, reconciliation, investigation, and root-cause analysis.

Responsibilities

• Validate data accuracy, completeness, consistency, and integrity across data products and platforms.
• Design and execute tests for data ingestion, transformation, enrichment, and consumption.
• Perform source-to-target reconciliation and data validation using SQL.
• Validate business rules, calculations, and transformation logic.
• Test batch and event-driven data pipelines throughout the development lifecycle.
• Perform integration, system, regression, and end-to-end testing of data solutions.
• Monitor Databricks jobs, workflows, and platform processes.
• Investigate and troubleshoot Databricks job and data pipeline failures.
• Analyze execution logs, alerts, and monitoring information to identify data quality issues.
• Develop and maintain automated data validation and reconciliation solutions using SQL, Python, and Databricks notebooks.
• Contribute to automated testing within CI/CD pipelines.
• Identify, document, investigate, and support the resolution of data defects and quality issues.
• Work closely with Data Engineers, Developers, Architects, Product Owners, and QA teams.
• Support data migrations, platform upgrades, and release readiness activities.
• Contribute to improving data testing, automation, monitoring, and quality assurance practices.

Skills

Data QA

SQL

Python

Data validation

Root-cause analysis

Data pipelines testing

CI/CD knowledge

Azure

PySpark

Event Hubs/Kafka basics

Tools

Databricks

Databricks notebooks

Databricks jobs

Monitoring tools

Azure

Job description

Schedule: 11:00 AM to 8:00 PM Manila time

Work Setup: Hybrid - Mega Tower, Mandaluyong

What are we looking for?

Skills Required:

• 3+ years of experience in Data QA, Data Quality Engineering role
• Strong SQL skills for data validation, reconciliation, investigation, and root-cause analysis
• Hands-on experience working with Databricks, including notebooks, workflows, jobs, monitoring, and troubleshooting
• Experience using Python for data validation and test automation within Databricks notebooks
• Strong experience testing data pipelines, ETL/ELT processes, transformations, and data products
• Experience validating data ingestion, transformation, enrichment, and consumption processes
• Experience performing source-to-target reconciliation and investigating data discrepancies
• Understanding of batch and event-driven data pipelines and distributed data architectures
• Experience monitoring and troubleshooting Databricks jobs and workflows
• Experience working with large and complex datasets
• Familiarity with CI/CD pipelines and modern deployment practices
• Knowledge of software testing principles, methodologies, and defect management
• Strong analytical and problem-solving skills with excellent attention to detail
• Strong English communication skills, with the ability to clearly communicate data quality issues, findings, and technical concerns to both technical and non-technical stakeholders
• Experience with Azure, PySpark, Event Hubs/Kafka, or data observability tools is an advantage

What will you do?

• Validate data accuracy, completeness, consistency, and integrity across data products and platforms
• Design and execute tests for data ingestion, transformation, enrichment, and consumption
• Perform source-to-target reconciliation and data validation using SQL
• Validate business rules, calculations, and transformation logic
• Test batch and event-driven data pipelines throughout the development lifecycle
• Perform integration, system, regression, and end-to-end testing of data solutions
• Monitor Databricks jobs, workflows, and platform processes
• Investigate and troubleshoot Databricks job and data pipeline failures
• Analyze execution logs, alerts, and monitoring information to identify data quality issues
• Develop and maintain automated data validation and reconciliation solutions using SQL, Python, and Databricks notebooks
• Contribute to automated testing within CI/CD pipelines
• Identify, document, investigate, and support the resolution of data defects and quality issues
• Work closely with Data Engineers, Developers, Architects, Product Owners, and QA teams
• Support data migrations, platform upgrades, and release readiness activities
• Contribute to improving data testing, automation, monitoring, and quality assurance practices

Join the awesome team and enjoy these benefits & perks:

• Medical, Dental Coverage and Life insurance from day 1 of employment
• Paid Vacation and Sick Leave (with Quarterly Sick Leave Conversion)
• Competitive salary package and annual appraisal
• Financial Assistance Program
• Mandatory Government Benefits and 13th Month PayComplimentary Sleeping Quarters, Coffee at no cost
• Complimentary Office Fitness and Wellness Facilities at no cost
• Regular Company Events, Work Life Balance, and Career growth opportunities
• Accessible location at the heart of Metro Manila --- the Mega Tower, EDSA

ConnectOS is certified as a Great Place to Work and is a top-rated Philippines employer of choice. Our Client is a Field Service Management(FSM) provider passionate about making work and the lives of mobile workers better. An established market leader with over 400 staff across the UK, Ireland, Australia & the Nordics, they supports over 1,000 organisations and 500,000 workers to transform the delivery of field services and experience an exceptional return on investment.

Equal Employment Statement

Employment decisions at ConnectOS will be conducted without consideration of factors such as age', race, color, religion, gender, disability status, sexual orientation, gender identity or expression, genetic information, and marital status. ConnectOS ensures the full confidentiality of the data it processes.