Data Quality Engineer | SQL, Python & Databricks | Hybrid

ConnectOS; Mandaluyong; Hybrid; PHP 600,000 - 900,000; Full time

Benefits offered by this job

Medical & dental coverage

Paid vacation & sick leave

Annual appraisal

Financial assistance program

13th month pay

Sleeping quarters

Office fitness & wellness facilities

Regular company events

Metro Manila location at Mega Tower

Job summary

ConnectOS is seeking a Data QA professional to validate data across products and platforms in a hybrid setup based in Mandaluyong. You will design tests for ingestion, transformation, enrichment, and consumption while performing source-to-target reconciliation with SQL.

The role requires strong Python skills for data validation, experience with Databricks notebooks, and a solid understanding of CI/CD pipelines to ensure quality throughout development and releases.

Qualifications

• 3+ years of experience in Data QA, Data Quality Engineering role.
• Strong SQL skills for data validation, reconciliation, investigation, and root-cause analysis.

Responsibilities

• Validate data accuracy, completeness, consistency, and integrity across data products and platforms.
• Design and execute tests for data ingestion, transformation, enrichment, and consumption.
• Perform source-to-target reconciliation and data validation using SQL.
• Validate business rules, calculations, and transformation logic.
• Test batch and event-driven data pipelines throughout the development lifecycle.
• Perform integration, system, regression, and end-to-end testing of data solutions.
• Monitor Databricks jobs, workflows, and platform processes.
• Investigate and troubleshoot Databricks job and data pipeline failures.
• Analyze execution logs, alerts, and monitoring information to identify data quality issues.
• Develop and maintain automated data validation and reconciliation solutions using SQL, Python, and Databricks notebooks.
• Contribute to automated testing within CI/CD pipelines.
• Identify, document, investigate, and support the resolution of data defects and quality issues.
• Work closely with Data Engineers, Developers, Architects, Product Owners, and QA teams.
• Support data migrations, platform upgrades, and release readiness activities.
• Contribute to improving data testing, automation, monitoring, and quality assurance practices.

Skills

Data QA

SQL

Python

Data validation

Root-cause analysis

Data pipelines testing

CI/CD knowledge

Azure

PySpark

Event Hubs/Kafka basics

Tools

Databricks

Databricks notebooks

Databricks jobs

Monitoring tools

Azure

Job description

ConnectOS is seeking a Data QA professional to validate data across products and platforms in a hybrid setup based in Mandaluyong. You will design tests for ingestion, transformation, enrichment, and consumption while performing source-to-target reconciliation with SQL.

The role requires strong Python skills for data validation, experience with Databricks notebooks, and a solid understanding of CI/CD pipelines to ensure quality throughout development and releases.