Data Test Automation Engineer

Rising Tide Digital, Inc.; Makati; On-site; PHP 900,000 - 1,200,000; Full time

Job summary

Rising Tide Digital, Inc. in Makati, Philippines is seeking a data test automation engineer to design and maintain the data test automation framework spanning SQL Server, SSIS, dbt, Fivetran, Python ingestion and Databricks pipelines.

You will integrate automated tests into Azure DevOps, build reusable regression suites, and drive quality gates across CI/CD. The role requires 4+ years in test automation or data engineering, strong Python and SQL, and hands-on experience with frameworks like

Qualifications

• 4+ years in test automation or data engineering with data pipeline testing.
• Strong Python and SQL and production-quality test code.
• Hands-on with data testing frameworks (pytest, Great Expectations, dbt tests, Soda).
• Experience integrating tests with CI/CD (Azure DevOps) and Git workflows.
• Knowledge of ETL/ELT patterns and data warehouse concepts.
• Ability to document designs clearly and mentor others.

Responsibilities

• Design, build, and maintain the data test automation framework across pipelines.
• Implement four data quality CI/CD gates (accuracy, latency, performance, security).
• Build reusable regression suites, data quality checks, profiling and anomaly detection.
• Integrate automated tests into Azure DevOps pipelines; own reporting and dashboards.
• Create synthetic and masked test data generation utilities.
• Define Delta Lake native validation for the Databricks Lakehouse (Bronze, Silver, Gold).
• Pair with QA Leads to convert manual tests to automated checks; mentor others.
• Measure automated regression coverage and ROI against targets.
• Leverage AI tools to accelerate test code and data generation.

Skills

Python

SQL

Test automation

CI/CD

Azure DevOps

Great Expectations

dbt tests

Soda

Databricks

PySpark

Education

Bachelor's Degree in Computer Science, Information Systems, or related field

Tools

pytest

Great Expectations

dbt tests

Soda

Azure DevOps Pipelines

Git

Databricks

Job description

Builds and maintains the automated testing framework, data quality gates and regression suites used by all EDW delivery teams. Enables the practice to raise automated regression coverage and enforce quality gates in the CI/CD pipeline.

Job Description

• Design, build and maintain the data test automation framework used across the practice, covering SQL Server, SSIS, dbt, Fivetran, Python ingestion and Databricks pipelines

• Implement the four data quality CI/CD gates (accuracy, latency, performance, security) as automated checks that block environment promotion when they fail

• Build reusable automated regression suites, source to target reconciliation, schema and row count checks, data profiling and anomaly detection

• Integrate automated tests into Azure DevOps pipelines and version control; own test execution reporting and dashboards

• Build synthetic and masked test data generation utilities and test data management practices

• Design the Delta Lake native validation approach for the Databricks Lakehouse (Bronze, Silver, Gold), including schema enforcement, time travel and Unity Catalog governance checks

• Pair with QA Leads and engineers to convert manual test cases to automated checks; coach the practice on automation standards and code review

• Measure and report automated regression coverage and automation ROI against practice targets

• Leverage AI/LLM-powered tools (e.g., Claude, Copilot) to accelerate test code, synthetic data and query generation, validating AI-assisted output before use in production test cycles

• Participate in agile ceremonies, code reviews and release activities as required

Required Key Knowledge Skills/ Experience

• 4+ years in test automation or data engineering, with hands-on data pipeline testing experience

• Strong Python and SQL; able to write production quality test code, not only scripts

• Hands-on experience with a data testing or quality framework (e.g., pytest, Great Expectations, dbt tests, Soda) and with building reusable test libraries

• Experience integrating automated tests with CI/CD (Azure DevOps Pipelines or equivalent) and Git-based workflows

• Working knowledge of ETL/ELT patterns and data warehouse concepts

• Ability to work independently, document designs clearly and mentor others on automation practice

• Good verbal and written communication skills

Preferred Experience

• Hands-on experience with Databricks (PySpark, Delta Lake, Unity Catalog, Databricks Workflows/Jobs, Asset Bundles) or other Big Data/Spark platforms

• Experience with performance and load testing of data pipelines EDW QA Practice Job Descriptions | Page 6

• Experience with data observability or anomaly detection tooling

• Databricks certification (e.g., Databricks Certified Data Engineer Associate) is a nice to have

• Banking or financial services industry experience

Education requirements

• Bachelors Degree in Computer Science, Information Systems, Computer Engineering or related field