Data Quality Automation Engineer (Databricks)

Axos Business Center; Manila; On-site; PHP 600,000 - 1,000,000; Full time

Job summary

Axos Business Center is seeking a QA Automation Engineer to write code for automated testing of Web UI, SQL databases, REST APIs, and mobile devices. You will support quality assurance across the Enterprise Data Management lifecycle and ensure data quality in the Databricks Lakehouse.

Required skills include SQL, PySpark/Spark SQL, Python, and experience with Databricks notebooks and Delta Lake. Strong communication and Agile collaboration are essential.

Qualifications

• 2+ years' experience in QA testing, preferably in data engineering or data warehousing
• Data testing in SQL, PySpark/Spark SQL, and Python framework, with hands-on testing of Databricks notebooks, Delta Lake tables and Workflows/Jobs
• Excellent verbal and written communication skills for technical and non-technical audiences
• Strong problem-solving skills, self-motivation and ability to work under tight deadlines
• Demonstrated ability to learn new technologies and frameworks as needed
• Ability to validate ETL/ELT pipelines and ensure data quality across Bronze/Silver/Gold layers

Responsibilities

• Perform QA duties for the Enterprise Data Management lifecycle
• Define and implement data validation and unit/integration testing methods to ensure data quality
• Contribute to test strategy and quality of data in Databricks Lakehouse and develop automated/manual test procedures
• Document bugs and provide supporting test results to assess data product quality
• Collaborate with end users, analysts, IT, DBAs, Tableau developers and data architects to develop comprehensive test plans
• Validate data pipelines with PySpark/Spark SQL and Databricks Workflows/Jobs and ensure accuracy across lake layers
• Leverage AI/LLM tools to accelerate test case generation and data creation, and validate outputs before production testing

Skills

QA Testing

Python

SQL

Databricks

PySpark

CI/CD

Data Warehousing

Education

Bachelor's Degree in Computer Science or related field

Tools

Databricks

Spark SQL

Job description

Axos Business Center is seeking a QA Automation Engineer to write code for automated testing of Web UI, SQL databases, REST APIs, and mobile devices. You will support quality assurance across the Enterprise Data Management lifecycle and ensure data quality in the Databricks Lakehouse.

Required skills include SQL, PySpark/Spark SQL, Python, and experience with Databricks notebooks and Delta Lake. Strong communication and Agile collaboration are essential.