Data QA Engineer (Databricks & ETL Validation)

SMBC Group; Ireland; Hybrid; EUR 80,000 - 110,000; Full time

Job summary

SMBC Group is seeking a QA Testing Specialist- Data Engineer to ensure the accuracy, reliability, and integrity of enterprise data platforms built on Databricks. This role blends data engineering with QA expertise to validate ETL pipelines and large-scale datasets.

The position supports data-driven decision-making, collaborating with Data Engineers, Business Analysts, Product Owners, and Project Managers across distributed teams, reporting to the Director, QA Testing Manager.

Qualifications

• 5+ years of experience in Quality Assurance testing or relevant Data Engineering roles.
• 6+ years of experience in test management strategy; experience in securities or financial services.
• 3+ years designing solutions in process flow, business logic and UI.
• Strong experience with Azure data ecosystem, Databricks notebooks and cluster management.
• Experience building or supporting data test automation, with CI/CD and Git.
• Hands-on test development for medium to large enterprise projects and production.

Responsibilities

• Delivery: ensure data quality standards before production releases.
• Define test scope, scenarios, risk-based coverage and test strategies.
• Design and execute tests for complex ETL pipelines and perform regression testing.
• Data validation & automation: write SQL queries and Python scripts to support data test automation.
• Monitor Databricks jobs and investigate pipeline failures and data issues.
• Log, track and manage defects in JIRA and communicate quality risks clearly.

Skills

Advanced SQL

Python (PySpark)

Data validation

Analytical thinking

Problem solving

Communication

Tools

Azure data ecosystem

Databricks

CI/CD pipelines

Git

Python (Pandas)

Job description

SMBC Group is seeking a QA Testing Specialist- Data Engineer to ensure the accuracy, reliability, and integrity of enterprise data platforms built on Databricks. This role blends data engineering with QA expertise to validate ETL pipelines and large-scale datasets.

The position supports data-driven decision-making, collaborating with Data Engineers, Business Analysts, Product Owners, and Project Managers across distributed teams, reporting to the Director, QA Testing Manager.