Data Quality Assurance Engineer (AVAILABLE IMMEDIATELY)

Embelo; Cape Town; Hybrid; ZAR 600,000 - 900,000; Full time

Job summary

Embelo’s Inference Group is seeking a hands-on Data Quality Assurance Engineer to join the Data and Integration team in Cape Town. You will ensure Azure and Databricks data is accurate, complete and trustworthy by profiling, validating, reconciling and monitoring data end-to-end.

You will design automated checks with SQL and PySpark, build data quality monitoring, and contribute from week one in a delivery role. Hybrid work from Woodstock, with office presence required several days a week.

Qualifications

• Hands-on data quality, data testing or data engineering experience.
• Experience in Microsoft Azure data environments.
• Databricks experience and advanced SQL skills.

Responsibilities

• Profile source and target datasets for completeness and anomalies.
• Design and implement data validation rules and automated checks using SQL and PySpark.
• Reconcile data between source systems, staging layers and target models.
• Build and maintain data quality monitoring, alerting and reporting.
• Perform root cause analysis on data issues with Data Engineers to resolve them.
• Test data pipelines, transformations, and data models before and after release.
• Embed data quality tests into Azure DevOps CI/CD pipelines.
• Define and track data quality metrics and thresholds with stakeholders.
• Help define data quality standards, frameworks and best practices across client projects.
• Support master data and reference data quality initiatives.
• Guide and support less experienced team members on data quality practices.
• Work with Data Engineers, Integration Developers, Analysts and business data owners.
• Document data quality rules, findings and processes, and keep stakeholders updated on progress.

Skills

Azure data environments

Databricks

Advanced SQL

PySpark

Data profiling

Data reconciliation

CI/CD

Agile

Independent work

Education

Degree in Computer Science / Information Systems

Tools

Azure DevOps

dbt

Python

Job description

Data Quality Assurance Engineer (MUST BE AVAILABLE IMMEDIATELY)

Data Quality Assurance Engineer | Azure, Databricks, Advanced SQL & PySpark

About the role

We're looking for a hands-on Data Quality Assurance Engineer to join the growing Data and Integration team at Inference Group at Embelo in Cape Town.

You’ll make sure the data flowing through our clients' Azure and Databricks platforms is accurate, complete and trustworthy. You’ll profile, validate, reconcile and monitor data, track issues back to their source, and help shape how data quality is approached across projects. This is a delivery role for someone who can contribute from week one, work from clear requirements and take ownership of data quality from end to end.

You’ll suit this role if you enjoy digging into data, spotting what doesn’t add up and building checks that catch problems before the business does.

What You’ll Be Doing

• Profile source and target datasets to understand structure, completeness and anomalies.
• Design and implement data validation rules and automated checks using advanced SQL and PySpark in Databricks.
• Reconcile data between source systems, staging layers and target models (row counts, totals, keys and business rules).
• Build and maintain data quality monitoring, alerting and reporting.
• Perform root cause analysis on data issues and work with Data Engineers to resolve them.
• Test data pipelines, transformations and data models before and after release.
• Embed data quality tests into Azure DevOps CI/CD pipelines.
• Define and track data quality metrics and thresholds with stakeholders.
• Help define data quality standards, frameworks and best practices across client projects.
• Support master data and reference data quality initiatives.
• Guide and support less experienced team members on data quality practices.
• Work with Data Engineers, Integration Developers, Analysts and business data owners.
• Document data quality rules, findings and processes, and keep stakeholders updated on progress.

What We’re Looking For

• Approximately 4 to 7 years of hands‑on experience in data quality, data testing or data engineering.
• Experience working in Microsoft Azure data environments.
• Hands‑on experience with Databricks.
• Advanced SQL skills, including complex joins, window functions and large‑dataset analysis.
• PySpark and/or Python for data validation and automation.
• Proven experience with data profiling, data validation and data reconciliation.
• Experience setting up data quality monitoring and alerting.
• Strong root cause analysis skills for data issues.
• Practical experience with Azure DevOps and CI/CD.
• Experience working in an Agile environment.
• Able to work independently from defined requirements and deliver at pace.

Nice to Have

• Elementary Data, or other data observability tools.
• dbt, including dbt tests and data contracts.
• Profisee or other Master Data Management (MDM) platforms.
• Understanding of data governance, data lineage and data quality dimensions.
• Consultancy or client‑facing delivery experience.
• Azure or Databricks certifications (e.g. DP-203, DP-600, Databricks Data Engineer Associate).

The Person We’re Looking For

You’ll be hands‑on, practical and quick to get productive in a new environment.

You should be someone who:

• Takes ownership of your work and delivers with minimal supervision.
• Has a sharp eye for detail and enjoys investigating data problems.
• Communicates data issues clearly to technical and non-technical colleagues.
• Adapts quickly to different client environments and ways of working.
• Cares about trustworthy data, clear documentation and repeatable checks.
• Is willing to complete client onboarding and background or security vetting, where required.

Location & Working Arrangement

This is a hybrid position based in Woodstock, Cape Town, with a minimum of three days per week in the office. Candidates willing to relocate to Cape Town are welcome to apply. Relocation costs will be the candidate's responsibility.

Education

A degree in Computer Science, Information Systems, Statistics, Engineering or a related field is preferred but not essential. Relevant hands‑on experience will also be considered.

Why Join Us?

You’ll join Inference Group (Embelo), a growing data and AI consultancy working with UK‑based clients on modern data and integration projects. You’ll work on a modern Azure and Databricks stack, gain exposure to client delivery and grow your skills alongside an ambitious team.