Data Reliability Engineer – Azure DataOps & Quality

Vector Resourcing; United Kingdom; On-site; GBP 50,000 - 70,000; Full time

Job summary

A recruitment firm in the United Kingdom seeks a DataOps/Data Quality Engineer for a hands-on role focused on building data validation frameworks and automated testing for Azure-based data platforms. Responsibilities include collaborating with engineering teams, ensuring pipeline reliability, and documenting best practices. Candidates should have a strong background in data validation, experience with Azure Data Factory and monitoring tools, and be adept at automation and scripting. Competitive compensation package offered.

Qualifications

• Strong background in data validation frameworks and automated testing.
• Experience working with Azure Monitor and setting up alert rules.
• Strong debugging and incident resolution skills.

Responsibilities

• Build and maintain data validation frameworks to ensure data quality.
• Test and validate data pipelines and notebooks developed by Data Engineers.
• Automate execution of validation routines and verify pipeline outputs.

Skills

Data validation frameworks

Automated testing

Azure Monitor

SQL

Scripting languages

Data Quality Engineering

Collaboration

Tools

Azure Data Factory

Synapse pipelines

PySpark

Azure DevOps

Job description

A recruitment firm in the United Kingdom seeks a DataOps/Data Quality Engineer for a hands-on role focused on building data validation frameworks and automated testing for Azure-based data platforms. Responsibilities include collaborating with engineering teams, ensuring pipeline reliability, and documenting best practices. Candidates should have a strong background in data validation, experience with Azure Data Factory and monitoring tools, and be adept at automation and scripting. Competitive compensation package offered.