Azure Databricks Data Quality Engineer – Part-time Freelance

EngiFlex BV; Belgique; Hybrid; EUR 42,000 - 64,000; Part time

Job summary

EngiFlex BV in Belgium is seeking a mid-level Data Engineer for a part-time freelance role (60%). You will design, build and maintain data quality pipelines for key data assets, including data about stops, lines and trips, in a modern Azure environment.

You will translate functional quality requirements into technical rules, collaborate with data stewards and stakeholders, and visualize quality insights with Power BI.

Qualifications

• Experience as a Data Engineer at mid-level.
• Proficient in Python and/or SQL with experience in Python.
• Experience in an Azure environment.
• Familiar with data quality tools such as Unity Catalog and/or SODA.
• Knowledge of data quality, data management and data governance.
• Using Databricks as exploration tool.
• Experience designing and implementing ETL processes.
• Familiar with databases and setting up a data quality framework.
• Able to visualize data quality insights clearly, e.g., with Power BI.

Responsibilities

• Design, build and maintain data quality pipelines for mission-critical data assets, including data on stops, lines and trips.
• Deepen understanding of the business context of the data to work technically and substantively.
• Visualize data errors for data stewards and producers, including with Power BI.
• Design, develop and manage data quality pipelines in a modern Azure environment.
• Coordinate with data stewards on quality requirements.
• Translate functional quality requirements into technical quality rules.
• Implement quality rules into pipelines and monitoring processes.
• Proactively think about priority data quality needs and propose improvements.
• Contribute to expansion of a scalable data quality program.
• Collaborate with ICT, data teams, data governance and the business; bridge between technical solutions and organizational needs using Azure Databricks, Unity Catalog, Azure Function Apps, Container Apps, Event Hubs, Data Factory, Apache Spark, SQL, Python, data contracts, SODA, Power BI and Power Query.

Skills

Python

SQL

Azure

Power BI

Databricks

ETL processes

Data governance

Data quality

Data management

Tools

Unity Catalog

SODA

Azure Databricks

Data Factory

Event Hubs

Job description

EngiFlex BV in Belgium is seeking a mid-level Data Engineer for a part-time freelance role (60%). You will design, build and maintain data quality pipelines for key data assets, including data about stops, lines and trips, in a modern Azure environment.

You will translate functional quality requirements into technical rules, collaborate with data stewards and stakeholders, and visualize quality insights with Power BI.