Senior Data Engineer

Appsierra Group; Antwerpen, Brussel; Sur place; EUR 70 000 - 100 000; Plein temps

Résumé du poste

Appsierra Group in Belgium is seeking a Senior Data Engineer to design, build and maintain scalable data pipelines within a modern cloud data environment, with a strong focus on Microsoft Fabric, Power BI and Python. You will translate reporting needs into robust data models and reusable data assets to enable reliable insights for end users.

You will work independently on architecture, governance, quality, maintainability and scalability, collaborating with analysts, architects and stakeholders

Qualifications

• Demonstrable experience as a Data Engineer.
• Demonstrable experience with databases.
• Experience with Python, Java or Scala for data streams and ETL.
• Experience in designing and implementing ETL processes.

Responsabilités

• Design, build, optimize, and maintain scalable data pipelines within a modern cloud data environment.
• Implement data integrations from various sources, such as relational databases, APIs, files, applications and other data sources.
• Develop lakehouse, warehouse and medallion architectures, focusing on reusability, performance and data quality.
• Translate reporting and analysis needs into clear data models and reliable datasets.
• Monitor, document and improve existing data flows, pipelines and data processes.
• Independently record data projects from analysis to implementation and delivery.
• Align with business stakeholders, data analysts, architects and technical teams on requirements, solutions and deliverables.
• Actively contribute to standards, best practices and knowledge sharing within the data team.

Connaissances

Data pipelines

Cloud data platforms

Python/Java/Scala

Data modeling

Description du poste

We are looking for a Senior Data Engineer with extensive experience in designing, building and maintaining scalable and reliable data solutions.

Within this assignment, you will work on a data platform based on a modern data architecture, with a strong focus on Microsoft Fabric, Power BI, Python and the realization of large-scale, robust data piplines. You translate reporting and data needs into robust data models, high-performance pipelines and reusable data assets that allow end users to gain reliable insights faster.

We are looking for an independent professional who is not only technically strong, but also actively thinks along with us about architecture, data governance, quality, maintainability and scalability. You will work closely with analysts, reporting specialists, architects, end users and other stakeholders.

Responsibilities

• Design, build, optimize, and maintain scalable data pipelines within a modern cloud data environment.


• Implement data integrations from various sources, such as relational databases, APIs, files, applications and other data sources.


• Developing and managing lakehouse, warehouse and medallion architectures, with a focus on reusability, performance and data quality.


• Translating reporting and analysis needs into clear data models and reliable datasets.


• Monitoring, documenting and improving existing data flows, pipelines and data processes.


• Independently recording data projects, from analysis to implementation and delivery.


• Align with business stakeholders, data analysts, architects and technical teams on requirements, solutions and deliverables.


• Actively contribute to standards, best practices and knowledge sharing within the data team.

Requirements

• Demonstrable experience as a Data Engineer


• Demonstrable experience with databases


• Demonstrable experience with programming languages such as Python, Java or Scala for developing data streams and ETL processes


• Demonstrable experience in designing and implementing Extract, Transform, Load (ETL) processes