Senior Data Engineer: Build Scalable Data Pipelines

Everience Benelux; Brussel Hoofdstad; Sur place; EUR 65 000 - 90 000; Plein temps

Résumé du poste

Everience Benelux is seeking a Senior Data Engineer to manage, integrate, and optimize data across upstream and downstream activities, focused on forecasting data. You will ensure data quality, accessibility, and governance across sources for stakeholders, analysts, and scientists.

Responsibilities include building ETL/ELT pipelines, data standardization, lineage documentation, and collaboration with architects and developers to drive data platform decisions and best practices.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• Strong experience in Python development for data processing, scripting, and ETL implementation.
• Advanced knowledge of SQL, relational databases, and data warehouse concepts.
• Experience designing and optimizing data models and database performance.
• Strong understanding of software development best practices.
• Proficiency with version control systems, particularly Git.
• Experience developing and maintaining ETL/ELT solutions.

Responsabilités

• Capture, integrate, and process structured and unstructured data from various internal and external sources.
• Design, develop, and maintain robust ETL/ELT pipelines.
• Structure, standardize, qualify, and document data to ensure consistency and usability.
• Map and maintain data lineage and data source documentation.
• Monitor and improve data quality through validation, testing, and cleansing processes.
• Identify and eliminate duplicate, incomplete, or inconsistent data.
• Ensure the quality and reliability of data entering the Data Lake.
• Contribute to the creation and maintenance of data repositories when required.
• Promote and implement best practices in data governance and data management.
• Develop solutions within the enterprise data framework.
• Write technical specifications and design documentation.
• Develop and execute unit tests to ensure solution reliability.
• Participate in technical and architectural discussions and contribute to strategic data platform decisions.
• Support the continuous improvement of data architecture and engineering practices.
• Ensure timely delivery of development activities while maintaining high-quality standards.

Connaissances

Python

SQL

Git

ETL/ELT

Formation

Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field

Outils

Databricks

Apache Airflow

Description du poste

Everience Benelux is seeking a Senior Data Engineer to manage, integrate, and optimize data across upstream and downstream activities, focused on forecasting data. You will ensure data quality, accessibility, and governance across sources for stakeholders, analysts, and scientists.

Responsibilities include building ETL/ELT pipelines, data standardization, lineage documentation, and collaboration with architects and developers to drive data platform decisions and best practices.