Data Engineer Service (SRQ109730)

TiTANS Consulting; Brussel Hoofdstad; Hybride; EUR 75 000 - 110 000; Plein temps

Avantages offerts par ce poste

Hybrid work model

Challenging energy sector project

Résumé du poste

Elia Group is seeking a Data Engineer to join our Data Organization and help build and optimize data pipelines and storage structures across European energy platforms. You will work in a product-team setup and interact with analysts to refine requirements while contributing to testing and documentation.

Ideal candidates have 3–5 years of hands-on experience with data engineering in Azure Databricks environments, and are eager to learn new technologies and collaborate within a flat, open-source

Qualifications

• Proven experience in building data pipelines and data storage structures.
• Experience with Azure data services and Databricks.
• Ability to work with business analysts and contribute to testing and documentation.

Responsabilités

• Collaborate with product teams to translate requirements into scalable data solutions.
• Develop and maintain data pipelines, storage structures, and analytic data models.
• Contribute to governance tooling and data quality initiatives.

Connaissances

SQL Server

Azure Databricks

Python

Data pipelines

Outils

Azure Data Factory

Azure Functions

Azure Stream Analytics

Azure DevOps

Redis

RabbitMQ

Neo4j

Apache Arrow

Description du poste

Excited to work on a project for a key player in the energy landscape? The Belgian, German and European energy landscape is in full swing. Did you know that Elia Group plays a crucial role in this?

As part of Elia Group, a European transmission system operator, Elia Belgium and 50Hertz in Germany ensures the reliability and sustainability of the electricity supply in both countries. Side-by-side with other Contingent Workers and internal staff, you will play a part in building a sustainable, green and reliable energy infrastructure that stimulates economic growth and reduces our ecological footprint. Only together can we make the biggest impact possible! We believe in the power of diversity: we are convinced that an inclusive and diverse work environment leads to more innovation, creativity and better results.

Within the corporate Digital & Data department, we aim at facilitating and driving our organization to leverage data. At Elia, data is considered as a major asset for the business to achieve its targets (strategic ambitions, innovation or transformation themes, objectives and regulatory compliance).

With our Data Platform consisting out of:

• Cutting-edge Integration Toolset,
• Business Intelligence, Analytics and storage capabilities,
• A platform for the Management of Master Data,
• A Data Governance platform that encompasses Data Lineage and Data Quality.

With our Data Organization consisting out of:

• Business Product Teams (supporting the business stakeholder initiatives, organized according to the Agile principles)
• Backbone/Platform Teams (supporting the data platform initiatives, organized according to the Agile principles)
• Transversal competencies Team (supporting the various profiles and technologies initiatives, organized according to the Agile principles (Spotify))

Our Data Organization never stands still: No status-quo! Accordingly, we challenge ourselves and the organization continuously. We work in quite flat hierarchy, with our teammates widespread in agile teams, and according to the principle of open source.

We are looking for a Data Engineer Service, who will primarily join one of our product Teams. It is an opportunity to mark with your signature our corporate Data organization and contribute indirectly to better product to manage our customer, as more qualitative data or service around data for our customer.

We are looking for Data Engineers able to create data pipelines, efficient storage structures, powerful materialized views in different analytical technologies, but also data exchange endpoints at destination of our users. To some extent, you’ll also have to interact with aspect related to governance tools (Glossary, Modeling, Lineage, or Data Quality…)

What will be your mission and for which competences will you need an Extensive hands-on experience (> 3 to 5 years preferable) in 2 out of the 4 following categories:

• Usage of the SQL server
• Implementing data pipelines using Azure services such as Azure Databricks, but also to some extent Azure Data Factory, Azure Functions, Azure Stream/log Analytics, and Azure DevOps
• Implementing data pipelines or data enrichments with Python in a Databricks environment
• Open to learn and jump on new technologies (on the ones listed above, or also Redis, RabbitMQ, Neo4j, or Apache Arrow, …)

• Able and willing to interact with business analysts and stakeholders to refine some requirements and to present reusable and integrated solution
• Able and willing to contribute to extensive testing of the solution, as the reinforcement of devops principles within the team.
• Able and willing to contribute to the writing and structuration of documentation

What you will NOT be doing

• You shall not act from an Ivory Technical Tower.
• You don’t not make decisions for the Business but rather advise them with careful logic or showing your reasoning.
• You shall not deliver technical solution, rather product features.

Requirements:

• Able to challenge your interlocutors by leveraging your rational thinking, and no non-sense philosophy.
• Continuously look at data in a transversal way (no siloes), across the entire Enterprise, to maximize coherence, reuse and adoption.
• Track record of driving results through continuous improvement
• Customer-oriented
• Thinking Iterative
• Analytical approach to problem-solving and a track record of driving results through continuous improvement
• Team player breathing respect, open-mind, dare, challenge, innovation and one team/voice for the Customer
• Product-oriented mindset
• Enjoy sharing ideas with the team (or with other teams) and contribute to the product success
• Language skills: fluent in English (must have) AND fluent in German/French or Dutch (soft requirement)

Additional information:

• Location: 2days/week Brussels and 3days/week remote (after training)
• Important: if the consultant will work in Belgium, for non-EU candidates, please present candidates who comply with the following criteria:
• Possess a work permit allowing the individual to work in Belgium.
• Hold a valid residence permit confirming the right of residence in Belgium.
• Please note that the local conditions apply depending on where the PO will be created.
• For a PO created at Elia Transmission Belgium / Elia Asset, the General Purchasing Conditions ELIA 01.09.2015 apply. These can be found on our website.
• The General Purchasing terms and Conditions for external parties (Contracting) as of July 2019, shall apply in addition to the above conditions.
• For a PO created at 50Hertz, the Elia Group General Purchasing Conditions – short version, as of Jul-21 apply. The Specific Purchasing Conditions Short version Germany as of Jul-21 shall also apply in addition to the above conditions. These can be found on our website.
• Please note that ELIA/ 50Hertz at all times need to maintain the flexibility to switch location of PO. In case of a change, the local tender process must be respected.

What makes this mission attractive?

• An interesting project at the reference within the energy sector: Elia Group encourages innovation and collaboration. Within our company you will be at the forefront of the energy transition, and you will have the chance to contribute to ground-breaking technologies designed to accelerate this transition. It is a one-of-a-kind opportunity to demonstrate your skills and develop further your competences within this project.
• Focus on well-being at work: we put maximum effort into a positive work culture in which your well-being is central.
• A diverse team of co-workers: Elia Group puts a high value on diversity and inclusion. You will join a diverse and passionate team that enjoys sharing knowledge and leading the way towards a more sustainable future together.

We are convinced that your contribution to our team will be invaluable and look forward to welcoming you soon!