Data Engineer Senior

ACENSI; Brussel Hoofdstad; Sur place; EUR 75 000 - 110 000; Plein temps

Résumé du poste

ACENSI is looking for a Senior Data Engineer for a client based in Brussels. The role covers developing within the data framework, writing technical specifications, and creating unit tests.

You will participate in architecture direction and implement best practices around data management, ensuring on-time deliveries and production monitoring. The candidate should have strong Python, Pyspark, Databricks, AWS, and (preferred) Airflow, Terraform, CI/CD, and C# skills, with a solid understanding of

Qualifications

• Strong experience in the activities described, with high level analytical skills and rigour, plus a great ability to listen and communicate.
• Experience with Databricks platform, ETL tasks, Spark clusters, and SQL optimization is preferred.
• Knowledge of energy market portfolio/risk/trading and energy forecasting is a plus.
• Agile methodology experience is preferred.

Responsabilités

• Develop within the data framework.
• Write technical specifications.
• Write unit tests.
• Participate in architecture direction.
• Put in place best practices around data management.
• Ensure deliveries and respect deadlines.
• Production monitoring and maintenance.
• Collaborate with multidisciplinary teams and stakeholders.

Connaissances

Python

Pyspark

Databricks

AWS

Airflow

Terraform

CI/CD

C#

SQL

Description du poste

ACENSI is looking a Senior Data Engineer for one of their clients based in Brussels :

Activities

The main activities are:

• Develop within the data framework


• Write technical specifications


• Write Unit Test


• Participating to architecture direction


• Provide and Put in place the best practise around data management


• Ensure deliveries and respect deadlines


• Production Monitoring / Maintenance


• The consultant(s) put forward for this assignment must have sound experience in the activities described above, with high level analytical skills, rigour as well as a great ability to listen and communicate.


• Expected technical skills


• Technical skills required: (by order of priority for the assignment)


• Python V3


• Pyspark


• Databricks


• AWS


• Airflow (preferred)


• Terraform (preferred)


• CI / CD (preferred)


• C# (preferred)

Expected functional skills

• Solid understanding of relational databases (SQL) and data warehouses


• Experience with the Databricks platform, including creating and executing ETL tasks, managing Spark clusters, and optimizing SQL queries (preferred)


• Ability to collaborate with multidisciplinary teams and communicate effectively with stakeholders (preferred)


• Proactive problem-solving skills and the ability to work autonomously (preferred)


• Knowledge and skills in the energy market industry (preferred)


• Knowledge of portfolio management or risk management or Trading (preferred)


• Knowledge in the energy forecasting activities (preferred)


• Demonstrated ability to effectively understand customer requirements and deliver innovative solutions that those customer demands (preferred)


• Agile methodology (preferred)

Expected behavioural competencies

• Strong interpersonal skills with proven ability to interact with a wide variety of stakeholders, assimilate feedback and assess impact on your perimeter


• Comfortable with working in a fast-paced multidisciplinary environment while maintaining strict customer data privacy requirements


• Capacity to atomize and abstract topics to make them more generic


• Entrepreneurial spirit and creative approach to problem solving especially in Digital initiatives


• Uncompromising integrity and ethical standards