Data Engineer Senior

ACENSI; Brussel; Sur place; EUR 90 000 - 120 000; Plein temps

Résumé du poste

ACENSI is seeking a Senior Data Engineer based in Brussels to develop within the data framework, write technical specifications, and implement unit tests. You will participate in architecture direction, promote data management best practices, and ensure timely deliveries with production monitoring.

Required skills include Python, PySpark, Databricks, and AWS, with preference for Airflow, Terraform, CI/CD, C#, and Azure DevOps expertise.

Qualifications

• The consultant(s) must have sound experience in the activities described, with high level analytical skills and rigour.
• Strong technical background in Python, Pyspark and Databricks is expected.
• Experience with AWS, data platforms and data management best practices is required.
• Knowledge of Airflow, Terraform and CI/CD practices is preferred.
• C# development experience and Azure DevOps (TFS or VSTS) familiarity are a plus.
• Experience with API testing tools like Postman or Insomnia is advantageous.

Responsabilités

• Develop within the data framework and produce technical specifications.
• Write unit tests and contribute to architecture direction.
• Ensure timely deliveries and monitor production deployments.
• Collaborate with multidisciplinary teams and communicate effectively with stakeholders.
• Deliver KPI dashboards, workload estimations and delivery documents.

Connaissances

Python

Pyspark

Databricks

AWS

Airflow

Terraform

CI/CD

C#

Azure DevOps

Postman

Insomnia

Outils

SQL

ETL

Spark

CI/CD pipelines

Description du poste

About The Job

:

Activities

• Develop within the data framework
• Write technical specifications
• Write Unit Test
• Participating to architecture direction
• Provide and Put in place the best practise around data management
• Ensure deliveries and respect deadlines
• Production Monitoring / Maintenance
• The consultant(s) put forward for this assignment must have sound experience in the activities described above, with high level analytical skills, rigour as well as a great ability to listen and communicate.
• Expected technical skills
• Technical skills required: (by order of priority for the assignment)
• Python V3
• Pyspark
• Databricks
• AWS
• Airflow (preferred)
• Terraform (preferred)
• CI / CD (preferred)
• C# (preferred)

About The Job

ACENSI is looking a Senior Data Engineer for one of their clients based in Brussels :

Activities

The Main Activities Are

• Develop within the data framework
• Write technical specifications
• Write Unit Test
• Participating to architecture direction
• Provide and Put in place the best practise around data management
• Ensure deliveries and respect deadlines
• Production Monitoring / Maintenance

Expected skills

General skills (soft skills)

• The consultant(s) put forward for this assignment must have sound experience in the activities described above, with high level analytical skills, rigour as well as a great ability to listen and communicate.
• Expected technical skills
• Technical skills required: (by order of priority for the assignment)
• Python V3
• Pyspark
• Databricks
• AWS
• Airflow (preferred)
• Azure DevOps (TFS or VSTS) (preferred)
• Terraform (preferred)
• Iomnia / Postman (preferred)
• CI / CD (preferred)
• C# (preferred)

Expected functional skills

• Solid understanding of relational databases (SQL) and data warehouses
• Experience with the Databricks platform, including creating and executing ETL tasks, managing Spark clusters, and optimizing SQL queries (preferred)
• Ability to collaborate with multidisciplinary teams and communicate effectively with stakeholders (preferred)
• Proactive problem-solving skills and the ability to work autonomously (preferred)
• Knowledge and skills in the energy market industry (preferred)
• Knowledge of portfolio management or risk management or Trading (preferred)
• Knowledge in the energy forecasting activities (preferred)
• Demonstrated ability to effectively understand customer requirements and deliver innovative solutions that those customer demands (preferred)
• Agile methodology (preferred)

Expected behavioural competencies

• Strong interpersonal skills with proven ability to interact with a wide variety of stakeholders, assimilate feedback and assess impact on your perimeter
• Comfortable with working in a fast-paced multidisciplinary environment while maintaining strict customer data privacy requirements
• Capacity to atomize and abstract topics to make them more generic
• Entrepreneurial spirit and creative approach to problem solving especially in Digital initiatives
• Uncompromising integrity and ethical standards

Expected deliverables

• Monthly Time Track
• Activity report
• KPI dashboard
• Estimation of the workload
• Documents on his/her delivery