Data Engineer Senior

ACENSI; Brussel; Sur place; EUR 80 000 - 120 000; Plein temps

Résumé du poste

ACENSI is looking for a Senior Data Engineer based in Brussels to join a client project. You will develop within the data framework, write technical specifications, and contribute to architecture direction.

Responsibilities include writing unit tests, implementing data management best practices, ensuring on-time deliveries, and production monitoring/maintenance. Strong skills in Python, PySpark, Databricks, AWS, and CI/CD are expected.

Qualifications

• Experience with data engineering activities and data management best practices.
• Strong knowledge of relational databases (SQL) and data warehouses.
• Experience with Databricks platform, ETL tasks, Spark clusters, and SQL optimization.
• Ability to collaborate with multidisciplinary teams and communicate with stakeholders.
• Proactive problem-solving and autonomous work style.

Responsabilités

• Develop within the data framework and write technical specifications.
• Write Unit Tests and participate in architecture direction.
• Provide and implement best practices around data management.
• Ensure deliveries on time and monitor production.

Connaissances

Python V3

Pyspark

Databricks

AWS

Airflow

Azure DevOps

Terraform

Insomnia

Postman

CI / CD

C#

SQL

Outils

Databricks

Insomnia

Postman

Terraform

Description du poste

ACENSI is looking a Senior Data Engineer for one of their clients based in Brussels :

Activities

The main activities are:

• Develop within the data framework
• Write technical specifications
• Write Unit Test
• Participating to architecture direction
• Provide and Put in place the best practise around data management
• Ensure deliveries and respect deadlines
• Production Monitoring / Maintenance

Expected skills

General skills (soft skills)

• The consultant(s) put forward for this assignment must have sound experience in the activities described above, with high level analytical skills, rigour as well as a great ability to listen and communicate.
• Expected technical skills
• Technical skills required: (by order of priority for the assignment)
• Python V3
• Pyspark
• Databricks
• AWS
• Airflow (preferred)
• Azure DevOps (TFS or VSTS) (preferred)
• Terraform (preferred)
• Iomnia / Postman (preferred)
• CI / CD (preferred)
• C# (preferred)

Expected functional skills

• Solid understanding of relational databases (SQL) and data warehouses
• Experience with the Databricks platform, including creating and executing ETL tasks, managing Spark clusters, and optimizing SQL queries (preferred)
• Ability to collaborate with multidisciplinary teams and communicate effectively with stakeholders (preferred)
• Proactive problem-solving skills and the ability to work autonomously (preferred)
• Knowledge and skills in the energy market industry (preferred)
• Knowledge of portfolio management or risk management or Trading (preferred)
• Knowledge in the energy forecasting activities (preferred)
• Demonstrated ability to effectively understand customer requirements and deliver innovative solutions that those customer demands (preferred)
• Agile methodology (preferred)

Expected behavioural competencies

• Strong interpersonal skills with proven ability to interact with a wide variety of stakeholders, assimilate feedback and assess impact on your perimeter
• Comfortable with working in a fast-paced multidisciplinary environment while maintaining strict customer data privacy requirements
• Capacity to atomize and abstract topics to make them more generic
• Entrepreneurial spirit and creative approach to problem solving especially in Digital initiatives
• Uncompromising integrity and ethical standards

Expected deliverables

• Monthly Time Track
• Activity report
• KPI dashboard
• Estimation of the workload
• Documents on his/her delivery