Senior Data Engineer | Python, Spark & Databricks

ACENSI; Brussel; Sur place; EUR 90 000 - 120 000; Plein temps

Résumé du poste

ACENSI is seeking a Senior Data Engineer based in Brussels to develop within the data framework, write technical specifications, and implement unit tests. You will participate in architecture direction, promote data management best practices, and ensure timely deliveries with production monitoring.

Required skills include Python, PySpark, Databricks, and AWS, with preference for Airflow, Terraform, CI/CD, C#, and Azure DevOps expertise.

Qualifications

• The consultant(s) must have sound experience in the activities described, with high level analytical skills and rigour.
• Strong technical background in Python, Pyspark and Databricks is expected.
• Experience with AWS, data platforms and data management best practices is required.
• Knowledge of Airflow, Terraform and CI/CD practices is preferred.
• C# development experience and Azure DevOps (TFS or VSTS) familiarity are a plus.
• Experience with API testing tools like Postman or Insomnia is advantageous.

Responsabilités

• Develop within the data framework and produce technical specifications.
• Write unit tests and contribute to architecture direction.
• Ensure timely deliveries and monitor production deployments.
• Collaborate with multidisciplinary teams and communicate effectively with stakeholders.
• Deliver KPI dashboards, workload estimations and delivery documents.

Connaissances

Python

Pyspark

Databricks

AWS

Airflow

Terraform

CI/CD

C#

Azure DevOps

Postman

Insomnia

Outils

SQL

ETL

Spark

CI/CD pipelines

Description du poste

ACENSI is seeking a Senior Data Engineer based in Brussels to develop within the data framework, write technical specifications, and implement unit tests. You will participate in architecture direction, promote data management best practices, and ensure timely deliveries with production monitoring.

Required skills include Python, PySpark, Databricks, and AWS, with preference for Airflow, Terraform, CI/CD, C#, and Azure DevOps expertise.