Data Engineer Databricks

Degetel; Belgique; Sur place; EUR 65 000 - 95 000; Plein temps

Résumé du poste

Degetel in Brussels is seeking a Data Engineer to design and maintain scalable data pipelines on the Databricks platform. You will manage ingestion from multiple sources, implement ETL, and ensure data quality and security across pipelines.

You will monitor performance, troubleshoot issues, and document processes and best practices for knowledge transfer to the team taking over platform operations.

Qualifications

• Bachelor's degree in Computer Science or related field.
• Experience building data pipelines and ETL processes.
• Knowledge of Databricks and Spark is preferred.

Responsabilités

• Design, implement, and maintain scalable data pipelines on Databricks.
• Manage data ingestion from diverse sources and ensure data quality.
• Implement and optimize ETL processes for performance and reliability.
• Monitor pipeline performance and troubleshoot issues.
• Document processes, specs and best practices for the team.
• Transfer knowledge to teammates for ongoing operations.

Connaissances

Databricks

ETL

Data pipelines

SQL

Formation

Bachelor's degree in Computer Science

Outils

Spark

Airflow

Description du poste

Data Engineer Databricks - Brussels

Implement, design, build and maintain scalable data pipelines on Databricks.

Responsibilities

• Manage data ingestion from various sources
• Implement and optimize ETL processes
• Ensure data quality, integrity and security across pipelines
• Monitor and troubleshoot pipeline performance
• Document processes, technical specs and best practices
• Transfer knowledge to the team that will take over running the platform

Qualifications

• Bachelor's degree in Computer Science, E...