Senior Data Platform Engineer & Team Lead

Swift Software; Terhulpen; Sur place; EUR 70 000 - 90 000; Plein temps

Avantages offerts par ce poste

Inclusive workplace

Opportunities for global exposure

Résumé du poste

Swift Software is seeking a highly skilled Lead Data Engineer in Belgium to architect, develop, and maintain data pipelines. This role requires strong experience with Apache Airflow and Spark, along with leadership capabilities to guide a team of engineers.

The ideal candidate holds a Bachelor's or Master's degree and has over 10 years of experience in data engineering. Strong communication skills and proficiency in English are vital.

Qualifications

• 10+ years of experience in data engineering, big data, or analytics platforms.
• Strong hands-on experience with Apache Airflow, Apache Spark, Delta Lake, Cloudian S3 or S3-compatible object storage.
• Excellent communication skills in English, both written and spoken.

Responsabilités

• Design, develop, and maintain reliable, scalable, and efficient data pipelines.
• Orchestrate complex workflows using Apache Airflow.
• Collaborate with data analysts and business stakeholders to understand data requirements.

Connaissances

Apache Airflow

Apache Spark

Delta Lake

Cloudian S3

Java

Jira Xray

Python

Scala

Docker

Kubernetes

Formation

Bachelor’s or master’s degree in Computer Science, Engineering, Information Technology, or related field

Outils

Red Hat OpenShift

Description du poste

Swift Software is seeking a highly skilled Lead Data Engineer in Belgium to architect, develop, and maintain data pipelines. This role requires strong experience with Apache Airflow and Spark, along with leadership capabilities to guide a team of engineers.

The ideal candidate holds a Bachelor's or Master's degree and has over 10 years of experience in data engineering. Strong communication skills and proficiency in English are vital.