Lead Java Developer

Swift Software; Terhulpen; Sur place; EUR 70 000 - 90 000; Plein temps

Avantages offerts par ce poste

Inclusive workplace

Opportunities for global exposure

Résumé du poste

Swift Software is seeking a highly skilled Lead Data Engineer in Belgium to architect, develop, and maintain data pipelines. This role requires strong experience with Apache Airflow and Spark, along with leadership capabilities to guide a team of engineers.

The ideal candidate holds a Bachelor's or Master's degree and has over 10 years of experience in data engineering. Strong communication skills and proficiency in English are vital.

Qualifications

• 10+ years of experience in data engineering, big data, or analytics platforms.
• Strong hands-on experience with Apache Airflow, Apache Spark, Delta Lake, Cloudian S3 or S3-compatible object storage.
• Excellent communication skills in English, both written and spoken.

Responsabilités

• Design, develop, and maintain reliable, scalable, and efficient data pipelines.
• Orchestrate complex workflows using Apache Airflow.
• Collaborate with data analysts and business stakeholders to understand data requirements.

Connaissances

Apache Airflow

Apache Spark

Delta Lake

Cloudian S3

Java

Jira Xray

Python

Scala

Docker

Kubernetes

Formation

Bachelor’s or master’s degree in Computer Science, Engineering, Information Technology, or related field

Outils

Red Hat OpenShift

Description du poste

About the role

We are seeking a highly skilled Lead Data Engineer to architect, develop and maintain business use‑cases. The ideal candidate will have extensive experience with Airflow, Spark, Starburst, Delta Lake and S2, and a strong background in testing and quality assurance using Jira XRay. This role requires leadership capabilities to guide a team of engineers and collaborate closely with business analysts, platform, and business stakeholders. The squad is based in both Malaysia (Kuala Lumpur) and Belgium (La Hulpe).

Key responsibilities

• Design, develop, and maintain reliable, scalable, and efficient data pipelines.
• Apply Medallion Architecture (Bronze, Silver, Gold) principles.
• Orchestrate complex workflows using Apache Airflow.
• Develop distributed data processing jobs using Apache Spark.
• Implement object storage solutions with Cloudian S3 for data lake architectures.
• Build and manage Delta tables with schema enforcement and evolution.
• Optimize data access and querying using Starburst/Trino.
• Ensure high data quality by adopting testing frameworks and writing automated tests with Jira XRay.
• Ensure high availability, fault tolerance, and performance of data platforms.
• Collaborate with data analysts and business stakeholders to understand data requirements.
• Implement data quality checks, monitoring, and alerting mechanisms.
• Enforce data governance, security, and compliance standards.
• Participate in technical design discussions and contribute to architectural decisions.
• Mentor junior engineers and promote engineering best practices.
• Participate in on‑call support and incident management when required.

Required qualifications

• Bachelor’s or master’s degree in Computer Science, Engineering, Information Technology, or related field.
• 10+ years of experience in data engineering, big data, or analytics platforms.
• Strong hands‑on experience with Apache Airflow, Apache Spark, Delta Lake, Cloudian S3 or S3‑compatible object storage, Starburst/Trino, Red Hat OpenShift.
• Proficiency in Java is a must.
• Experience in testing and quality assurance using Jira Xray is a huge plus.
• Experience with Python/Scala is an advantage.
• Experience with containerization and orchestration (Docker, Kubernetes, OpenShift) is a plus.
• Familiarity with CI/CD pipelines and DevOps practices.
• Solid understanding of data modelling, data warehousing, and data lake architecture.
• Experience working with large‑scale, high‑volume, and high‑velocity data systems.
• Strong analytical, communication, and presentation skills, with excellent English, both written and spoken.
• Team player with strong interpersonal skills, willing to work in a multicultural environment and able to lead, coach and groom other team members.
• Adaptability and responsiveness to change.

What we offer

We give you the freedom to be yourself and an environment that values diverse perspectives. We are committed to an inclusive and accessible recruitment process. If you require a reasonable accommodation related to accessibility during your application or interview, please contact accessibility‑[e-mail]. All requests are confidential and will not affect your candidacy. This mailbox is not monitored for general recruitment enquiries and should only be used for accessibility or accommodation‑related requests.

At Swift, we are dedicated to building a workplace where people can bring their full selves and ideas to the team. We offer unparalleled exposure to knowledge, expertise and technologies, and opportunities to work in teams, departments and disciplines across the world.