Data Engineer: Spark Pipelines & AI-Driven Analytics

PassFort; Brussel Hoofdstad; Sur place; EUR 50 000 - 70 000; Plein temps

Résumé du poste

PassFort is looking for a Data Engineer to develop scalable data pipelines and ETL workflows, primarily using Apache Spark and Databricks in a cloud environment. You will be part of a team that works on large-scale data challenges, collaborating with cross-functional teams to deliver high-quality data solutions.

A Bachelor's or Master's in Computer Science or a related field is required, along with practical experience in building data applications.

Qualifications

• Experience building scalable data applications using Apache Spark.
• Hands-on experience with Databricks in a cloud environment.
• Good understanding of distributed computing and performance optimisation.

Responsabilités

• Support the design and development of Spark-based data pipelines.
• Build and maintain ETL workflows ingesting data from Delta Lake and S3.
• Document data flows and technical solutions.

Connaissances

Scalable data applications using Apache Spark

Databricks in AWS

SQL for data transformation

Graph data structures

Version control with Git

Analytical skills

Communication skills

Formation

Bachelor’s or Master’s degree in Computer Science or Information Technology

Outils

Apache Spark

Databricks

Git

Description du poste

PassFort is looking for a Data Engineer to develop scalable data pipelines and ETL workflows, primarily using Apache Spark and Databricks in a cloud environment. You will be part of a team that works on large-scale data challenges, collaborating with cross-functional teams to deliver high-quality data solutions.

A Bachelor's or Master's in Computer Science or a related field is required, along with practical experience in building data applications.