Senior Data Engineer: Scalable Pipelines, PySpark & AWS

Ubique Systems; Brussel Hoofdstad; Sur place; EUR 70 000 - 100 000; Plein temps

Résumé du poste

Ubique Systems is seeking a Senior Data Engineer to design scalable data pipelines using Python, PySpark, Databricks, and AWS. The candidate will transform and validate data, ensure quality, and support production data platforms.

The role involves building ETL/ELT processes, developing workflows with Apache Airflow, and collaborating on data architecture and CI/CD pipelines using Azure DevOps/TFS, with Terraform for infra as code.

Qualifications

• Senior Data Engineer with hands-on experience in Python, PySpark, Databricks, and AWS.
• Develop scalable data pipelines and transform structured/unstructured data.
• Ensure data quality and support production data platforms.

Responsabilités

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Ingest, integrate, map, cleanse, transform, and validate data.
• Develop data processing solutions using Python, PySpark, and Databricks.

Connaissances

Python

PySpark

Databricks

AWS

Apache Airflow

Terraform

Azure DevOps

CI/CD pipelines

Outils

Terraform

Apache Airflow

Azure DevOps

Description du poste

Ubique Systems is seeking a Senior Data Engineer to design scalable data pipelines using Python, PySpark, Databricks, and AWS. The candidate will transform and validate data, ensure quality, and support production data platforms.

The role involves building ETL/ELT processes, developing workflows with Apache Airflow, and collaborating on data architecture and CI/CD pipelines using Azure DevOps/TFS, with Terraform for infra as code.