Data Engineer: Build Scalable Pipelines & AI Data Products

act digital EMEA - Alter Solutions; Brussel Hoofdstad; Sur place; EUR 65 000 - 90 000; Plein temps

Résumé du poste

act digital is seeking a Data Engineer to join our team and design end-to-end data pipelines on our cloud platform (AWS), processing data in the data lake and Snowflake. You will build data products for AI/ML, BI and data integration, working in agile teams to deliver tangible business value while following architectural and engineering best practices.

The role requires hands-on experience with the basics: SQL, data modelling (Data Vault), DBT, PySpark, Snowflake, Airflow, JSON/Parquet, and AWS

Qualifications

• Hands-on, proven experience with the basics: Advanced SQL, data modelling (including Data Vault) and building data pipelines.
• Proficient with DBT and PySpark for data pipeline development.
• Experience with Snowflake as a data warehouse and Airflow for orchestration.
• Familiar with JSON and Parquet formats, and AWS cloud services (S3, Glue, Athena, AppFlow, DMS, IAM).
• Knowledge of CI/CD and Git in an agile delivery environment.

Responsabilités

• Build and maintain robust data pipelines that integrate multiple data sources.
• Embed Data Governance by design to ensure data quality, consistency and compliance
• Align with data architecture principles and contribute to Data Product design.
• Collaborate with cross-functional teams to deliver data products within various use cases.
• Contribute to implementing our Data landscape and Data Product architecture.

Connaissances

Advanced SQL

Data modelling

Data Vault modelling

DBT

PySpark

Snowflake

Airflow

JSON

Parquet

AWS

S3

Glue

Athena

AppFlow

DMS

IAM

CI/CD

Git

Outils

DBT

PySpark

Snowflake

Airflow

AWS

S3

Glue

Athena

AppFlow

DMS

IAM

CI/CD

Git

Description du poste

act digital is seeking a Data Engineer to join our team and design end-to-end data pipelines on our cloud platform (AWS), processing data in the data lake and Snowflake. You will build data products for AI/ML, BI and data integration, working in agile teams to deliver tangible business value while following architectural and engineering best practices.

The role requires hands-on experience with the basics: SQL, data modelling (Data Vault), DBT, PySpark, Snowflake, Airflow, JSON/Parquet, and AWS