Data engineer

act digital EMEA - Alter Solutions; Brussel Hoofdstad; Sur place; EUR 65 000 - 90 000; Plein temps

Résumé du poste

act digital is seeking a Data Engineer to join our team and design end-to-end data pipelines on our cloud platform (AWS), processing data in the data lake and Snowflake. You will build data products for AI/ML, BI and data integration, working in agile teams to deliver tangible business value while following architectural and engineering best practices.

The role requires hands-on experience with the basics: SQL, data modelling (Data Vault), DBT, PySpark, Snowflake, Airflow, JSON/Parquet, and AWS

Qualifications

• Hands-on, proven experience with the basics: Advanced SQL, data modelling (including Data Vault) and building data pipelines.
• Proficient with DBT and PySpark for data pipeline development.
• Experience with Snowflake as a data warehouse and Airflow for orchestration.
• Familiar with JSON and Parquet formats, and AWS cloud services (S3, Glue, Athena, AppFlow, DMS, IAM).
• Knowledge of CI/CD and Git in an agile delivery environment.

Responsabilités

• Build and maintain robust data pipelines that integrate multiple data sources.
• Embed Data Governance by design to ensure data quality, consistency and compliance
• Align with data architecture principles and contribute to Data Product design.
• Collaborate with cross-functional teams to deliver data products within various use cases.
• Contribute to implementing our Data landscape and Data Product architecture.

Connaissances

Advanced SQL

Data modelling

Data Vault modelling

DBT

PySpark

Snowflake

Airflow

JSON

Parquet

AWS

S3

Glue

Athena

AppFlow

DMS

IAM

CI/CD

Git

Outils

DBT

PySpark

Snowflake

Airflow

AWS

S3

Glue

Athena

AppFlow

DMS

IAM

CI/CD

Git

Description du poste

act digital is an international consulting and engineering group that supports its clients in their digital transformation projects.

Present in 12 countries and with more than 6,000 employees, we leverage our expertise to address their challenges in software development, cybersecurity, data, cloud, and AI.

Our ambition: to become the trusted technology partner of the most innovative companies, by designing and securing systems that enhance their performance and resilience.

Joining act digital means becoming part of an agile and committed organization that works closely with its clients to turn ideas into concrete results, with pragmatism and high standards.

Job Description :

You will join our team of experts in data engineering. The data engineer works mainly on the engineering of (batch or near-realtime) end-to-end data pipelines on our cloud-based data platform (AWS), processing data in(to) the data lake and or warehouse (Snowflake). Data is processed to build domain-oriented data products for AI/ML, BI and data integration use cases. You'll be part of agile, business-oriented scrum teams delivering tangible business value while respecting architectural and engineering best practices.

Your responsibilities will include:

• Build and maintain robust data pipelines that integrate multiple data sources.
• Embed Data Governance by design to ensure data quality, consistency and compliance
• Align with our data architectural principles and contribute to the implementation of our Data Product architecture.
• Collaborate with business oriented and cross-functional teams and focus on delivering new data products in scope of different use cases/projects in line with Business priorities
• Contribute to the implementation of our Data landscape and Data Product architecture

Profile / Requirements :

What profile are we looking for this position:

Must-have skills :

Hands-on, proven experience with ("the basics"):

• Advanced SQL
• Data modelling, dimensional modelling, Data Vault modelling (strong experience required)
• Building data pipelines with DBT & PySpark
• Snowflake
• Airflow
• JSON, Parquet
• Data processing in an AWS cloud environment: AWS services (S3, Glue, Athena, AppFlow, DMS, …) & IAM
• Agile delivery, CI/CD, Git

Experience with, notions of or profound interest in ("nice to have"):

• Qlik
• Data ingestion (e.g. CDC, API, ...)
• Apache Kafka
• Apache Iceberg
• Event-based data processing
• Data product architectures
• Data quality metrics
• Data catalogue, data lineage tooling (e.g. DataHub)

Fluent in English (verbal and in writing), Dutch or French optional.