Cloud DataOps Engineer: Build Scalable Data Pipelines

act digital; Lisboa; Presencial; EUR 52 000 - 76 000; Tempo integral

Resumo da oferta

act digital is seeking an experienced Data Engineer to join an international project in Lisbon, contributing to a modern, cloud-based data ecosystem. You will design scalable data pipelines and robust data platforms, driving data quality and performance across teams.

key requirements include 3+ years in data engineering, strong SQL and Python, expertise in Airflow/DBT, and hands-on with AWS and modern data warehouses such as Snowflake or Redshift.

Qualificações

• 3+ years of Data Engineering experience with cloud platforms.
• Strong SQL and data modelling skills across dimensional, normalized and lakehouse architectures.
• Proficient in Python; knowledge of Scala/Java/Go is a plus.
• Hands-on with Airflow and DBT for orchestration and transformation.
• Experience with distributed processing frameworks like Spark or Flink.
• Advanced AWS knowledge (Glue, EMR, Redshift, Athena, S3, Lambda, Kinesis).
• Experience with CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins, CircleCI).
• Understanding of IaC using CDK/CloudFormation.
• Experience with streaming/event-driven architectures (Kafka, Pub/Sub).
• Knowledge of monitoring with Grafana/CloudWatch and data warehousing (Redshift/Snowflake).

Responsabilidades

• Build scalable data pipelines within a modern cloud-based data ecosystem.
• Design robust data platforms and dimensional/ lakehouse models.
• Collaborate across DevOps, Platform Engenharia and data teams to deliver reliable data services.

Conhecimentos

Data engineering

SQL

Python

DevOps

AWS

Spark

Flink

Airflow

DBT

CI/CD

IaC

Kafka

Monitoring

Ferramentas

Apache Airflow

DBT

GitHub Actions

GitLab CI

Jenkins

CircleCI

Terraform

CDK

CloudWatch

Grafana

Snowflake

Amazon Redshift

Kafka

Descrição da oferta de emprego

act digital is seeking an experienced Data Engineer to join an international project in Lisbon, contributing to a modern, cloud-based data ecosystem. You will design scalable data pipelines and robust data platforms, driving data quality and performance across teams.

key requirements include 3+ years in data engineering, strong SQL and Python, expertise in Airflow/DBT, and hands-on with AWS and modern data warehouses such as Snowflake or Redshift.