DataOps Engineer

act digital; Lisboa; Presencial; EUR 52 000 - 76 000; Tempo integral

Resumo da oferta

act digital is seeking an experienced Data Engineer to join an international project in Lisbon, contributing to a modern, cloud-based data ecosystem. You will design scalable data pipelines and robust data platforms, driving data quality and performance across teams.

key requirements include 3+ years in data engineering, strong SQL and Python, expertise in Airflow/DBT, and hands-on with AWS and modern data warehouses such as Snowflake or Redshift.

Qualificações

• 3+ years of Data Engineering experience with cloud platforms.
• Strong SQL and data modelling skills across dimensional, normalized and lakehouse architectures.
• Proficient in Python; knowledge of Scala/Java/Go is a plus.
• Hands-on with Airflow and DBT for orchestration and transformation.
• Experience with distributed processing frameworks like Spark or Flink.
• Advanced AWS knowledge (Glue, EMR, Redshift, Athena, S3, Lambda, Kinesis).
• Experience with CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins, CircleCI).
• Understanding of IaC using CDK/CloudFormation.
• Experience with streaming/event-driven architectures (Kafka, Pub/Sub).
• Knowledge of monitoring with Grafana/CloudWatch and data warehousing (Redshift/Snowflake).

Responsabilidades

• Build scalable data pipelines within a modern cloud-based data ecosystem.
• Design robust data platforms and dimensional/ lakehouse models.
• Collaborate across DevOps, Platform Engenharia and data teams to deliver reliable data services.

Conhecimentos

Data engineering

SQL

Python

DevOps

AWS

Spark

Flink

Airflow

DBT

CI/CD

IaC

Kafka

Monitoring

Ferramentas

Apache Airflow

DBT

GitHub Actions

GitLab CI

Jenkins

CircleCI

Terraform

CDK

CloudWatch

Grafana

Snowflake

Amazon Redshift

Kafka

Descrição da oferta de emprego

We are looking for an experienced Data Engineer to join an international project, working within a modern cloud-based data ecosystem. This is an excellent opportunity for professionals passionate about building scalable data platforms, designing robust pipelines, and working with cutting-edge technologies in a collaborative environment.

Key Requirements

• 3+ years of experience in Data Engineering, with exposure to DevOps and Platform Engineering practices.
• Strong expertise in SQL and data modelling, including dimensional, normalized, and lakehouse architectures.
• Solid programming skills in Python; knowledge of Scala, Java, or Go is a plus.
• Hands-on experience with data orchestration and transformation tools such as Apache Airflow and DBT.
• Experience working with distributed data processing frameworks such as Apache Spark, Apache Flink, or similar technologies.
• Advanced knowledge of AWS, including services such as Glue, EMR, Redshift, Athena, S3, Lambda, and Kinesis.
• Experience with CI/CD pipelines using tools such as GitHub Actions, GitLab CI, Jenkins, or CircleCI.
• Strong understanding of Infrastructure as Code (IaC) using CDK and CloudFormation.
• Experience with streaming and event-driven architectures using technologies such as Kafka, Kinesis, Flink, or Pub/Sub.
• Knowledge of monitoring and observability tools, including Grafana and CloudWatch.
• Experience with modern data warehouse platforms such as Amazon Redshift and Snowflake.