Senior DataOps Engineer: Data Platform & Pipelines Lead

Connect Digital; Portugal; Presencial; EUR 29 000 - 34 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Flexible benefits package

Extra day off on your birthday

One additional day off on 24 or 31 Dec

Resumo da oferta

Connect Digital is seeking a senior data engineer with 5+ years of experience to design and implement data pipelines and platform tooling. You will model data in dimensional and lakehouse structures, develop in Python with exposure to Scala/Java/Go, and own CI/CD and IaC pipelines on AWS.

You will work across streaming and batch processing, leveraging Airflow, Spark/Flink, and event-driven architectures, with Redshift/Snowflake data warehouses and observability dashboards.

Qualificações

• 5+ years in data engineering with DevOps/platform exposure.
• Proficient in relational and dimensional data modelling.

Responsabilidades

• Strong SQL and data modelling across dimensional/ lakehouse architectures.
• Proficient in Python; working knowledge of Scala, Java, or Go.
• Hands-on data pipelines with Airflow or DBT; experience with Spark or Flink.
• Experience with distributed processing frameworks (Spark/Flink).
• Advanced AWS experience (Glue/EMR/Redshift/Athena/S3) and CI/CD (GitHub Actions, Jenkins).
• Infrastructure as Code (CDK/CloudFormation) and event-driven architectures (Kafka/Kinesis).
• Observability with Grafana and CloudWatch; data warehouse proficiency in Redshift/Snowflake.

Descrição da oferta de emprego

Connect Digital is seeking a senior data engineer with 5+ years of experience to design and implement data pipelines and platform tooling. You will model data in dimensional and lakehouse structures, develop in Python with exposure to Scala/Java/Go, and own CI/CD and IaC pipelines on AWS.

You will work across streaming and batch processing, leveraging Airflow, Spark/Flink, and event-driven architectures, with Redshift/Snowflake data warehouses and observability dashboards.