Real-Time Data Engineer — Snowflake, Kafka & Cloud

Stott and May; Portugal; Híbrido; EUR 54 000 - 66 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

Mental health support

Professional development funding

Hybrid/Remote work

Resumo da oferta

Stott and May is seeking a Data Engineer to design, build and optimise data flows for a cloud-based platform. The role focuses on ingestion, transformation and modelling with Snowflake at the core and Kafka for real-time data capture.

You will work on KSQL/KStreams pipelines, data models in Snowflake and ensure data quality across the lifecycle, with hybrid/remote options and opportunities across Portugal.

Qualificações

• Solid commercial experience as a Data Engineer.
• Experience designing, building and optimising ELT/ETL pipelines.
• Strong SQL and Python or another scripting language.

Responsabilidades

• Design, build and maintain scalable ELT/ETL data pipelines within Snowflake.
• Implement data ingestion from various sources, including real-time streams using Kafka.
• Develop and deploy KSQL and KStreams pipelines for real-time processing.
• Develop efficient Snowflake data models for analytics.
• Ensure data quality, integrity and reliability across the data lifecycle.
• Optimise pipelines and Snowflake workloads for performance and scalability.
• Collaborate with architects, analysts and data scientists to deliver data solutions.
• Contribute to data engineering standards and best practices.

Conhecimentos

SQL

Python

Kafka

Airflow

Snowflake

CI/CD

Ferramentas

Snowflake

Kafka

KSQL

KStreams

Airflow

Confluent Schema Registry

Descrição da oferta de emprego

Stott and May is seeking a Data Engineer to design, build and optimise data flows for a cloud-based platform. The role focuses on ingestion, transformation and modelling with Snowflake at the core and Kafka for real-time data capture.

You will work on KSQL/KStreams pipelines, data models in Snowflake and ensure data quality across the lifecycle, with hybrid/remote options and opportunities across Portugal.