Senior Data Engineer: Databricks & Graph Platform (Hybrid)

Causeway Technologies; Lisboa; Híbrido; EUR 55 000 - 75 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Work-life balance

Modern collaborative offices

Resumo da oferta

Causeway Technologies, based in Lisbon, is seeking a Senior Data Engineer to design and build our next-generation data platform. In this role, you'll be pivotal in creating a medallion pipeline, ensuring data quality across processes and collaborating with cross-functional teams to deliver exceptional outcomes.

The successful candidate will possess strong production experience in Databricks and be proficient in Python, PySpark, and SQL. We offer a hybrid working environment, emphasizing work-life balance and continuous personal development.

Qualificações

• Strong production experience on Databricks, Delta Lake, and Delta Live Tables.
• Deep proficiency in Python and PySpark for large-scale data processing.
• Advanced SQL capabilities for query planning and optimization.

Responsabilidades

• Design and own ingestion into the bronze layer from various sources.
• Build and maintain the silver and gold medallion layers as Delta Live Tables.
• Monitor pipeline health and data quality metrics.

Conhecimentos

Databricks

Python

PySpark

SQL

PostgreSQL

Data transformation

Cloud storage (AWS, Azure, GCP)

Descrição da oferta de emprego

Causeway Technologies, based in Lisbon, is seeking a Senior Data Engineer to design and build our next-generation data platform. In this role, you'll be pivotal in creating a medallion pipeline, ensuring data quality across processes and collaborating with cross-functional teams to deliver exceptional outcomes.

The successful candidate will possess strong production experience in Databricks and be proficient in Python, PySpark, and SQL. We offer a hybrid working environment, emphasizing work-life balance and continuous personal development.