Senior Data Engineer: Databricks & Graph Platform (Hybrid)

Causeway Technologies; Lisboa; Hybrid; EUR 55,000 - 75,000; Full time

Benefits offered by this job

Work-life balance

Modern collaborative offices

Job summary

Causeway Technologies, based in Lisbon, is seeking a Senior Data Engineer to design and build our next-generation data platform. In this role, you'll be pivotal in creating a medallion pipeline, ensuring data quality across processes and collaborating with cross-functional teams to deliver exceptional outcomes.

The successful candidate will possess strong production experience in Databricks and be proficient in Python, PySpark, and SQL. We offer a hybrid working environment, emphasizing work-life balance and continuous personal development.

Qualifications

• Strong production experience on Databricks, Delta Lake, and Delta Live Tables.
• Deep proficiency in Python and PySpark for large-scale data processing.
• Advanced SQL capabilities for query planning and optimization.

Responsibilities

• Design and own ingestion into the bronze layer from various sources.
• Build and maintain the silver and gold medallion layers as Delta Live Tables.
• Monitor pipeline health and data quality metrics.

Skills

Databricks

Python

PySpark

SQL

PostgreSQL

Data transformation

Cloud storage (AWS, Azure, GCP)

Job description

Causeway Technologies, based in Lisbon, is seeking a Senior Data Engineer to design and build our next-generation data platform. In this role, you'll be pivotal in creating a medallion pipeline, ensuring data quality across processes and collaborating with cross-functional teams to deliver exceptional outcomes.

The successful candidate will possess strong production experience in Databricks and be proficient in Python, PySpark, and SQL. We offer a hybrid working environment, emphasizing work-life balance and continuous personal development.