Senior Databricks Engineer – Lakehouse Data Pipelines

Cronos Europa; Portugal; Híbrido; EUR 70 000 - 110 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Salary package

Work-life balance

Large-scale international platforms

Modern cloud technologies

Cutting-edge technologies

Resumo da oferta

Cronos Europa Portugal is recruiting two Senior Databricks Engineers to design, build, and operate data solutions on the Databricks Lakehouse Platform from Lisbon. You will take ownership of end-to-end data pipelines, use PySpark, Spark SQL, and Python, and work within an established data team.

The role requires 6+ years in data engineering, Databricks production experience, and strong cloud, governance, and CI/CD skills. Hybrid schedule with 3 days in the Lisbon office.

Qualificações

• Requires 6+ years of professional Data Engineering experience.
• Hands-on production Databricks experience.
• Strong PySpark, Spark SQL, and Delta Lake expertise.
• Experience with Python, SQL, Git, and CI/CD practices.
• Familiarity with Unity Catalog, data governance and lineage is a plus.
• Cloud exposure to Azure, AWS, or GCP is valued.

Responsabilidades

• Design, build, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
• Develop high-quality solutions using PySpark, Spark SQL, and Python.
• Design and optimize Delta Lake tables with partitioning and schema evolution.
• Implement layered data architectures (Raw, Cleansed, Curated).
• Build and manage workflows using Databricks Jobs, Workflows, and Delta Live Tables.
• Optimize Spark workloads and manage cluster configurations for cost efficiency.
• Implement logging, monitoring, alerting, and recovery mechanisms.
• Incorporate data quality controls across the pipeline lifecycle.
• Work with Unity Catalog for data governance and access control.
• Participate in code reviews and CI/CD-driven delivery practices.
• Collaborate in Agile ceremonies and produce design documentation.

Conhecimentos

Analytical thinking

Fluent English

Independent ownership

Problem solving

Formação académica

Bachelor's or Master's in CS/IT/Engineering

Ferramentas

Databricks

Apache Spark

PySpark

Spark SQL

Delta Lake

Python

SQL

Git

CI/CD

Unity Catalog

Descrição da oferta de emprego

Cronos Europa Portugal is recruiting two Senior Databricks Engineers to design, build, and operate data solutions on the Databricks Lakehouse Platform from Lisbon. You will take ownership of end-to-end data pipelines, use PySpark, Spark SQL, and Python, and work within an established data team.

The role requires 6+ years in data engineering, Databricks production experience, and strong cloud, governance, and CI/CD skills. Hybrid schedule with 3 days in the Lisbon office.