Senior Databricks Engineer - Remote Data Platform Leader

Cronos Europa; Lisboa; Presencial; EUR 65 000 - 100 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Tailor-made training

Good work-life balance

International team

Resumo da oferta

Cronos Europa Portugal is recruiting two Senior Databricks Engineers to design, build, and operate data solutions on the Databricks Lakehouse Platform from Lisbon. You will own end-to-end data pipelines and production deployments in an international, fully remote team.

The role requires hands-on expertise with Spark, PySpark, Delta Lake, and Python/SQL, plus experience in CI/CD, Git, and data governance. English communication and autonomy are essential for success.

Qualificações

• Minimum 6 years of professional experience in Data Engineering.
• Hands-on Databricks production experience.
• Strong expertise in Apache Spark, PySpark, and Spark SQL.
• Proven experience with Delta Lake.
• Advanced Python and SQL skills.
• Experience designing, deploying, and supporting production-grade data pipelines.
• Experience with Git and CI/CD practices.
• Knowledge of Databricks Workflows, Jobs, and Delta Live Tables.
• Experience with Unity Catalog, governance, and data lineage is an asset.
• Cloud experience with Azure, AWS, and/or GCP is highly valued.
• Knowledge of Terraform, Databricks Asset Bundles, dbt, or Airflow is a plus.
• Databricks certifications (Data Engineer Associate or Professional) are an advantage.

Responsabilidades

• Design, build, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
• Develop high-quality solutions using PySpark, Spark SQL, and Python.
• Design and optimize Delta Lake tables, including partitioning, schema evolution, and performance tuning.
• Implement layered data architectures (Raw, Cleansed, Curated).
• Build and manage pipelines with Databricks Jobs, Workflows, and Delta Live Tables.
• Optimize Spark workloads, including partitioning, caching, shuffling, join strategies, and file sizing.
• Manage cluster configurations and monitor platform cost efficiency.
• Implement logging, monitoring, alerting, and recovery mechanisms for reliable operations.
• Integrate data quality controls throughout the pipeline lifecycle.
• Work within Unity Catalog to support data governance, lineage, and access control.
• Participate in code reviews and CI/CD-driven delivery practices.
• Collaborate in Agile ceremonies including planning, refinement, reviews, and retrospectives.
• Produce and maintain technical documentation and design decisions.

Conhecimentos

Databricks

Spark

PySpark

Spark SQL

Python

SQL

CI/CD

Git

Unity Catalog

Azure

AWS

GCP

Terraform

dbt

Airflow

Delta Lake

Databricks Workflows

Formação académica

Bachelor's or Master’s in CS/IT/Engineering

Ferramentas

Terraform

dbt

Airflow

Delta Lake

Descrição da oferta de emprego

Cronos Europa Portugal is recruiting two Senior Databricks Engineers to design, build, and operate data solutions on the Databricks Lakehouse Platform from Lisbon. You will own end-to-end data pipelines and production deployments in an international, fully remote team.

The role requires hands-on expertise with Spark, PySpark, Delta Lake, and Python/SQL, plus experience in CI/CD, Git, and data governance. English communication and autonomy are essential for success.