Databricks Engineer

Cronos Europa; Portugal; Híbrido; EUR 70 000 - 110 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Salary package

Work-life balance

Large-scale international platforms

Modern cloud technologies

Cutting-edge technologies

Resumo da oferta

Cronos Europa Portugal is recruiting two Senior Databricks Engineers to design, build, and operate data solutions on the Databricks Lakehouse Platform from Lisbon. You will take ownership of end-to-end data pipelines, use PySpark, Spark SQL, and Python, and work within an established data team.

The role requires 6+ years in data engineering, Databricks production experience, and strong cloud, governance, and CI/CD skills. Hybrid schedule with 3 days in the Lisbon office.

Qualificações

• Requires 6+ years of professional Data Engineering experience.
• Hands-on production Databricks experience.
• Strong PySpark, Spark SQL, and Delta Lake expertise.
• Experience with Python, SQL, Git, and CI/CD practices.
• Familiarity with Unity Catalog, data governance and lineage is a plus.
• Cloud exposure to Azure, AWS, or GCP is valued.

Responsabilidades

• Design, build, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
• Develop high-quality solutions using PySpark, Spark SQL, and Python.
• Design and optimize Delta Lake tables with partitioning and schema evolution.
• Implement layered data architectures (Raw, Cleansed, Curated).
• Build and manage workflows using Databricks Jobs, Workflows, and Delta Live Tables.
• Optimize Spark workloads and manage cluster configurations for cost efficiency.
• Implement logging, monitoring, alerting, and recovery mechanisms.
• Incorporate data quality controls across the pipeline lifecycle.
• Work with Unity Catalog for data governance and access control.
• Participate in code reviews and CI/CD-driven delivery practices.
• Collaborate in Agile ceremonies and produce design documentation.

Conhecimentos

Analytical thinking

Fluent English

Independent ownership

Problem solving

Formação académica

Bachelor's or Master's in CS/IT/Engineering

Ferramentas

Databricks

Apache Spark

PySpark

Spark SQL

Delta Lake

Python

SQL

Git

CI/CD

Unity Catalog

Descrição da oferta de emprego

Cronos Europa Portugal is the Lisbon delivery centre of Cronos Europa, part of the Cronos Group, a technology federation of 9,000+ professionals and 500+ competence centres across Europe. From our office at IDB Lisbon, we deliver application development, architecture, and IT operations for major European organisations, working as an integrated nearshore extension of our clients' teams.

Cronos Europa Portugal is recruiting two Senior Databricks Engineers for an international technology services group.

As a member of an established data engineering team, you will design, build, and operate data solutions on the Databricks Lakehouse Platform. This role requires hands-on expertise across the full data engineering lifecycle, from architecture and development to production deployment and operational support.

We are looking for autonomous senior engineers capable of transforming ambiguous business requirements into scalable, production-ready data solutions while taking full ownership of their technical decisions.

Hybrid.

3x per week at the office

Responsibilities:

• Design, build, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
• Develop high-quality solutions using PySpark, Spark SQL, and Python.
• Design and optimize Delta Lake tables, including partitioning, schema evolution, and performance tuning.
• Implement layered data architectures (Raw, Cleansed, Curated).
• Build and manage workflows using Databricks Jobs, Workflows, and Delta Live Tables.
• Optimize Spark workloads, including partitioning, caching, shuffling, join strategies, and file sizing.
• Manage cluster configurations and monitor platform cost efficiency.
• Implement logging, monitoring, alerting, and recovery mechanisms to ensure reliable operations.
• Integrate data quality controls throughout the pipeline lifecycle.
• Work within Unity Catalog to support data governance, lineage, and access control.
• Participate in code reviews and contribute to CI/CD-driven delivery practices.
• Collaborate in Agile ceremonies including planning, refinement, reviews, and retrospectives.
• Produce and maintain technical documentation and design decisions.

Technical skills:

• Minimum 6 years of professional experience in Data Engineering.
• Significant hands-on experience with Databricks in production environments.
• Strong expertise in Apache Spark, PySpark, and Spark SQL.
• Proven practical experience with Delta Lake.
• Advanced Python and SQL skills.
• Experience designing, deploying, and supporting production-grade data pipelines.
• Experience with Git and CI/CD practices.
• Knowledge of Databricks Workflows, Jobs, and Delta Live Tables.
• Experience with Unity Catalog, governance, and data lineage is an asset.
• Cloud experience with Azure, AWS, and/or GCP is highly valued.
• Knowledge of Terraform, Databricks Asset Bundles, dbt, or Airflow is considered a plus.
• Databricks certifications (Data Engineer Associate or Professional) are an advantage.
• Exposure to MLflow and Databricks ML workflows is a plus.

Profile :

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• Strong analytical and problem-solving skills.
• Ability to work independently and take ownership of technical decisions.
• Excellent communication and collaboration skills within international teams.
• Experience in product engineering environments is considered a strong asset.
• Fluent English, written and spoken, is mandatory.
• Ability to work effectively in a fully remote environment.

We'll propose you:

• An attractive salary package.
• A good work-life balance environment.
• The opportunity to work on large-scale international data platforms.
• Exposure to modern cloud, data engineering, and analytics technologies.
• The assurance of working with cutting-edge technologies in an entrepreneurial spirit.
• Tailor-made training courses aligned with your professional goals.
• A good job in a friendly and collaborative environment.

If you wish to integrate a dynamic structure on a human scale while working with the latest technologies, don't wait anymore and join Cronos!