Senior Databricks Engineer

bridge351; Lisboa; Híbrido; EUR 70 000 - 110 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health Insurance

Life Insurance

Tech Visa program

Resumo da oferta

bridge351 is seeking two Senior Databricks Engineers to join our data engineering team. You will design, build and operate data solutions on the Databricks Lakehouse Platform, owning the full lifecycle from architecture to production deployment and operational support.

You will work autonomously to translate ambiguous business needs into scalable data solutions, taking full ownership of technical decisions and contributing to CI/CD-driven delivery within an Agile framework.

Qualificações

• 6+ years of professional experience in Data Engineering.
• Hands-on Databricks in production environments.
• Strong expertise in Apache Spark, PySpark and Spark SQL.
• Proven experience with Delta Lake.
• Advanced Python and SQL skills.
• Experience designing, deploying and supporting production-grade data pipelines.

Responsabilidades

• Design, build and maintain scalable data pipelines on the Databricks Lakehouse Platform.
• Optimize Delta Lake tables and partitioning strategies.
• Implement layered data architectures (Raw, Cleansed and Curated).
• Build and manage workflows with Databricks Jobs and Delta Live Tables.
• Optimize Spark workloads and manage cluster configurations.
• Implement logging, monitoring and recovery mechanisms for reliable operations.
• Collaborate in an Agile environment and participate in code reviews.

Conhecimentos

Databricks

PySpark

Spark SQL

Python

SQL

Git

CI/CD

Formação académica

Bachelor's or Master's in Computer Science/Engineering

Ferramentas

Databricks

Delta Lake

Unity Catalog

Databricks Workflows/Jobs

Delta Live Tables

Terraform

Descrição da oferta de emprego

Location: Lisbon, Portugal | Hybrid (3 days/week on-site)

About The Role

We are hiring two Senior Databricks Engineers to join an established data engineering team within an international technology services group.

You will design, build and operate data solutions on the Databricks Lakehouse Platform, owning the full lifecycle from architecture and development to production deployment and operational support.

We are looking for autonomous engineers who can turn ambiguous business requirements into scalable, production-ready data solutions and take full ownership of their technical decisions.

Key Responsibilities

• Design, build and maintain scalable data pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL and Python.
• Design and optimize Delta Lake tables, including partitioning, schema evolution and performance tuning.
• Implement layered data architectures (Raw, Cleansed and Curated).
• Build and manage workflows with Databricks Jobs, Workflows and Delta Live Tables.
• Optimize Spark workloads: partitioning, caching, shuffling, join strategies and file sizing.
• Manage cluster configurations and monitor platform cost efficiency.
• Implement logging, monitoring, alerting and recovery mechanisms for reliable operations.
• Integrate data quality controls throughout the pipeline lifecycle.
• Work within Unity Catalog to support governance, lineage and access control.
• Take part in code reviews and CI/CD-driven delivery.
• Collaborate in Agile ceremonies and maintain technical documentation and design decisions.

Requirements

• 6+ years of professional experience in Data Engineering.
• Significant hands-on experience with Databricks in production environments.
• Strong expertise in Apache Spark, PySpark and Spark SQL.
• Proven practical experience with Delta Lake.
• Advanced Python and SQL skills.
• Experience designing, deploying and supporting production-grade data pipelines.
• Experience with Git and CI/CD practices.
• Knowledge of Databricks Workflows, Jobs and Delta Live Tables.
• Bachelor's or Master's degree in Computer Science, IT, Engineering or a related field.
• Fluent English, written and spoken.

Nice to have

• Unity Catalog, data governance and lineage.
• Cloud experience with Azure, AWS and/or GCP.
• Terraform, Databricks Asset Bundles, dbt or Airflow.
• Databricks certification (Data Engineer Associate or Professional).
• Exposure to MLflow and Databricks ML workflows.
• Experience in product engineering environments.

What's on offer

• An attractive salary package and a good work-life balance.
• Large-scale international data platforms and modern cloud and data technologies.
• Tailor‑made training aligned with your professional goals.
• A friendly, collaborative and entrepreneurial environment.

What can you expect from us?

Mind-blowing workplace culture. You will be integrated in a professional, dynamic and collaborative team.

100% Remote opportunities

We want you to have the flexibility to work where you feel most comfortable and productive.

International Career

• You can expect professional growth and to be connect with the world.
• We are represented in Portugal, Belgium, Luxembourg, and Denmark.
• And with projects in many other countries: Netherlands, Luxembourg, Singapore and in the United States of America (and a lot more is coming…)

Extra Benefits & Perks

• If you wish to work with us and you are outside European Union (good news…) we are a Tech Visa Company, We will help!
• As a plus, we provide Health and Life Insurance.