Senior Databricks Data Engineer – Lakehouse & CI/CD Expert

Capgemini; Lisboa; Híbrido; EUR 45 000 - 65 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

Life insurance

Referral bonuses

Resumo da oferta

Capgemini Portugal is seeking a Senior Data Engineer with a Databricks focus to design and implement scalable data pipelines and lakehouse solutions. You will tackle delivery challenges in client projects and support pre-sales with strong technical solutioning.

You will work in a collaborative Data & AI consulting team, using Spark/PySpark, Delta Lake, and Unity Catalog, while communicating effectively in Portuguese and English and contributing to hybrid work arrangements in Lisbon.

Qualificações

• Minimum of 4+ years experience as a Data Engineer.
• Strong skills in SQL and Python/PySpark and understanding of distributed processing concepts.
• Experience with Databricks core components (jobs/workflows, Delta patterns).
• Familiarity with CI/CD and DevOps tooling applied to data engineering.
• Strong communication and teamwork with an ownership mindset.
• Fluency in Portuguese and English.

Responsabilidades

• Design, build and maintain robust batch and streaming pipelines using Databricks (Spark/PySpark, Databricks Workflows/Jobs).
• Implement lakehouse best practices with Delta Lake and data modeling for analytics readiness.
• Apply governance using Unity Catalog in coordination with client security requirements.
• Implement CI/CD practices for notebooks/jobs and promote testing and observability.
• Optimize performance and cost and troubleshoot production issues.
• Support pre-sales: contribute to architecture solutioning and technical workshops.

Conhecimentos

Databricks experience

SQL

Python / PySpark

CI/CD / DevOps tooling

Communication & teamwork

Portuguese & English fluency

Ferramentas

Databricks jobs/workflows

Delta Lake

Unity Catalog

Descrição da oferta de emprego

Capgemini Portugal is seeking a Senior Data Engineer with a Databricks focus to design and implement scalable data pipelines and lakehouse solutions. You will tackle delivery challenges in client projects and support pre-sales with strong technical solutioning.

You will work in a collaborative Data & AI consulting team, using Spark/PySpark, Delta Lake, and Unity Catalog, while communicating effectively in Portuguese and English and contributing to hybrid work arrangements in Lisbon.