Data Engineer (Databricks Focus)

Capgemini; Lisboa; Presencial; EUR 35 000 - 50 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health and Life insurance

Career Acceleration Programs

Referral program with bonuses

Resumo da oferta

A leading tech consulting company in Lisboa is looking for an experienced Data Engineer focusing on Databricks. You will design and implement scalable data pipelines, ensuring best practices in data governance and security. The ideal candidate should have over 2 years of experience in data engineering, strong skills in SQL and Python/PySpark, and familiarity with CI/CD practices. This position offers a flexible work environment with competitive compensation and a comprehensive benefits package.

Qualificações

• Minimum of 2+ years experience as a Data Engineer.
• Strong skills in SQL and Python/PySpark.
• Familiarity with CI/CD and DevOps tooling.

Responsabilidades

• Design, build and maintain robust batch and streaming pipelines using Databricks.
• Implement lakehouse best practices with Delta Lake.
• Optimize performance and troubleshoot production issues.

Conhecimentos

SQL

Python

PySpark

Communication

Teamwork

Problem solving

Ferramentas

Databricks

Delta Lake

CI/CD tooling

Descrição da oferta de emprego

Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Select your locationSelect your locationIndustriesChoose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Lisboa# Data Engineer (Databricks Focus)## Data Engineer (Databricks Focus)Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.## YOUR ROLEWe are looking for a Data Engineer with a Databricks focus to join Capgemini Portugal’s Data & AI consulting team. You will design and implement scalable data pipelines and lakehouse solutions, solve delivery challenges in client projects, and support commercial initiatives with strong technical solutioning.In this role you will be responsible for:* Design, build and maintain robust batch and streaming pipelines using Databricks (Spark/PySpark, Databricks Workflows/Jobs).* Implement lakehouse best practices with Delta Lake (reliability, schema evolution, optimization) and data modeling for analytics readiness.* Apply governance and security patterns using Unity Catalog (access control, lineage/discovery), in coordination with client security requirements.* Implement CI/CD practices for notebooks/jobs and promote testing, observability and operational reliability.* Optimize performance and cost (cluster configuration, workload tuning) and troubleshoot production issues.* Support pre-sales: contribute to architecture solutioning, estimations, and technical workshops in a consulting environment.## YOUR PROFILE* Minimum of 2+ years experience as a Data Engineer (Databricks experience strongly preferred).* Strong skills in SQL and Python/PySpark; understanding of distributed processing concepts.* Experience with Databricks core components (jobs/workflows, Delta patterns; governance concepts).* Familiarity with CI/CD and DevOps tooling applied to data engineering.* Strong communication and teamwork; proactive problem solving and ownership mindset.* Fluency in Portuguese and English.* At Capgemini Portugal we have a flexible and dynamic work environment. Flexibility enables a better work-life balance and gives more flexibility to the employee to manage the working hours, as well if he works at the office or remotely, according with the company’s hybrid work policy;* We have local programs that promote people growth, reskill and new skills development (Career Acceleration Programs);* We promote an empowering environment with autonomy and peers' relationships among the top scores of our Monthly Employees' feedback; Next to this, we also offer an attractive compensation package and benefits such as Health and Life insurance, as well as Referral program with bonuses for talent recommendations and other fringe benefits according with our partnerships in force.* Capgemini Portugal is an equal opportunity employer. We promote equality and dignity in all aspects of recruitment and employment, as well as employment offers and promotions made according with competence and ability or performance, respectively.Experience levelExperienced ProfessionalsLocationLisboa