Senior Databricks Data Engineer

Capgemini; Województwo pomorskie; On-site; PLN 180,000 - 280,000; Full time

Job summary

Capgemini Poland is seeking a data engineer to design and implement data processing solutions using Databricks and Python in a cloud-first environment. You will build robust data pipelines for large-scale datasets across AWS, Azure, or GCP, applying best practices in data engineering.

Work closely with solution architects to ensure data quality, security and scalability, and communicate effectively in English within a collaborative Capgemini team.

Qualifications

• Strong experience in data engineering with at least 1 year of hands-on Databricks expertise.
• Strong experience in Python for automation and data transformation.
• Experience with at least one major cloud platform (AWS, Azure, or GCP).
• Strong communication skills and strong English language skills.
• SQL knowledge and data modeling (nice to have).
• DevOps, CI/CD, and Infrastructure as Code (Terraform, Bicep) (nice to have).
• Real-time data streaming technologies such as Kafka or Spark Streaming (nice to have).
• Cloud storage solutions like Data Lake, Snowflake, or Synapse (nice to have).
• Hands-on experience with PySpark for distributed data processing (nice to have).
• Relevant certifications such as Databricks Certified Data Engineer Associate (nice to have).

Responsibilities

• Design and implement data processing solutions using Databricks for large-scale and diverse datasets.
• Design, build, and enhance data pipelines with Python and cloud-native tools.
• Work closely with solution architects to define and uphold best practices in data engineering.
• Ensure data consistency, security, and scalability within cloud-based environments.

Skills

Databricks

Python

Cloud platforms

Data engineering

English proficiency

Tools

Terraform

PySpark

Kafka

Snowflake

Synapse

Job description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Your Team

Insights & Data delivers state-of-the-art Data solutions. Our expertise primarily lies in Cloud & Big Data engineering, where we develop robust systems capable of processing extensive and complex datasets, utilizing specialized Cloud Data services across platforms like AWS, Azure, and GCP. We oversee the entire Software Development Life Cycle (SDLC) of these solutions, which involves not only leveraging data processing tools such as ETL but also extensive programming in languages like Python, Scala, or Java, coupled with the adoption of DevOps tools and best practices. The processed data is then made accessible to downstream systems through APIs, outbound interfaces, or is visualized via comprehensive reports and dashboards. Additionally, within our AI Center of Excellence, we undertake Data Science and Machine Learning projects with a focus on cutting-edge areas such as Generative AI, Natural Language Processing (NLP), Anomaly Detection, and Computer Vision.

Your Tasks

• Design and implement data processing solutions using Databricks for large-scale and diverse datasets.
• Design, build, and enhance data pipelines with Python and cloud-native tools.
• Work closely with solution architects to define and uphold best practices in data engineering.
• Ensure data consistency, security, and scalability within cloud-based environments.

Your Profile

• Strong experience in data engineering, with at least 1 year of hands-on Databricks expertise.
• Strong experience in Python for automation and data transformation.
• Experience working with at least one major cloud platform (AWS, Azure, or GCP).
• Strong communication skills and strong English language skills.

Nice to have:

• Solid understanding of SQL with experience in query optimization and data modeling.
• Familiarity with DevOps methodologies, CI/CD pipelines, and Infrastructure as Code (Terraform, Bicep).
• Experience with real-time data streaming technologies such as Kafka or Spark Streaming.
• Knowledge of cloud storage solutions like Data Lake, Snowflake, or Synapse.
• Hands-on experience with PySpark for distributed data processing.
• Relevant certifications such as Databricks Certified Data Engineer Associate or cloud-based data certifications.

What You'll Love About Working Here

• Well-being culture: medical care with Medicover, private life insurance, and Sports card. But we went one step further by creating our own Capgemini Helpline offering therapeutical support if needed and the educational podcast \"Let\'s talk about wellbeing\" which you can listen to on Spotify.
• Access to over 70 training tracks with certification opportunities (e.g., GenAI, Architects, Google) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, Pluralsight, TED Talks, Coursera and Udemy Business materials and trainings.
• Award-Winning Stability & Culture: Become part of an organization celebrated as \"Top Employer Poland 2024\" - in the audit our stable and supportive work environment scored 100%!
• Cutting-Edge Technology: Position yourself at the forefront of IT innovation, working with the latest technologies and platforms. Capgemini partners with top global enterprises, including 145 Fortune 500 companies.

Get To Know Us

Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.Do you want to get to know us better? Check our Instagram — @capgeminipl or visit our Facebook profile — Capgemini Polska. You can also find us on YouTube.

About Capgemini

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of over 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2025 global revenues of €22.5 billion.