Senior Data Engineer(Databricks)

Capgemini; Warszawa; On-site; PLN 50,000 - 75,000; Full time

Benefits offered by this job

Medical care with Medicover

Private life insurance

Sports card

Access to training platforms (Pluralsight, Coursera)

Therapeutic support via Capgemini Helpline

Job summary

Capgemini is seeking a Data Engineer in Warsaw, Poland. This role involves designing data processing solutions using Databricks, enhancing data pipelines with Python, and ensuring data consistency within cloud environments. Candidates should have at least one year of hands-on experience with Databricks, proficiency in Python, and familiarity with major cloud platforms such as AWS, Azure, or GCP. Capgemini offers a supportive work culture with access to numerous training opportunities and wellness programs.

Qualifications

• At least 1 year of hands-on Databricks expertise.
• Strong experience in Python for automation and data transformation.
• Experience with at least one major cloud platform (AWS, Azure, or GCP).
• Strong English communication skills.

Responsibilities

• Design and implement data processing solutions using Databricks.
• Design, build, and enhance data pipelines with Python.
• Work closely with solution architects to uphold data engineering best practices.
• Ensure data consistency and security in cloud environments.

Skills

Data Engineering

Python

Cloud Platforms (AWS, Azure, GCP)

Databricks

Communication Skills

Tools

Databricks

Kafka

Spark Streaming

Terraform

PySpark

Job description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Your Team

Insights & Data delivers state-of-the-art Data solutions. Our expertise primarily lies in Cloud & Big Data engineering, where we develop robust systems capable of processing extensive and complex datasets, utilizing specialized Cloud Data services across platforms like AWS, Azure, and GCP. We oversee the entire Software Development Life Cycle (SDLC) of these solutions, which involves not only leveraging data processing tools such as ETL but also extensive programming in languages like Python, Scala, or Java, coupled with the adoption of DevOps tools and best practices. The processed data is then made accessible to downstream systems through APIs, outbound interfaces, or is visualized via comprehensive reports and dashboards. Additionally, within our AI Center of Excellence, we undertake Data Science and Machine Learning projects with a focus on cutting‑edge areas such as Generative AI, Natural Language Processing (NLP), Anomaly Detection, and Computer Vision.

Your Tasks

• Design and implement data processing solutions using Databricks for large-scale and diverse datasets.
• Design, build, and enhance data pipelines with Python and cloud‑native tools.
• Work closely with solution architects to define and uphold best practices in data engineering.
• Ensure data consistency, security, and scalability within cloud‑based environments.

Your Profile

• Strong experience in data engineering, with at least 1 year of hands‑on Databricks expertise.
• Strong experience in Python for automation and data transformation.
• Experience working with at least one major cloud platform (AWS, Azure, or GCP).
• Strong communication skills and strong English language skills.

Nice to have

• Solid understanding of SQL with experience in query optimization and data modeling.
• Familiarity with DevOps methodologies, CI/CD pipelines, and Infrastructure as Code (Terraform, Bicep).
• Experience with real-time data streaming technologies such as Kafka or Spark Streaming.
• Knowledge of cloud storage solutions like Data Lake, Snowflake, or Synapse.
• Hands‑on experience with PySpark for distributed data processing.
• Relevant certifications such as Databricks Certified Data Engineer Associate or cloud‑based data certifications.

What You’ll Love About Working Here

• Well‑being culture: medical care with Medicover, private life insurance, and Sports card. But we went one step further by creating our own Capgemini Helpline offering therapeutical support if needed and the educational podcast “Let’s talk about wellbeing” which you can listen to on Spotify.
• Access to over 70 training tracks with certification opportunities (e.g., GenAI, Architects, Google) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, Pluralsight, TED Talks, Coursera and Udemy Business materials and trainings.
• Award‑Winning Stability & Culture: Become part of an organization celebrated as "Top Employer Poland 2024" - in the audit our stable and supportive work environment scored 100%!
• Cutting-Edge Technology: Position yourself at the forefront of IT innovation, working with the latest technologies and platforms. Capgemini partners with top global enterprises, including 145 Fortune 500 companies.

Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.