Senior Data Platform Engineer- Cloud Data Pipelines & MLOps

Capgemini; Poznań; On-site; PLN 200,000 - 260,000; Full time

Benefits offered by this job

Medicover medical care

Private life insurance

Sports card

Capgemini Helpline

Job summary

Capgemini Poland seeks a data platform engineer to design and build scalable cloud-based data platforms. You will architect data pipelines, integrate diverse data sources, and collaborate with data scientists to operationalize ML models.

Role requires hands-on cloud experience (AWS/Azure/GCP), strong SQL and programming in Python/Scala, and familiarity with DevOps tools. English fluency is essential.

Qualifications

• Cloud data platform experience (AWS/Azure/GCP).
• Proficient in Spark/Hive/Snowflake/Delta Lake.
• Strong SQL skills with relational/NoSQL DBs.
• Programming in Python or Scala.
• Experience with CI/CD tooling.
• Hands-on Docker and Kubernetes experience.
• Knowledge of DataOps, testing, and monitoring.
• Understanding of data security, encryption & IAM.
• Familiarity with cloud AI/ML or generative AI tools is a plus.
• Excellent English communication.

Responsibilities

• Design and develop scalable cloud-based Data Platforms (AWS/Azure/GCP).
• Build, optimize, and maintain data pipelines for batch and streaming workloads.
• Integrate with diverse data sources and expose data via APIs, semantic layers, and warehouses.
• Work with cloud services including orchestration tools (Dataflow, Data Pipeline, ADF, MWAA, Cloud Composer).
• Utilize compute services (Databricks, EMR, Glue, DataProc, Snowflake).
• Design multi-layered data architectures (bronze/silver/gold).
• Ensure performant SQL/NoSQL solutions.
• Collaborate with Data Scientists to operationalize ML models.
• Document data architectures, workflows, and processes.
• Ensure security, compliance, and data governance across the platform.
• Participate in architectural discussions and technology recommendations.

Skills

Cloud data platforms

Big data processing

SQL proficiency

Python/Scala

CI/CD tooling

Docker & Kubernetes

DataOps & testing

Data security & IAM

English proficiency

Generative AI familiarity

Tools

Databricks

Snowflake

Delta Lake

Spark

Hive

ADF

MWAA / Dataflow / Cloud Composer

GitHub Actions

Azure DevOps

Jenkins

Job description

Capgemini Poland seeks a data platform engineer to design and build scalable cloud-based data platforms. You will architect data pipelines, integrate diverse data sources, and collaborate with data scientists to operationalize ML models.

Role requires hands-on cloud experience (AWS/Azure/GCP), strong SQL and programming in Python/Scala, and familiarity with DevOps tools. English fluency is essential.