Cloud Data Engineer — Azure, Spark & APIs (Hybrid)

Capgemini; Fundão, Lisboa, Évora; Hybrid; EUR 42,000 - 64,000; Full time

Benefits offered by this job

Health and life insurance

Hybrid work

Career growth programs

Training and certifications

Job summary

Capgemini Engineering in Portugal seeks a Cloud Data Engineer to design, develop and maintain backend services and data pipelines. You will work with Python, Flask, Docker, Kubernetes, and Azure to build scalable solutions and support large-scale data processing with Databricks and Spark.

You will join an agile, hybrid team delivering end-to-end solutions across national and international projects, focusing on performance, security, and reliability.

Qualifications

• Proficient Python development for backend services.
• Experience building REST APIs with Flask.
• Hands-on with Docker and Kubernetes for containerized apps.
• Experience with Databricks and Apache Spark for data processing.
• Agile/Scrum experience in cross-functional teams.
• Knowledge of Redis caching for performance.
• Solid understanding of Azure cloud services.
• Proficiency in PostgreSQL and database management.
• Version control with Git.

Responsibilities

• Design, develop, and maintain backend services and REST APIs using Python and Flask API.
• Build scalable backend applications with Redis caching.
• Containerize applications using Docker and Kubernetes.
• Handle end-to-end development, deployment, enhancement, and support.
• Collaborate in Agile/Scrum teams.
• Create and maintain CI/CD pipelines with Azure DevOps.
• Deploy and manage apps in Azure cloud/container environments.
• Work with Databricks and Spark for data processing.
• Optimize PostgreSQL database operations.
• Participate in sprint planning, reviews, testing, debugging, and production support.
• Ensure scalability, reliability, security, and performance.

Skills

Python

Flask APIs

Docker

Kubernetes

Databricks

Apache Spark

Redis

Azure

PostgreSQL

Git

Tools

Azure DevOps

Job description

Capgemini Engineering in Portugal seeks a Cloud Data Engineer to design, develop and maintain backend services and data pipelines. You will work with Python, Flask, Docker, Kubernetes, and Azure to build scalable solutions and support large-scale data processing with Databricks and Spark.

You will join an agile, hybrid team delivering end-to-end solutions across national and international projects, focusing on performance, security, and reliability.