Cloud native data engineer

adesso SE; Berlin; Hybrid; EUR 70,000 - 110,000; Full time

Job summary

adesso SE in Berlin is seeking a data engineer who designs and implements robust data pipelines using Apache Airflow, Kafka, Spark, or Trino, ensuring reliable, efficient data flows. You will develop container‑based analytics platforms and build CI/CD pipelines on Kubernetes to deliver features safely to production.

You will automate deployments with Helm and ArgoCD, integrate data platforms into customer environments (IAM, monitoring, logging), and collaborate with clients to translate business

Qualifications

• Hands-on experience with Spark, Kafka, Airflow or similar technologies in production-like projects.
• Practical experience with Kubernetes deployments, services, secrets and Helm charts.
• Strong programming skills in Java, Scala or Python and familiarity with Maven, sbt or Gradle build tools.
• Understanding of IaaS, PaaS, SaaS and infrastructure-as-code (Terraform/Ansible/Puppet).
• Interest in data landscapes, trying new technologies, and sharing knowledge with teams and customers.
• Ability to communicate in German and English at a professional level.

Responsibilities

• Design and implement robust data pipelines and data ingestion/processing using open-source components.
• Build container-based analytics platforms and CI/CD pipelines on Kubernetes for safe production deployment.
• Automate deployment of analytics platforms using Helm, ArgoCD, and ensure reproducible, stable deployments.
• Integrate data platforms into customer environments (IAM, monitoring, logging) for stability and security.
• Collaborate with customers to translate business requirements into open-source analytics solutions on Kubernetes.
• Continuously update knowledge in cloud, data, and software engineering and share learnings with team and customers.

Skills

Airflow

Kafka

Spark

Trino

Kubernetes

Java

Python

CI/CD

Terraform

ArgoCD

Helm

IAM

Monitoring

Logging

Education

Degree or equivalent qualification

Tools

Maven

Gradle

Git

Terraform

Ansible

Puppet

Helm

ArgoCD

Job description

Описание:

We are one of the top names in the IT world and focus on optimizing our customers’ core business processes. By intelligently using tailor‑made IT solutions, we help our customers get the most out of their business and current technologies. But we achieve success through one thing above all: the people at adesso! They bring ideas, professional expertise, and technologies together. Together, we are programming (your) future at adesso.

Задачи:

• You design and implement robust data pipelines, data ingestion, and data processing based on open‑source components such as Apache Airflow, Kafka, Spark, or Trino, and ensure that data flows reliably, efficiently, and transparently.
• You develop container‑based analytics platforms and design efficient CI/CD pipelines based on Kubernetes, ensuring that new features and changes reach production safely and automatically.
• You are responsible for the automated deployment of analytics platforms—for example, using Helm charts and tools such as ArgoCD—and ensure that deployments are reproducible and stable.
• You integrate data platforms into existing customer environments, including IAM, monitoring, and logging, and thereby actively contribute to the stability, security, and transparency of the solutions.
• Together with our customers, you understand business requirements and implement them using open‑source analytics services based on Kubernetes, with the goal of supporting our customers holistically on their journey toward data sovereignty.
• You continuously update your knowledge in cloud, data, and software engineering, try out new technologies, and share your experience with the team and customers—for example, in projects, communities, or internal events.

Требования:

• You have completed a degree (or an equivalent qualification) and already have hands‑on experience with components such as Spark, Kafka, Airflow, or similar technologies—ideally in projects close to production.
• You have practical experience with Kubernetes (e.g., deployment and service definitions, handling secrets, and Helm charts) and enjoy building containerised applications and platforms.
• You have solid programming skills in Java, Scala, or Python and have worked with build and CI/CD tools such as Maven, sbt, Gradle, Git, or similar tools.
• You understand concepts such as IaaS, PaaS, and SaaS, and have initial experience with infrastructure‑as‑code approaches (e.g., Terraform, Ansible, or Puppet) to build infrastructure that is reproducible and versionable.
• You enjoy understanding complex data landscapes, trying out new technologies in the data and analytics field, and helping shape solutions end to end.
• You confidently use AI tools in your field, critically evaluate their results, and support customers and adessi in making use of AI’s potential.
• Your very good German and good English skills enable you to communicate confidently.

Условия:

You will feel at home with us! We are collegial, close‑knit, and treat each other as equals—we value open exchange, team spirit, and mutual respect. We value diversity and different perspectives just as much as we value you as a person. This and much more define our very special sense of togetherness. There is even a word for it: adessi. Our culture and the way we work together are shaped by mutual appreciation, recognition, and support. This connects us across all levels of the hierarchy, including when working from home. For the second time, we have taken first place in the “Germany’s Best ITC Employers” competition. Our extensive training program and transparent career-level model for everyone ensure that your development with us never stands still. Growing together and creating opportunities is programmed into our DNA.