Staff Data Engineer (all genders)

IT-Systemhaus der Bundesagentur für Arbeit; Köln; Vor Ort; EUR 70.000 - 90.000; Vollzeit

Zusammenfassung

A public sector IT service provider in Köln is seeking a Cloud-Architect to design and evolve scalable data products and architectures for analytics. The ideal candidate has over 5 years in data engineering or architecture roles, strong SQL skills, and experience with Databricks and Azure. Collaboration with cross-functional teams using agile methodologies is essential. This role offers an opportunity to drive innovative solutions in a cloud environment, making a significant impact on data strategies.

Qualifikationen

• 5+ years in data engineering or architecture roles in cloud environments.
• Strong SQL skills with hands-on experience in Databricks and Apache Spark.
• Proven experience building production-grade ingestion and transformation pipelines.

Aufgaben

• Design and evolve scalable data products architectures for analytics and reporting.
• Build and operate reliable ingestion and transformation pipelines.
• Collaborate with stakeholders to align engineering standards, CI/CD, and best practices.

Kenntnisse

SQL

Databricks

Apache Spark

Python

Scala

Tools

Microsoft Azure

Terraform

Jobbeschreibung

Beginn

• Cloud-Architect

What you will do

• Design and evolvescalable data productsarchitecturesthat support analytics,reporting, and advanceduse cases across domains
• Partnerwith domainand product teamsto translatebusiness needs into cleardataproductcontractsaligned with ourdata platform architecture andstrategy
• Buildandoperatereliable ingestionand transformation pipelines, with strong testing, observability,and cost aware operations
• Lead deliveryand technicalalignmentn complexcross teaminitiativesthroughdesign reviews, mentoring, andhands on contribution
• Collaborateclosely withplatform,security,and operations stakeholdersto align engineering standards, CI/CD, andbest practices
• Work agile using Scrum or Kanban, contributing to planning, prioritization, and continuous improvement

Ihr Profil:

What you will need

5+ years in data engineering or data architecture roles in cloud environment (preferably Microsoft Azure), including designing scalable lakehouse platforms and reference architectures

StrongSQLskills plus hands on experience with Databricksand Apache Spark, including performance tuning and cost aware design on Azure

Provenexperiencebudlingproductiongrade ingestionand transformation pipelines, ideally withDelta Lake patterns,orchestration, and robust testing

Solid software engineering practices for data systems,including Python or Scala, Git based workflows,CI/CD, and infrastructure as code such as Terraform

Experience withmodern data governanceand security, including Unity Catalog concepts, RBAC, ABAC,data masking,lineage, and auditing

Strong data modeling capability for analytics and data products, including dimensional and domain-oriented modeling, plus designing data products, SLAs, and data quality controls