Databricks Data Architect - Data Mesh & Real-Time Pipelines

Infosys; København; On-site; DKK 900,000 - 1,300,000; Full time

Job summary

Infosys is a global leader in next-generation digital services and consulting. We enable clients in 59 countries to navigate their digital transformation.

With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer clients, in 59 countries, as they navigate their digital transformation powered by cloud and AI. We enable them with an AI-first core, empower the business with agile digital at scale and drive continuous improvement with

Qualifications

• Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures.
• Hands-on experience with streaming technologies, especially Kafka / Confluent Kafka.
• Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server.
• Working knowledge of AWS data services, especially S3.
• Understanding of data product thinking, data mesh concepts, and modern data engineering best practices.

Responsibilities

• Build and maintain batch and streaming data pipelines from legacy mainframe DB2 and on prem SQL Server systems into an AWS-based data lake.
• Implement real-time ingestion using Confluent Kafka and land data in Amazon S3.
• Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze, Silver, Gold).
• Design and deliver high-quality, reusable data products aligned to data mesh principles.
• Ensure data quality, reliability, security, and governance across pipelines.
• Collaborate with domain teams, platform teams, and stakeholders to enable self-serve analytics and consumption.

Skills

Databricks

Spark

PySpark/SQL

Kafka

Legacy DB2 mainframe

SQL Server

AWS S3

Data mesh concepts

Data product thinking

Tools

Confluent Kafka

Job description

Infosys is a global leader in next-generation digital services and consulting. We enable clients in 59 countries to navigate their digital transformation.

With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer clients, in 59 countries, as they navigate their digital transformation powered by cloud and AI. We enable them with an AI-first core, empower the business with agile digital at scale and drive continuous improvement with