Data Mesh Architect: DB2 to Cloud Data Lake

IT Technical Jobs; Greater London; On-site; GBP 90,000 - 120,000; Full time

Job summary

IT Technical Jobs seeks a Data Architect to design, build and operate scalable data pipelines and data products, enabling a modern data mesh architecture across AWS.

The role focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. You will collaborate with domain teams and stakeholders to promote self‑serve analytics and strong data governance.

Qualifications

• Experience designing data pipelines for scalable architectures
• Cloud experience with AWS and data lakes
• Knowledge of data mesh concepts and data governance

Responsibilities

• Build and maintain batch data pipelines from legacy DB2 and on‑prem SQL Server to AWS data lake.
• Implement real‑time ingestion using Kafka ecosystem and land data in S3.
• Develop transformations and analytics pipelines in Databricks following medallion architecture (Bronze/Silver/Gold).
• Design and deliver reusable data products aligned to data mesh principles.
• Ensure data quality, reliability, security and governance across pipelines.
• Collaborate with domain and platform teams to enable self‑serve analytics.

Skills

Databricks

Pyspark

Data Architecture

Datalake Architecture

Real-time data processing

Batch data processing

DB2

SQL Server

Kafka

Job description

IT Technical Jobs seeks a Data Architect to design, build and operate scalable data pipelines and data products, enabling a modern data mesh architecture across AWS.

The role focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. You will collaborate with domain teams and stakeholders to promote self‑serve analytics and strong data governance.