Domain Architect

JR United Kingdom; Slough; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

A leading company in analytics is seeking a Senior Data Engineer for a hybrid role based in London. You will design and implement data solutions, optimize processing pipelines, and lead engineering efforts. Ideal candidates will have strong expertise in Azure and big data frameworks, ensuring high-quality data management and compliance.

Qualifications

• Expertise in data ingestion using Azure Event Hubs, Kafka, REST APIs.
• Proficiency with major Azure services like Data Lake and Event Hubs.
• Strong background in data governance and compliance.

Responsibilities

• Evaluate Cyber Analytics Platform and design data lake structure.
• Identify data sources and define processing requirements.
• Provide technical leadership and ensure data governance.

Skills

Data ingestion from sources

Azure services

Databricks

ETL/ELT optimization

Data governance

Technical leadership

Tools

Azure Cloud Services

Databricks

DevOps (CI/CD)

Terraform/Infrastructure as Code

Job description

Social network you want to login/join with:

Location: London, UK (Hybrid - 3 days a week in person)

Contract: 12 months +

Start: ASAP

Status: Inside IR35

Key Responsibilities:

• Evaluate the Cyber Analytics Platform architecture and design the data lake structure.
• Identify data sources for ingestion and define a prioritized backlog of processing requirements.
• Design scalable data pipelines and document ingestion patterns.
• Provide technical leadership and mentorship to the engineering team.
• Implement data governance, access controls, and security models.
• Work with DevOps engineers to ensure CI/CD processes for data workflows.
• Build cloud-based solutions focusing on high-performance analytics and distributed data processing.
• Optimize data workflows and pipelines for large-scale data processing (terabytes/billions of events).
• Design cost-efficient, scalable solutions in the cloud.
• Ensure data quality, security, and compliance in all pipelines.
• Perform ongoing tuning and optimization for pipeline performance.

Required Skills & Qualifications:

• Expertise in data ingestion from sources like Azure Event Hubs, Kafka, REST APIs, and file storage.
• Proficiency with Azure services, including Data Lake, Event Hubs, and Storage Accounts.
• Advanced knowledge of Databricks, Spark, and distributed data processing frameworks.
• Strong experience in ETL/ELT optimization and data modeling.
• Familiarity with CI/CD for data workflows.
• Background in data governance, security, and compliance.
• Technical leadership experience in guiding engineering teams.
• Proven experience in designing and implementing cloud-based big data analytics platforms.
• Tools Expertise: Azure Cloud Services, Databricks, DevOps (CI/CD), Terraform/Infrastructure as Code (plus).