Data Architect - AWS & Azure

UBDS Digital; Greater London; On-site; GBP 80,000 - 120,000; Full time

Benefits offered by this job

Private medical cover

Discretionary bonus

25 days holiday + birthday + work annv

EV leasing with salary sacrifice

Contributed Pension Scheme

Death in service cover

Job summary

UBDS Group is seeking an experienced Data Architect to design and deliver scalable data platforms across AWS and Azure. You will lead multi-cloud data engineering, build automated pipelines, and implement event-driven architectures that securely integrate cloud and on‑premises data sources.

Collaborating with Data Engineers, Cloud Architects and delivery teams, you will provide technical leadership while shaping data solutions, workflows and governance for complex Government and Defence

Qualifications

• Experience as a Data Architect or senior data engineer with architecture responsibilities.
• Hands-on design and delivery of data solutions across AWS and Microsoft Azure.
• Experience designing automated ETL/ELT pipelines.
• Experience with distributed data processing technologies like Apache Spark.
• Experience with event-driven architectures and data workflows.

Responsibilities

• Design scalable data architectures across AWS and Azure.
• Define and implement automated data pipelines using cloud-native tech (e.g., Spark).
• Design data integration across cloud and on-premises sources.
• Establish event-driven architectures for near real-time data processing.
• Optimize data pipelines for performance, reliability and scalability.
• Develop self-service ETL onboarding for new data assets.
• Define data access, storage, and processing patterns across multi-clouds.
• Provide architectural guidance for AWS and Azure services (EC2, EMR, S3, Lambda, Blob Storage).
• Collaborate with Cloud/Infra teams on networking, security and access controls.
• Champion DevOps and IaC, CI/CD and automated deployments.
• Support Terraform, GitLab automation tooling in delivery.
• Produce architecture docs and technical designs.
• Engage with stakeholders to translate requirements into solutions.
• Provide leadership to Data Engineers and delivery teams.

Skills

Data architecture

AWS

Azure

ETL pipelines

Apache Spark

CI/CD

Infrastructure as Code

Terraform

GitLab

Security

Tools

Terraform

GitLab

Apache Spark

Job description

Description

At UBDS, we help organisations transform through cloud, cyber security, AI and digital innovation. We are looking for an experienced Data Architect to support the design and delivery of modern, scalable data platforms and solutions across complex Government and Defence environments.

At UBDS, we help organisations transform through cloud, cyber security, AI and digital innovation. We are looking for an experienced Data Architect to support the design and delivery of modern, scalable data platforms and solutions across complex Government and Defence environments.

This is a hands‑on architecture role with a strong focus on multi‑cloud data engineering, automated data pipelines and event‑driven architectures. You will work across both AWS and Microsoft Azure, designing secure, resilient and high‑performing data solutions that integrate cloud and on‑premises data sources.

Working closely with Data Engineers, Cloud Architects, Software Engineers and delivery teams, you will provide technical leadership while remaining actively involved in the design, development and implementation of data solutions.

What You'll Do

• Design and deliver scalable data architectures across AWS and Azure environments.
• Define and implement automated data pipelines using cloud-native technologies and frameworks such as Apache Spark.
• Design data integration solutions connecting cloud platforms with on‑premises data sources.
• Establish event‑driven architectures to support efficient data processing, workflow orchestration and near‑real‑time data availability.
• Optimise data pipelines for performance, parallelisation, reliability and scalability.
• Design data processing capabilities that support early identification of fraud risks and other analytical use cases.
• Develop scalable approaches and tooling to enable self‑service ETL and the onboarding of new data assets.
• Define data access, storage, integration and processing patterns across multi‑cloud environments.
• Provide architectural guidance across AWS and Azure services, including EC2, EMR, S3, Lambda and Azure Blob Storage.
• Work with Cloud and Infrastructure teams to ensure appropriate networking, connectivity, security and access controls.
• Champion DevOps and software engineering best practices, including Infrastructure as Code, CI/CD and automated deployments.
• Support the use of Terraform, GitLab and automation tooling across data platform delivery.
• Produce architecture documentation, technical designs and implementation guidance.
• Engage with technical and business stakeholders to translate complex data requirements into practical solutions.
• Provide technical leadership and guidance to Data Engineers and wider delivery teams.

What We're Looking For

• Strong experience as a Data Architect, Cloud Data Architect or Senior Data Engineer with architectural responsibilities.
• Proven hands‑on experience designing and delivering data solutions across both AWS and Microsoft Azure.
• Strong understanding of cloud data architecture, data integration and distributed data processing.
• Experience designing and implementing automated ETL/ELT pipelines.
• Experience with Apache Spark or equivalent distributed data processing technologies.
• Experience designing event‑driven architectures and data processing workflows.
• Strong understanding of data pipeline orchestration, performance optimisation and parallel processing.
• Experience integrating cloud‑based platforms with on‑premises data sources.
• Hands‑on knowledge of AWS services such as EC2, EMR, S3 and Lambda.
• Experience with Azure data storage and processing services, including Azure Blob Storage.
• Good understanding of AWS and Azure networking, security and connectivity.
• Experience with Infrastructure as Code, particularly Terraform.
• Experience using GitLab and implementing CI/CD pipelines.
• Strong understanding of software engineering principles, automation and DevOps practices.
• Ability to translate business and technical requirements into scalable, secure and maintainable data architectures.
• Strong stakeholder engagement and communication skills.

Desirable Experience

Experience across some of the following would be beneficial:

• Designing data platforms supporting fraud detection, risk assessment or advanced analytics.
• Streaming technologies such as Kafka, AWS Kinesis or Azure Event Hubs.
• Serverless and event‑driven data processing architectures.
• Data lake, lakehouse and modern data platform architectures.
• Self‑service data ingestion and ETL frameworks.
• Python, SQL or other data engineering languages.
• Data governance, lineage, metadata management and data quality.
• Experience with large‑scale or highly regulated data environments.
• Experience delivering data solutions within Government, Defence or wider public‑sector organisations.

Security Clearance

Due to the security requirements of the assignment, candidates must hold current SC (Security Check) clearance prior to commencing the role.

Candidates must also be able to maintain the required level of security clearance for the duration of the assignment.

The Opportunity

This role would suit an experienced Data Architect who enjoys combining architectural ownership with hands‑on technical delivery.

You will work across complex AWS and Azure environments, helping design and modernise data platforms that enable efficient data processing, integration and advanced analytical capabilities.

You'll collaborate with experienced Data, Cloud, Cyber Security and Engineering specialists while playing an important role in delivering secure, scalable and high‑performing data solutions for our customers.

Benefits

Why people choose to grow their careers at UBDS Group for its reputation as a dynamic and forward‑thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting‑edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.

UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

• Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.