Data Architect - AWS & Azure

UBDS Group; Greater London; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Private medical cover

Discretionary bonus

25 Days holiday + Birthday + work ann.

EV leasing with salary sacrifice

Contributed Pension Scheme

Death in service cover

Job summary

UBDS Group is seeking an experienced Data Architect to design and deliver scalable, multi-cloud data platforms across AWS and Azure for Government and Defence environments. You will lead automated pipelines, event-driven architectures and secure data processing, collaborating with Data Engineers and Cloud Architects to drive delivery.

You will help translate complex data requirements into practical solutions, ensuring robust networking, security, and DevOps practices.

Qualifications

• Proven data architecture experience in complex environments.
• Hands-on with multi-cloud data engineering and data pipelines.
• Strong understanding of cloud data integration and distributed processing.
• Experience designing automated ETL/ELT pipelines.
• Familiarity with Spark or similar technologies.
• Knowledge of IaC, Terraform and CI/CD practices.
• Experience with security, networking and access controls in cloud.
• Ability to translate requirements into scalable data architectures.

Responsibilities

• Design scalable data architectures across AWS and Azure.
• Build automated data pipelines using cloud-native tools and Spark.
• Create data integration between cloud platforms and on‑prem sources.
• Establish event-driven architectures for near-real-time processing.
• Optimize pipelines for performance and reliability.
• Lead data engineers and delivery teams with hands-on delivery.
• Provide architectural guidance across AWS and Azure services.
• Produce architecture docs and technical designs.

Skills

Data architecture

Cloud data platforms

Multi-cloud (AWS & Azure)

ETL/ELT

CI/CD / DevOps

Terraform

GitLab

Security & compliance

Tools

AWS

Azure

Terraform

GitLab

S3

EC2

EMR

Lambda

Azure Blob Storage

Job description

At UBDS, we help organisations transform through cloud, cyber security, AI and digital innovation. We are looking for an experienced Data Architect to support the design and delivery of modern, scalable data platforms and solutions across complex Government and Defence environments.

This is a hands-on architecture role with a strong focus on multi-cloud data engineering, automated data pipelines and event-driven architectures. You will work across both AWS and Microsoft Azure, designing secure, resilient and high-performing data solutions that integrate cloud and on-premises data sources.

Working closely with Data Engineers, Cloud Architects, Software Engineers and delivery teams, you will provide technical leadership while remaining actively involved in the design, development and implementation of data solutions.

What You'll Do

• Design and deliver scalable data architectures across AWS and Azure environments.
• Define and implement automated data pipelines using cloud-native technologies and frameworks such as Apache Spark.
• Design data integration solutions connecting cloud platforms with on-premises data sources.
• Establish event-driven architectures to support efficient data processing, workflow orchestration and near-real-time data availability.
• Optimise data pipelines for performance, parallelisation, reliability and scalability.
• Design data processing capabilities that support early identification of fraud risks and other analytical use cases.
• Develop scalable approaches and tooling to enable self-service ETL and the onboarding of new data assets.
• Define data access, storage, integration and processing patterns across multi-cloud environments.
• Provide architectural guidance across AWS and Azure services, including EC2, EMR, S3, Lambda and Azure Blob Storage.
• Work with Cloud and Infrastructure teams to ensure appropriate networking, connectivity, security and access controls.
• Champion DevOps and software engineering best practices, including Infrastructure as Code, CI/CD and automated deployments.
• Support the use of Terraform, GitLab and automation tooling across data platform delivery.
• Produce architecture documentation, technical designs and implementation guidance.
• Engage with technical and business stakeholders to translate complex data requirements into practical solutions.
• Provide technical leadership and guidance to Data Engineers and wider delivery teams.

What We're Looking For

• Strong experience as a Data Architect, Cloud Data Architect or Senior Data Engineer with architectural responsibilities.
• Proven hands-on experience designing and delivering data solutions across both AWS and Microsoft Azure.
• Strong understanding of cloud data architecture, data integration and distributed data processing.
• Experience designing and implementing automated ETL/ELT pipelines.
• Experience with Apache Spark or equivalent distributed data processing technologies.
• Experience designing event-driven architectures and data processing workflows.
• Strong understanding of data pipeline orchestration, performance optimisation and parallel processing.
• Experience integrating cloud-based platforms with on-premises data sources.
• Hands-on knowledge of AWS services such as EC2, EMR, S3 and Lambda.
• Experience with Azure data storage and processing services, including Azure Blob Storage.
• Good understanding of AWS and Azure networking, security and connectivity.
• Experience with Infrastructure as Code, particularly Terraform.
• Experience using GitLab and implementing CI/CD pipelines.
• Strong understanding of software engineering principles, automation and DevOps practices.
• Ability to translate business and technical requirements into scalable, secure and maintainable data architectures.
• Strong stakeholder engagement and communication skills.

Desirable Experience

Experience across some of the following would be beneficial:

• Designing data platforms supporting fraud detection, risk assessment or advanced analytics.
• Streaming technologies such as Kafka, AWS Kinesis or Azure Event Hubs.
• Serverless and event-driven data processing architectures.
• Data lake, lakehouse and modern data platform architectures.
• Self-service data ingestion and ETL frameworks.
• Python, SQL or other data engineering languages.
• Data governance, lineage, metadata management and data quality.
• Experience with large-scale or highly regulated data environments.
• Experience delivering data solutions within Government, Defence or wider public-sector organisations.

Security Clearance

Due to the security requirements of the assignment, candidates must hold current SC (Security Check) clearance prior to commencing the role.

Candidates must also be able to maintain the required level of security clearance for the duration of the assignment.

The Opportunity

This role would suit an experienced Data Architect who enjoys combining architectural ownership with hands-on technical delivery.

You will work across complex AWS and Azure environments, helping design and modernise data platforms that enable efficient data processing, integration and advanced analytical capabilities.

You'll collaborate with experienced Data, Cloud, Cyber Security and Engineering specialists while playing an important role in delivering secure, scalable and high-performing data solutions for our customers.

Why people choose to grow their careers at UBDS Group

Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.

UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

• Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.