Data Architect - AWS & Azure

Ubds-Group; Greater London; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Training

Private medical cover

Discretionary bonus

Holidays

EV leasing

Pension

Death in service

Job summary

UBDS Group is seeking an experienced Data Architect to design scalable data platforms across AWS and Azure, delivering secure, high-performance solutions for Government and Defence contexts.

You will work hands-on with data engineers and cloud experts to implement automated pipelines, event-driven processes and IaC, while guiding delivery and ensuring robust security and compliance.

Qualifications

• Proven hands-on data architecture across AWS and Azure.
• Experience designing and delivering automated ETL/ELT pipelines.
• Strong understanding of data governance and security considerations.

Responsibilities

• Design scalable data architectures across AWS and Azure environments.
• Define and implement automated data pipelines using cloud-native technologies.
• Establish event-driven architectures to support near-real-time data availability.
• Provide architectural guidance across AWS and Azure services, including EC2, EMR, S3, Lambda and Azure Blob Storage.
• Champion IaC, CI/CD and automated deployments.

Skills

Data Architecture

AWS

Azure

ETL/ELT

Apache Spark

Event-driven architectures

Terraform

GitLab

CI/CD

Security & Governance

Tools

Terraform

GitLab

Apache Spark

Job description

At UBDS, we help organisations transform through cloud, cyber security, AI and digital innovation. We are looking for an experienced Data Architect to support the design and delivery of modern, scalable data platforms and solutions across complex Government and Defence environments.

This is a hands-on architecture role with a strong focus on multi-cloud data engineering, automated data pipelines and event-driven architectures. You will work across both AWS and Microsoft Azure, designing secure, resilient and high-performing data solutions that integrate cloud and on-premises data sources.

Working closely with Data Engineers, Cloud Architects, Software Engineers and delivery teams, you will provide technical leadership while remaining actively involved in the design, development and implementation of data solutions.

What You'll Do

• Design and deliver scalable data architectures across AWS and Azure environments.
• Define and implement automated data pipelines using cloud-native technologies and frameworks such as Apache Spark.
• Design data integration solutions connecting cloud platforms with on-premises data sources.
• Establish event-driven architectures to support efficient data processing, workflow orchestration and near-real-time data availability.
• Optimise data pipelines for performance, parallelisation, reliability and scalability.
• Design data processing capabilities that support early identification of fraud risks and other analytical use cases.
• Develop scalable approaches and tooling to enable self-service ETL and the onboarding of new data assets.
• Define data access, storage, integration and processing patterns across multi-cloud environments.
• Provide architectural guidance across AWS and Azure services, including EC2, EMR, S3, Lambda and Azure Blob Storage.
• Work with Cloud and Infrastructure teams to ensure appropriate networking, connectivity, security and access controls.
• Champion DevOps and software engineering best practices, including Infrastructure as Code, CI/CD and automated deployments.
• Support the use of Terraform, GitLab and automation tooling across data platform delivery.
• Produce architecture documentation, technical designs and implementation guidance.
• Engage with technical and business stakeholders to translate complex data requirements into practical solutions.
• Provide technical leadership and guidance to Data Engineers and wider delivery teams.

What We're Looking For

• Strong experience as a Data Architect, Cloud Data Architect or Senior Data Engineer with architectural responsibilities.
• Proven hands-on experience designing and delivering data solutions across both AWS and Microsoft Azure.
• Strong understanding of cloud data architecture, data integration and distributed data processing.
• Experience designing and implementing automated ETL/ELT pipelines.
• Experience with Apache Spark or equivalent distributed data processing technologies.
• Experience designing event-driven architectures and data processing workflows.
• Strong understanding of data pipeline orchestration, performance optimisation and parallel processing.
• Experience integrating cloud-based platforms with on-premises data sources.
• Hands-on knowledge of AWS services such as EC2, EMR, S3 and Lambda.
• Experience with Azure data storage and processing services, including Azure Blob Storage.
• Good understanding of AWS and Azure networking, security and connectivity.
• Experience with Infrastructure as Code, particularly Terraform.
• Experience using GitLab and implementing CI/CD pipelines.
• Strong understanding of software engineering principles, automation and DevOps practices.
• Ability to translate business and technical requirements into scalable, secure and maintainable data architectures.
• Strong stakeholder engagement and communication skills.

Desirable Experience

Experience across some of the following would be beneficial:

• Designing data platforms supporting fraud detection, risk assessment or advanced analytics.
• Streaming technologies such as Kafka, AWS Kinesis or Azure Event Hubs.
• Serverless and event-driven data processing architectures.
• Data lake, lakehouse and modern data platform architectures.
• Self-service data ingestion and ETL frameworks.
• Python, SQL or other data engineering languages.
• Data governance, lineage, metadata management and data quality.
• Experience with large-scale or highly regulated data environments.
• Experience delivering data solutions within Government, Defence or wider public-sector organisations.

Security Clearance

Due to the security requirements of the assignment, candidates must hold current SC (Security Check) clearance prior to commencing the role.

Candidates must also be able to maintain the required level of security clearance for the duration of the assignment.

The Opportunity

This role would suit an experienced Data Architect who enjoys combining architectural ownership with hands-on technical delivery.

You will work across complex AWS and Azure environments, helping design and modernise data platforms that enable efficient data processing, integration and advanced analytical capabilities.

You'll collaborate with experienced Data, Cloud, Cyber Security and Engineering specialists while playing an important role in delivering secure, scalable and high-performing data solutions for our customers.

Why people choose to grow their careers at UBDS Group

Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth.

UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

• Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.