AWS Data Platform Engineer / Administrator

UBDS Group; City Of London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A forward-thinking technology firm in the United Kingdom is seeking an experienced AWS Cloud Engineer with active SC Clearance. In this role, you will design and optimize cloud infrastructure and CI/CD pipelines, manage AWS data services, and collaborate with cross-functional teams to support large-scale operations. The ideal candidate will have hands-on experience with AWS services and Terraform. Competitive benefits include training programs, private medical cover, and a discretionary bonus.

Benefits

Training opportunities

Private medical cover

Discretionary bonus

25 days holiday plus additional days

Electric Vehicle leasing

Contributed Pension Scheme

Death in service cover

Qualifications

• Strong hands-on experience with AWS-native data services.
• Strong hands-on experienced with Terraform for IaC.
• Experience with Airflow for DAG orchestration.

Responsibilities

• Provision, manage, and maintain AWS data services.
• Implement and maintain Infrastructure as Code using Terraform.
• Support CI/CD pipelines and version control using GitLab.

Skills

Experience with AWS data services (S3, Redshift, etc.)

Terraform for Infrastructure as Code

Airflow for DAG orchestration

YAML for CI/CD pipelines

Python, SQL, Bash for automation

AWS Security best practices

AWS Networking and VPC

Containerisation using Docker

Job description

Overview

We are seeking an experience AWS Cloud Engineer with an active SC Clearance to design, implement, and optimise the cloud infrastructure and CI/CD pipelines of AWS data infrastructure. This role focuses on AWS-native data services, infrastructure automation, and orchestration to support large-scale data operations.

Responsibilities

• Provision, manage, and maintain AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch.
• Implement and maintain Infrastructure as Code (IaC) using Terraform.
• Manage orchestration workflows using Apache Airflow.
• Support CI/CD pipelines and version control using GitLab.
• Monitor and maintain core services such as S3 security file scanning, monitoring and reporting of data infrastructure access and usage patterns, and data ingress/egress patterns.
• Managing infrastructure that supports Data Engineering workflows including: disaster recovery, performance improvements, coding patterns.
• Collaborate with cross-functional teams (Data Engineering, SRE, Security) to ensure robust and secure data operations.
• Troubleshoot and resolve incidents related to AWS data infrastructure.
• Contribute to documentation and process improvement initiatives.
• Managing and monitoring access and RBAC controls.

Requirements

• Strong hands-on experience with AWS native data services including S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Athena, Step Function, SQS, CloudWatch, CloudTrail, EMR.
• Strong hands-on experienced with Terraform for IaC.
• Experience with Airflow for DAG orchestration and monitoring.
• Experience with YAML for CI/CD pipelines (e.g. GitLab CI/CD, GitHub Actions).
• Experience with Python, SQL and Bash for automation, querying and troubleshooting.
• Understanding of AWS Security best practices, IAM policies and RBAC.
• Understanding of AWS Networking and VPC
• Experience with containerisation using Docker
• Experience with Disaster Recovery, backups and snapshots.

Desirable Skills

• Understanding of AWS Neptune, EKS
• Experience with Jira Service Desk
• Experience supporting Data Engineers
• Experience working as a consultant
• README and Confluence documentation

Soft Skills

• Strong problem-solving and troubleshooting skills.
• Ability to work in an Agile environment.
• Comfortable with stakeholder management
• Excellent communication and collaboration skills.

Benefits

Why people choose to grow their careers at UBDS Group

Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group's culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.

UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

• Training - All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday - You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.