AWS Data Engineers

UBDS Group; Greater London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A forward-thinking technology firm in Greater London is seeking AWS Data Engineers at all levels to design and optimize scalable data pipelines using AWS services. Candidates should have strong skills in Python, SQL, and experience with containerization tools like Docker. Work will involve building efficient data solutions and collaboration with cross-functional teams, all within a dynamic environment that supports career growth and innovation.

Benefits

Training programs for personal development

Private medical cover

Discretionary bonus

25 days holiday plus extra days

Electric Vehicle leasing

Contributed Pension Scheme

Death in service cover

Qualifications

• Strong programming skills in Python and proficiency in SQL.
• Experience with Apache Airflow for DAG orchestration.
• Hands-on experience with Docker for containerisation.

Responsibilities

• Develop and maintain data pipelines using Python and SQL.
• Containerise data applications using Docker.
• Build and optimise data solutions using AWS services.

Skills

Python

SQL

Apache Airflow

Docker

AWS Redshift

AWS OpenSearch

AWS Lambda

AWS Glue

Git

Tools

GitLab

Terraform

CloudFormation

Job description

Rayo Cloud is seeking highly skilled, Security Cleared AWS Data Engineers at all levels to design, build, and maintain scalable data pipelines and infrastructure using AWS-native services. This role focuses on data orchestration, automation, and containerisation to support high-performance data workflows across the organisation.

Key Responsibilities:

• Develop and maintain data pipelines using Python, SQL, and Apache Airflow.
• Containerise data applications and workflows using Docker.
• Build and optimise data solutions using AWS services including:
• Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
• Collaborate with cross-functional teams to deliver robust, secure, and scalable data infrastructure.
• Manage version control using GitLab (or similar).
• Monitor and troubleshoot data pipeline performance and reliability.
• Contribute to documentation and process improvement initiatives.
• Ensure data quality, governance, and security best practices are followed.

Essential:

• Strong programming skills in Python and proficiency in SQL.
• Experience with Apache Airflow for DAG orchestration and monitoring.
• Hands-on experience with Docker for containerisation.
• Proficient in AWS data services:
• Redshift, OpenSearch, Lambda, Glue, Step Functions, Batch.
• Familiarity with CI/CD pipelines and YAML-based configuration (e.g., GitLab CI/CD).
• Proficient in Git and collaborative development using GitLab (or similar).
• Understanding of AWS security best practices, IAM policies, and RBAC.

Desirable Skills:

• Experience with AWS services such as Athena, SQS, CloudWatch, CloudTrail, EMR.
• Exposure to infrastructure-as-code tools (e.g., Terraform, CloudFormation).
• Familiarity with documentation tools like Confluence and README standards.
• Experience working in consulting or client-facing environments.

Soft Skills:

• Strong problem-solving and troubleshooting abilities.
• Comfortable working in Agile environments.
• Effective stakeholder management and communication skills.
• Collaborative mindset and willingness to share knowledge.

Why people choose to grow their careers at UBDS Group

Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.

UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

• Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.