Cloud Platform Engineer

Opus Recruitment Solutions Ltd; North East; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Opus Recruitment Solutions Ltd. is seeking a Cloud Platform Engineer in Newcastle (Hybrid, 3 days onsite). This 12-month fixed-term contract role focuses on building and supporting modern cloud-based data platforms using AWS, PySpark, and IaC.

You will work with Terraform, GitLab CI/CD, and collaborate with engineers to deliver secure, scalable cloud solutions. You’ll join an energetic team, contributing to pipelines, platform components, and best practices while maintaining strong communication

Qualifications

• Hands-on PySpark for data transformation and processing.
• Experience with AWS data services including Glue and S3.
• Terraform for Infrastructure as Code.
• GitLab CI/CD or similar CI/CD tooling.
• Understanding of software engineering and structured delivery.
• Experience in cloud/platform/data engineering environments.
• Strong communication and collaboration skills.
• SC Clearance eligibility is essential.

Responsibilities

• Assist in development, configuration, and testing of cloud-based Lakehouse components.
• Develop and maintain data transformation pipelines using PySpark.
• Contribute to shared libraries, reusable components, and platform improvements.
• Support cloud infrastructure deployments through Infrastructure as Code.
• Follow engineering standards, processes, and coding best practices.
• Participate in code reviews, testing, and continuous improvement.
• Collaborate with cross-functional teams to deliver technical solutions.
• Support ongoing maintenance and optimisation of platform services.

Skills

PySpark

AWS data services

SC Clearance eligibility

Software engineering principles

Cloud/data engineering environments

Strong communication

Troubleshooting

Tools

Terraform

GitLab CI/CD

AWS Glue

Amazon S3

Job description

Cloud Platform Engineer
Location: Newcastle (Hybrid, 3 days onsite)
Employment Type: 12-Month Fixed-Term Contract (with potential for permanent opportunities)
Security Clearance: SC Eligible (essential)

About the Role We are looking for a Cloud Platform Engineer to join a growing engineering team focused on building and supporting modern cloud-based data platforms. This role offers the opportunity to work with AWS technologies, data processing frameworks, and Infrastructure as Code tools within a collaborative and fast-paced environment.
You will support the development, testing, and enhancement of core platform components while working alongside experienced engineers to deliver scalable, secure, and reliable cloud solutions.

Key Responsibilities

• Assist in the development, configuration, and testing of cloud-based Lakehouse platform components.
• Develop and maintain data transformation pipelines using PySpark.
• Contribute to shared libraries, reusable components, and platform improvements.
• Support cloud infrastructure deployments through Infrastructure as Code practices.
• Follow established engineering standards, development processes, and coding best practices.
• Participate in code reviews, testing activities, and continuous improvement initiatives.
• Collaborate with cross-functional teams to deliver high-quality technical solutions.
• Support the ongoing maintenance and optimisation of platform services.

Essential Skills & Experience

• Hands-on experience with PySpark for data transformation and processing.
• Experience working with AWS data services, including:
  • AWS Glue
  • Amazon S3
• Experience using Terraform for Infrastructure as Code.
• Experience working with GitLab CI/CD or similar CI/CD pipeline tooling.
• Understanding of software engineering principles and structured delivery methodologies.
• Experience working within cloud engineering, platform engineering, or data engineering environments.
• Strong communication, problem-solving, and collaborative working skills.
• SC Clearance eligibility is essential.

Desirable Skills

• Active SC Clearance.
• Experience working with Lakehouse or modern data platform architectures.
• Understanding of DevOps practices and automation.
• Experience contributing to shared codebases and peer review processes.
• Exposure to Agile delivery methodologies.