AWS / Databricks Platform Engineer - Outside IR35

Shareforce; Remote; GBP 80,000 - 100,000; Part time

Job summary

A leading technology consulting firm is looking for an experienced Platform Engineer to support the rollout of a large-scale Data and AI platform. Your responsibilities will include designing and maintaining AWS infrastructure, managing CI/CD pipelines, and ensuring security and compliance. This role is remote with occasional travel to London, and the day rate is up to £550 for an initial 3-month contract, with a potential for extension.

Qualifications

• Proven experience delivering Terraform-based AWS infrastructure.
• Strong understanding of GitHub Actions and CI/CD automation.
• Hands-on expertise with AWS Private Link and VPC networking.

Responsibilities

• Design, build, and maintain AWS infrastructure using Terraform.
• Develop, manage, and optimise CI/CD pipelines.
• Implement secure network connectivity using AWS PrivateLink.
• Monitor and optimise cloud cost efficiency.

Skills

AWS Infrastructure with Terraform

CI/CD Automation with GitHub Actions

AWS Private Link

Databricks and Unity Catalog

AWS Organizations and Compliance

AWS IAM and OAuth

Security Best Practices

Cloud Cost Optimization

Collaboration Skills

Job description

We are seeking an experienced Platform Engineer to support the rollout and ongoing operation of a large-scale, federated Data and AI platform. The role will focus on building secure, scalable, and cost-optimised AWS infrastructure, implementing governance, and enabling advanced data services across multiple business domains.

Key Responsibilities

• Design, build, and maintain AWS infrastructure using Terraform (IaC).
• Develop, manage, and optimise CI/CD pipelines with GitHub Actions.
• Implement secure network connectivity using AWS PrivateLink (Interface VPC Endpoints) and VPC endpoint services.
• Configure and govern Databricks and Unity Catalog to ensure compliant data access and lineage.
• Enforce consistency and control through AWS Organizations, Service Control Policies (SCPs), AWS Config, and compliance frameworks.
• Manage identity and access management (IAM) using OAuth, federated credentials, and RBAC principles.
• Apply AWS security best practices, including Defense in Depth, BCDR, and high availability.
• Monitor and optimise cloud cost efficiency using AWS Cost Explorer, Budgets, and FinOps best practices.
• Collaborate with data, platform, and security teams to ensure a resilient, governed, and high-performing cloud ecosystem.

Required Skills & Experience

• Proven experience delivering Terraform-based AWS infrastructure.
• Strong understanding of GitHub Actions and CI/CD automation.
• Hands‑on expertise with AWS Private Link, VPC networking, and secure service exposure.
• Deep knowledge of Databricks and Unity Catalog for governance and security.
• Solid experience with AWS Organizations, SCPs, AWS Config, and resource governance.
• Background in AWS IAM, federated authentication, OAuth, and identity integration.
• Proven ability to design with security, resilience, and cost-optimisation in mind.
• Excellent collaboration and documentation skills within cross‑functional teams.

Additional Information

• Day Rate: Up to £550
• IR35 Status: Outside IR35
• Start Date: February
• Duration: Initial 3-month contract, significant opportunity for extension
• Location: Remote with occasional travel to client site (London)