SC Cleared Databricks Architect | Remote

SR2 REC LTD; Greater London; Remote; GBP 111,000 - 120,000; Full time

Job summary

SR2 REC LTD is seeking an SC-cleared Databricks Architect to shape an enterprise Databricks environment on AWS and deliver data products with secure, governed access. The role focuses on platform infrastructure, data modelling, and self-service analytics, with a strong emphasis on security and governance.

The position is mainly remote with ad hoc visits to London, offering a 6-month rolling contract and inside IR35.

Qualifications

• Experience delivering enterprise Databricks and Lakehouse solutions.
• Expertise in Delta Lake, Unity Catalog and data engineering patterns.
• Experience integrating Databricks with AWS services.
• Strong background in platform or data product architecture.
• SC clearance is required.
• Ability to communicate architecture decisions clearly and guide multidisciplinary teams.
• Knowledge of security, access management and governance in large organisations.

Responsibilities

• Define architecture, reference designs and reusable patterns for Databricks platforms and data products.
• Shape AWS platform foundations, integration approaches and processing patterns for batch and streaming workloads.
• Establish standards for data modelling, data contracts, metadata, quality and product lifecycle management.
• Design governance and access controls through Unity Catalog, supporting discovery, lineage and secure data sharing.
• Guide performance, reliability and cost decisions across platform services and data workloads.
• Lead design reviews and stakeholder workshops, providing technical assurance and direction to delivery teams.

Skills

Databricks architecture

Delta Lake

Unity Catalog

AWS data integration

Data governance

Security governance

Stakeholder communication

SC clearance

Tools

Terraform

Job description

SC Cleared Databricks Architect | Remote

SR2 is supporting a major public sector data transformation programme seeking experienced Databricks Architects. We're interested in architects with strengths in platform design, data product architecture, or both.

The Role

You’ll help shape an enterprise Databricks environment on AWS, supporting secure platform foundations and trusted, reusable data products. Working with engineering, governance and business teams, you’ll define architecture that enables teams to discover, access and use data effectively.

Your focus will reflect your expertise, spanning platform infrastructure and integration through to data modelling, product standards and self-service analytics.

Key Responsibilities

• Define architecture, reference designs and reusable patterns for Databricks platforms and data products.

• Shape AWS platform foundations, integration approaches and processing patterns for batch and streaming workloads.

• Establish standards for data modelling, data contracts, metadata, quality and product lifecycle management.

• Design governance and access controls through Unity Catalog, supporting discovery, lineage and secure data sharing.

• Guide performance, reliability and cost decisions across platform services and data workloads.

• Lead design reviews and stakeholder workshops, providing technical assurance and direction to delivery teams.

Essential

• Strong architecture experience delivering enterprise Databricks and Lakehouse solutions.

• Expertise in Delta Lake, Unity Catalog and modern data engineering patterns.

• Experience integrating Databricks with AWS, including relevant storage, identity and networking services.

• A strong background in either:

  • Platform architecture: AWS infrastructure, medallion architecture, compute, orchestration, Terraform and deployment automation.

  • Data product architecture: reusable data products, data contracts, modelling, metadata, governance and self-service consumption.

• Understanding of security, access management and governance within complex organisations.

• Ability to communicate architecture decisions clearly and guide multidisciplinary teams.

• SC clearance required.

Desirable

• Knowledge of Spark, dbt, Databricks SQL or Workflows.

• Experience applying data mesh principles and enabling governed data sharing.

• Relevant Databricks, AWS, Terraform or data management certifications.

The Details

• Contract role: 6-month rolling contract

• IR35 Status: Inside IR35

• Rate: £600-£650

• Location: Mainly remote - ad hoc visits in London.

• Clearance: SC required

If you are a Databricks Architect with platform or data product expertise and this looks of interest, please apply for immediate consideration.