SC Cleared Databricks Architect | Remote

SR2 - Socially Responsible Recruitment; Greater London; À distance; GBP 111 000 - 120 000; Plein temps

Résumé du poste

SR2 - Socially Responsible Recruitment is seeking an experienced Databricks Architect to shape an enterprise Databricks environment on AWS. The role focuses on platform foundations, reusable data products and secure governance across data workloads.

You will work with engineering, governance and business teams to define architecture that enables data discovery, access and self-service analytics while meeting security and cost objectives.

Qualifications

• Strong enterprise Databricks architecture experience.
• Expertise with Delta Lake and Unity Catalog.
• Experience integrating Databricks with AWS services.
• Knowledge of security, governance and data sharing in large organisations.
• Ability to communicate architectural decisions clearly to multidisciplinary teams.

Responsabilités

• Define architecture for Databricks platforms and data products with reference designs.
• Shape AWS platform foundations and data processing patterns for batch/streaming workloads.
• Establish data modelling standards, data contracts and metadata governance.
• Design governance and access controls via Unity Catalog for discovery and secure sharing.
• Lead design reviews and workshops, offering technical direction to delivery teams.

Description du poste

SC Cleared Databricks Architect | Remote

SR2 is supporting a major public sector data transformation programme seeking experienced Databricks Architects. We're interested in architects with strengths in platform design, data product architecture, or both.

The Role

You'll help shape an enterprise Databricks environment on AWS, supporting secure platform foundations and trusted, reusable data products. Working with engineering, governance and business teams, you'll define architecture that enables teams to discover, access and use data effectively.

Your focus will reflect your expertise, spanning platform infrastructure and integration through to data modelling, product standards and self-service analytics.

Key Responsibilities

• Define architecture, reference designs and reusable patterns for Databricks platforms and data products.

• Shape AWS platform foundations, integration approaches and processing patterns for batch and streaming workloads.

• Establish standards for data modelling, data contracts, metadata, quality and product life cycle management.

• Design governance and access controls through Unity Catalog, supporting discovery, lineage and secure data sharing.

• Guide performance, reliability and cost decisions across platform services and data workloads.

• Lead design reviews and stakeholder workshops, providing technical assurance and direction to delivery teams.

Essential

• Strong architecture experience delivering enterprise Databricks and Lakehouse solutions.

• Expertise in Delta Lake, Unity Catalog and modern data engineering patterns.

• Experience integrating Databricks with AWS, including relevant storage, identity and networking services.

• A strong background in either:

  • Platform architecture: AWS infrastructure, medallion architecture, compute, orchestration, Terraform and deployment automation.

  • Data product architecture: reusable data products, data contracts, modelling, metadata, governance and self-service consumption.

• Understanding of security, access management and governance within complex organisations.

• Ability to communicate architecture decisions clearly and guide multidisciplinary teams.

• SC clearance required.

Desirable

• Knowledge of Spark, dbt, Databricks SQL or Workflows.

• Experience applying data mesh principles and enabling governed data sharing.

• Relevant Databricks, AWS, Terraform or data management certifications.

The Details

• Contract role: 6-month rolling contract

• IR35 Status: Inside IR35

• Rate: £600-£650

• Location: Mainly remote - ad hoc visits in London.

• Clearance: SC required