Databricks Resident Solutions Architect — SC Cleared (Gov)

Consult; Greater London; Hybrid; GBP 120,000 - 166,000; Full time

Benefits offered by this job

Job summary

Consult is seeking a Databricks Resident Solutions Architect (SC Cleared) to work on a UK public sector engagement in London. The role is contract-based with an initial 6 months and strong extension potential, onsite as required with hybrid attendance.

You will design, govern and deliver a robust Databricks Lakehouse, implement Unity Catalog governance, and drive production-grade pipelines while ensuring UK-sovereign data handling and cost visibility. Start ASAP.

Qualifications

• Active UK SC clearance from day one.
• Current DPP vetting as a Databricks Resident Solutions Architect or equivalent status.
• 4+ years hands-on Databricks delivery with at least two end-to-end production implementations as lead/architect.
• Deep Unity Catalog experience with RBAC on sensitive data.
• Strong PySpark, Spark SQL and Delta Lake experience, including performance tuning at scale.
• Production pipelines with Lakeflow, DLT, Workflows and DABs.

Responsibilities

• Lead the architecture and build of a secure Databricks Lakehouse on Azure or AWS, using medallion design (bronze, silver, gold).
• Design and implement Unity Catalog governance: catalogues, schemas, RBAC, row/column security, lineage and audit for government data.
• Build production-grade ingestion and pipelines with Lakeflow Connect, Lakeflow Declarative Pipelines, (DLT) and Workflows; move beyond notebooks to deployable code.
• Establish CI/CD and platform engineering standards using Databricks Asset Bundles (DABs), Terraform and Azure DevOps or GitHub Actions.
• Lead migrations from legacy platforms with clear cut-over and reconciliation plans.
• Monitor and optimise DBU consumption and cluster policies for cost visibility.
• Enable MLOps and GenAI use cases including MLflow, Model Serving and Genie.
• Act as trusted advisor to client stakeholders with workshops and architecture reviews.
• Coach and upskill client and partner engineers towards self-sufficiency.
• Support pre-sales and RFP responses with solution design and estimates.

Job description

Consult is seeking a Databricks Resident Solutions Architect (SC Cleared) to work on a UK public sector engagement in London. The role is contract-based with an initial 6 months and strong extension potential, onsite as required with hybrid attendance.

You will design, govern and deliver a robust Databricks Lakehouse, implement Unity Catalog governance, and drive production-grade pipelines while ensuring UK-sovereign data handling and cost visibility. Start ASAP.