Azure Databricks Platform Architect | FinOps & Data Platform

Square One Resources

Greater London

Hybrid

GBP 90,000 - 130,000

Full time

5 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Square One Resources is seeking a hands-on Azure Databricks Platform Engineer / Architect in London, combining architecture, engineering, platform optimisation and production support. The role focuses on a delivery-led transformation, with three days onsite and two days remote each week.

You will optimise the Databricks platform, control costs through FinOps and advance the Discovery Zone to migrate analytics workloads from POSIT/RStudio to Databricks, collaborating with data scientists,

Qualifications

Hands-on experience implementing and optimising Azure Databricks platforms.
Ability to design compute policies, autoscaling and guardrails.
Experience reducing costs through FinOps and tagging.
Desirable migration experience of POSIT/RStudio workloads to Databricks.
Strong Python, PySpark and SQL development skills.
Enterprise data engineering and production platform exposure.

Responsibilities

Design, configure and optimise Azure Databricks environments across Serverless, Jobs Compute, Interactive Compute and Classic Clusters.
Assess workloads to select the most appropriate compute model balancing performance, SLA, utilisation and cost.
Implement compute policies, autoscaling, quotas, budgets and governance guardrails.
Troubleshoot production issues and continuously improve platform performance and reliability.
Optimise Databricks SQL, Delta Lake and workload performance.