Senior Data Architect - Databricks

SoCode Recruitment; London; Remote; GBP 60,000 - 100,000; Full time

Job summary

An established industry player in financial consultancy is seeking a Data Architect with expertise in Databricks to drive a transformative data platform project. This role offers the opportunity to work on a greenfield implementation, collaborating with top-tier professionals in a dynamic environment. You'll be responsible for defining architectural direction and ensuring best practices in data engineering and governance. If you're passionate about data innovation and ready to make a significant impact, this is the role for you.

Qualifications

• Proven experience as a Data Architect in enterprise environments.
• Extensive hands-on experience with Databricks including SQL and PySpark.
• Strong knowledge of Azure cloud services and data integration.

Responsibilities

• Lead the architecture and design of a next-gen data platform using Databricks.
• Collaborate with stakeholders to define data requirements and architecture patterns.
• Champion best practices in data quality, governance, and performance tuning.

Skills

Databricks

SQL

PySpark

Data Warehousing

Data Lakes

Azure Cloud Services

Data Governance

Agile Methodologies

Communication Skills

Tools

Terraform

CI/CD Pipelines

Unity Catalog

Purview

Collibra

Job description

4 days ago Be among the first 25 applicants

Direct message the job poster from SoCode Recruitment

Job Title: Data Architect – Databricks Specialist
Location: Remote (UK-based candidates preferred)
Engagement: Contract - Status determination TBC
Start Date: ASAP
Sector: Financial Services / Consultancy

About the Role We’re looking for an experienced Data Architect with deep expertise in Databricks to join a high-profile data transformation programme within a leading financial consultancy. You will be instrumental in the design and delivery of a scalable, secure, and high-performing data platform leveraging the Databricks Lakehouse architecture.
This is a critical project where you’ll step into a mature environment, helping to define architectural direction and ensure best practices in data engineering, governance, and performance optimisation.

Key Responsibilities

• Lead the architecture and design of a next-gen data platform using Databricks and Delta Lake
• Collaborate with stakeholders including data engineers, analysts, and business leads to define data requirements and architecture patterns
• Ensure the platform is scalable, secure, and aligned to financial regulatory standards
• Develop architectural artefacts (diagrams, documentation, guidelines)
• Provide technical leadership and mentorship to engineering teams
• Champion best practices in data quality, lineage, governance, and performance tuning
• Integrate with a wider Azure ecosystem (e.g. Azure Data Lake, Synapse, Power BI)

Required Skills & Experience

• Proven experience as a Data Architect in enterprise environments
• Extensive hands-on experience with Databricks (including SQL, PySpark, Delta Lake)
• Solid background in data warehousing, data lakes, and big data frameworks
• Strong knowledge of Azure cloud services, especially in data integration
• Experience working in regulated environments (e.g. financial services, insurance, banking)
• Excellent communication skills, capable of engaging with technical and non-technical stakeholders alike
• Comfortable working in agile, fast-paced delivery environments

Nice to Have

• Familiarity with CI/CD pipelines, Infrastructure as Code (e.g. Terraform, ARM)
• Exposure to data governance tools like Unity Catalog, Purview, Collibra
• Knowledge of data privacy regulations (GDPR, financial compliance)

Why Join?

• Join a respected financial consultancy at the forefront of data innovation
• Work on a greenfield Databricks implementation with high visibility
• Collaborate with top-tier engineering and architecture professionals
• Long-term potential with future project opportunities

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Contract

Job function

• Job function

  Finance

Referrals increase your chances of interviewing at SoCode Recruitment by 2x

Sign in to set job alerts for “Senior Data Architect” roles.

London, England, United Kingdom 3 hours ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 day ago

Croydon, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 months ago

Slough, England, United Kingdom 1 week ago

London, England, United Kingdom 4 days ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

Greater London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 3 days ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 6 days ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 6 months ago

London, England, United Kingdom 2 weeks ago

Greater London, England, United Kingdom 3 weeks ago

City Of London, England, United Kingdom 6 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.