Lead Data Architect & Engineer — Remote UK

Arc IT Recruitment Limited; Greater London; Remote; GBP 100,000 - 110,000; Full time

Job summary

Arc IT Recruitment Limited is seeking a hands‑on Data Architect for a fast‑growing fintech client. You will own the data platform design and also implement pipelines, acting as the go‑to data engineering expert across the business.

Responsibilities include building scalable pipelines on Azure Databricks, shaping lakehouse architecture with Spark and Delta Lake, and refining Snowflake environments for performance and cost. Remote-first with UK emphasis and monthly London meetups.

Qualifications

• Strong Azure background with data platforms in Azure environments.
• Hands-on engineering skills; you still write code.
• Deep expertise with Databricks, Spark, Delta Lake and Lakehouse.
• Snowflake architecture and optimisation experience.
• Experience with Azure Data Factory, ADLS Gen2, Synapse and/or Fabric.
• Data modelling across Kimball, Inmon and Data Vault.
• Strong SQL, Python, Spark and Snowflake SQL skills.
• Experience with CI/CD and IaC tools like Terraform, ARM or Bicep.
• Knowledge of governance and cataloguing tools (Microsoft Purview).
• Confidence to own design decisions as data expert.

Responsibilities

• Own data architecture while staying hands-on as a senior data engineer.
• Be the go-to expert for data engineering questions, standards and decisions.
• Lead design of data solutions from conceptual models to physical implementation.
• Build and maintain scalable pipelines and lakehouse solutions (Azure Databricks, Spark, Delta Lake).
• Design and optimise Snowflake environments for performance, scale and cost.
• Support batch, streaming, real-time data processing at high volumes.
• Embed governance, lineage, metadata and data quality practices.
• Drive automation via CI/CD and Infrastructure as Code.
• Collaborate with engineering, analytics and data science teams as the trusted data voice.
• Evaluate new technologies and shape long-term platform roadmap.

Skills

Azure

Databricks

Spark

Delta Lake

Snowflake

SQL

Python

CI/CD

Infrastructure as Code

Terraform

ARM/Bicep

Purview

Data modeling

Governance

Tools

Azure Data Factory

ADLS Gen2

Synapse Analytics

Microsoft Fabric

Job description

Arc IT Recruitment Limited is seeking a hands‑on Data Architect for a fast‑growing fintech client. You will own the data platform design and also implement pipelines, acting as the go‑to data engineering expert across the business.

Responsibilities include building scalable pipelines on Azure Databricks, shaping lakehouse architecture with Spark and Delta Lake, and refining Snowflake environments for performance and cost. Remote-first with UK emphasis and monthly London meetups.