Databricks Data Engineer – Azure, Medallion Architecture (PE)

twentyAI; City Of London; On-site; GBP 77,000 - 129,000; Full time

Job summary

twentyAI is hiring a Data Engineer in London to design and build the firm’s first Databricks environment on Azure, implementing a bronze/silver/gold medallion architecture and delivering a trusted golden data source for Finance, Portfolio Operations, and Compliance.

You will collaborate with senior stakeholders to translate business needs into scalable data pipelines, optimize performance, and ensure data quality ahead of the next fund launch.

Qualifications

• Proven delivery of Databricks/Delta Lake builds.
• Strong PySpark and medallion architecture knowledge.
• Azure data platform experience.

Responsibilities

• Design and build the firm's first Databricks instance on Azure.
• Own the technical delivery of the data platform end-to-end.

Skills

Databricks

Delta Lake

Medallion architecture

PySpark

Azure

Stakeholder management

Private Equity experience

Tools

Azure Analysis Services

Job description

twentyAI is hiring a Data Engineer in London to design and build the firm’s first Databricks environment on Azure, implementing a bronze/silver/gold medallion architecture and delivering a trusted golden data source for Finance, Portfolio Operations, and Compliance.

You will collaborate with senior stakeholders to translate business needs into scalable data pipelines, optimize performance, and ensure data quality ahead of the next fund launch.