Databricks Data Engineer for AI-Driven Platform

Two Circles; Greater London; In loco; GBP 70.000 - 110.000; Tempo pieno

Vantaggi offerti da questo lavoro

Discretionary Bonus

Performance reviews every 6 months

Summer Away Days

Private healthcare

Gym membership

Cycle to work

Learning & Development opportunities

Descrizione del lavoro

Two Circles in London is seeking a Data Engineer to design, build, and optimise scalable data pipelines on Databricks, leveraging Delta Lake and Unity Catalog for robust data governance. You will write clean Python code and work in an Agile team to deliver data-driven insights for the sports industry.

The role requires strong Databricks production experience, PySpark and Spark SQL, plus SQL proficiency. A coachable mindset and willingness to learn AI-assisted development are essential.

Competenze

• Hands-on production Databricks experience with Delta Lake and Unity Catalog.
• Strong Python (object-oriented) and clean, testable code.
• Solid SQL for data querying and analysis.
• Experience with Agile development and CI/CD practices.
• Willingness to learn AI-assisted development and coachable mindset.
• Experience in data lakehouse environments.

Mansioni

• Design, build, and optimise scalable data pipelines on Databricks.
• Collaborate with product and marketing to deliver data-driven insights.
• Extend Azure data platform (ADF, Function Apps) and CI/CD.
• Actively improve the Databricks platform with modernization.
• Work within an Agile sprint framework.

Conoscenze

Databricks

Python

SQL

Agile

Teamwork

Coachable

Formazione

Databricks Certification

Strumenti

Delta Lake

Unity Catalog

PySpark

Spark SQL

Azure DevOps

Azure Data Factory

Copilot

Descrizione del lavoro

Two Circles in London is seeking a Data Engineer to design, build, and optimise scalable data pipelines on Databricks, leveraging Delta Lake and Unity Catalog for robust data governance. You will write clean Python code and work in an Agile team to deliver data-driven insights for the sports industry.

The role requires strong Databricks production experience, PySpark and Spark SQL, plus SQL proficiency. A coachable mindset and willingness to learn AI-assisted development are essential.