Lead Data Engineer - Databricks

TN United Kingdom; United Kingdom; Remote; GBP 60,000 - 80,000; Full time

Job summary

A leading company in the UK is seeking a Lead Data Engineer to enhance their AI capabilities through advanced analytics. The role requires extensive experience with Databricks and offers a fully remote opportunity on a 6-month contract with potential for extension. You'll collaborate with multiple vendors to optimize data engineering processes and ensure best practices are followed.

Qualifications

• Extensive Databricks development experience.
• Up-to-date knowledge of best practices in Databricks data engineering.

Responsibilities

• Assist in building AI capabilities to drive analytics.
• Hands-on Databricks development experience.

Skills

Databricks

Performance Optimization

Git

DevOps Integration

Job description

Your new role

As a Lead Data Engineer, you will be required to assist my client in building AI capabilities to drive analytics. You will have hands-on Databricks development experience, with up-to-date knowledge of best practices within Databricks data engineering, specifically with code version management (GIT/DevOps integration), Unity Catalog, and performance optimization in Databricks transformation workloads. You will be working with multiple vendors on AI capabilities.

• C£Market rate - inside IR35
• Fully remote opportunity
• 6 Months contract (Likely extension)

What you'll need to succeed

• Extensive Databricks development experience
• Up-to-date knowledge of best practices in Databricks data engineering
• Experience with Databricks Unity Catalog and performance optimization
• Code version management (Git/DevOps integration)