Lead Data Engineer - Databricks

hays-gcj-v4-pd-online; United Kingdom; Remote; GBP 50,000 - 70,000; Full time

Job summary

A leading company seeks a Lead Data Engineer to enhance AI capabilities through advanced Databricks development. The role involves working remotely for a 6-month contract with potential for extension, requiring expertise in Databricks, performance optimisation, and version control. Candidates should possess strong knowledge of data engineering practices and hands-on experience in the field.

Qualifications

• Extensive experience with Databricks development.
• Knowledge of coding best practices and performance optimisation.
• Familiarity with Git/DevOps practices.

Responsibilities

• Assist client in building AI capabilities.
• Develop Databricks solutions focusing on analytics and performance.
• Collaborate with multiple vendors.

Skills

Databricks best practices

Databricks development experience

Git integration

DevOps integration

Performance optimisation

Job description

Your new role

As a Lead Data Engineer, you will be required to assist my client in building AI capabilities to drive analytics. You will have hands-on Databricks development experience, with up-to-date knowledge of best practices within Databricks data engineering, specifically with code version management (GIT/DevOps integration), Unity Catalog, and performance optimisation in Databricks transformation workloads. You will be working with multiple vendors on AI capabilities.

• C£Market rate - inside IR35
• Fully remote opportunity
• 6 Months contract (Likely extension)

What you'll need to succeed

• Databricks best practices
• Extensive Databricks development experience
• Up-to-date knowledge of best practices in Databricks data engineering
• Experience with Databricks Unity Catalog and performance optimisation
• Code version management (Git/DevOps integration)