Data Engineer (Databricks)

iO Associates; Manchester; On-site; GBP 100,000 - 125,000; Full time

Job summary

A leading recruitment firm is seeking a skilled Databricks Engineer to join a client's data team in Manchester. The successful candidate will work on designing and implementing Databricks solutions, optimizing performance, and collaborating with stakeholders. Essential skills include experience with Databricks, Spark, Scala, Python, SQL, and cloud platforms like AWS or Azure. This is an onsite role, so presence in Manchester is required.

Qualifications

• Proven experience working with Databricks in a similar role.
• Strong knowledge of Spark, Scala, Python, and SQL.
• Experience with cloud platforms such as AWS or Azure.
• Ability to work collaboratively in a fast-paced environment.
• Excellent problem-solving and communication skills.

Responsibilities

• Work closely with cross-functional teams to design, develop, and implement Databricks solutions.
• Manage and optimise the performance of Databricks clusters.
• Collaborate with stakeholders to gather requirements and provide technical guidance.
• Troubleshoot and resolve complex issues related to Databricks infrastructure.

Skills

Databricks

Spark

Scala

Python

SQL

AWS

Azure

Problem-solving

Communication

Job description

I am on the look out for a skilled Databricks Engineer to join my client's data team whilst they are in a period of driving growth & effiency. This role is outside IR35 & will require some onsite presence in either Birmigham or Manchester.

Responsibilities

• Work closely with cross-functional teams to design, develop, and implement Databricks solutions.

• Manage and optimise the performance of Databricks clusters.

• Collaborate with stakeholders to gather requirements and provide technical guidance.

• Troubleshoot and resolve complex issues related to Databricks infrastructure.

Essential Skills & Experience

• Proven experience working with Databricks in a similar role.

• Strong knowledge of Spark, Scala, Python, and SQL.

• Experience with cloud platforms such as AWS or Azure.

• Ability to work collaboratively in a fast-paced environment.

• Excellent problem-solving and communication skills.

Desirable Skills & Experience

• Certification in Databricks or related technologies.

• Familiarity with machine learning and data analytics.

• Previous experience in data pipeline development.

• Knowledge of DevOps principles.

Please note this role unfortunately is not able to accomodate visas & due to volume of expected candidates, plus those already in our network, it is unlikely we are able to repond to you all but thank you for taking the time to apply.