Remote Databricks Data Engineer | Spark, PySpark & ETL

ISx4 Group; United Kingdom; On-site; GBP 40,000 - 65,000; Full time

Job summary

ISx4 Group is seeking a Data Engineer specialized in Databricks to design and build scalable data pipelines. The role involves collaborating within an agile team to deliver high-quality data solutions for enterprise clients in a remote capacity.

Candidates should have over 3 years of experience in developing production data pipelines using tools like Databricks, Python, and SQL. The position requires strong collaboration and communication skills, along with a passion for data engineering.

Qualifications

• 3+ years experience building production data pipelines.
• Strong development skills in Python and Microsoft SQL Server.
• Hands-on experience with Databricks, Spark, and PySpark.

Responsibilities

• Design and implement ELT/ETL pipelines using PySpark and Databricks.
• Build scalable batch and streaming data pipelines using Spark and Kafka.
• Ensure high data quality and enable analytics for enterprise clients.

Skills

Python

Microsoft SQL Server

Databricks

Spark

PySpark

REST APIs

Kafka

Tools

Databricks Workflows

Delta Lake

Hadoop

Job description

ISx4 Group is seeking a Data Engineer specialized in Databricks to design and build scalable data pipelines. The role involves collaborating within an agile team to deliver high-quality data solutions for enterprise clients in a remote capacity.

Candidates should have over 3 years of experience in developing production data pipelines using tools like Databricks, Python, and SQL. The position requires strong collaboration and communication skills, along with a passion for data engineering.