AWS Databricks Data Engineer – Delta Lake

Ronald James; Newcastle upon Tyne; On-site; GBP 50,000 - 60,000; Full time

Benefits offered by this job

Staff discounts

Perkbox portal access

Cycle to work scheme

Breakfast and drinks provided

Company events

Job summary

Ronald James is seeking a Data Engineer in Newcastle upon Tyne to build robust data pipelines in the AWS ecosystem. The role focuses on Delta Lakehouse on Databricks, data modelling and governance to deliver reliable, scalable data solutions for stakeholders.

Required are strong Python/SQL/Scala skills, ETL leadership, and a track record in retail data environments. Attractive benefits and ongoing tech investment are provided.

Qualifications

• Proficiency in AWS services including Lambda, Kinesis and Glue.
• Hands-on experience with Databricks and Delta Lakehouse architectures.
• Proficient in Python, SQL and Scala for data engineering tasks.
• Design, build and maintain ETL processes.
• Experience with large datasets and data modelling.
• Knowledge of data governance and data security best practices.

Responsibilities

• Build and optimize data ingestion pipelines using AWS services (Lambda, Kinesis, Glue).
• Develop and optimize transformation pipelines within Delta Lake on Databricks.
• Design and implement efficient data models for storage and retrieval.
• Collaborate with data scientists, analysts and stakeholders to meet data needs.
• Ensure data reliability, integrity and timeliness with quality checks.
• Optimize queries and data retrieval performance.
• Stay updated with AWS, Databricks advancements; suggest new tools.

Skills

AWS services

Delta Lakehouse

Python

SQL

Scala

ETL

Data modelling

Data governance

Data security

Databricks

Education

AWS and/or Databricks Certification

Tools

Lambda

Kinesis

Glue

Job description

Ronald James is seeking a Data Engineer in Newcastle upon Tyne to build robust data pipelines in the AWS ecosystem. The role focuses on Delta Lakehouse on Databricks, data modelling and governance to deliver reliable, scalable data solutions for stakeholders.

Required are strong Python/SQL/Scala skills, ETL leadership, and a track record in retail data environments. Attractive benefits and ongoing tech investment are provided.