Data Engineer

Syntax Consultancy Ltd; Leeds; Hybrid; GBP 60,000 - 65,000; Full time

Benefits offered by this job

Remote/Hybrid Working

Pension

22 days holiday + BH rising to 25 days

Death in Service

Health Care Plan

Job summary

Syntax Consultancy Ltd in Leeds is seeking a Data Engineer with Databricks and AWS expertise. The role is hybrid, permanent, and includes duties to run and maintain production data pipelines on Databricks and AWS. You will diagnose incidents, improve performance, and contribute to CI/CD and release processes.

The position offers £60,000-£65,000 plus benefits, with a hybrid work setup and generous holiday allowances. Start ASAP in Oct/Nov 2026.

Qualifications

• Strong Databricks and AWS experience.
• Experience with Spark SQL, Delta Lake, Parquet and Hive metastore.
• Hands-on data pipelines on Databricks and AWS.

Responsibilities

• Run and maintain production data pipelines on Databricks and AWS.
• Resolve incidents and improve data service performance.
• Own incidents from investigation through recovery and closure.
• Support CI/CD and controlled production deployments.

Skills

Databricks

AWS

Python

PySpark

SQL

Tools

Databricks

AWS

Python

PySpark

Spark UI

Delta Lake

Parquet

Hive metastore

S3

IAM

CloudWatch

Git

CI/CD

Terraform

Gitlab

Jenkins

Linux

Shell Scripts

Glue

Lambda

Step Functions

Job description

Data Engineer (Databricks / AWS)

Leeds (Hybrid)

Permanent

£60,000 - £65,000 + Benefits

Data Engineer needed for a permanent full-time position based in Leeds (Hybrid). Must have strong Databricks and AWS experience.

Hybrid Working Model - primarily working from home with travel to the Leeds office typically once/twice a month. Start ASAP in October/November 2026.

A chance to work with a leading global IT transformation on a large-scale Government project:

Data Engineer with strong Databricks, AWS, Python, PySpark and SQL skills.

Hands-on Data Engineer to run + maintain production data pipelines on Databricks and AWS.

Keeping scheduled data processing reliable, resolve incidents, fixes + improving data services performance.

The role combines L2/L3 production support and Data Engineering tasks.

Databricks experience covering notebooks, scheduled jobs, cluster configuration, driver / executor logs, Spark UI + performance troubleshooting.

Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation.

Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, schemas, partitions and the relationship between table metadata and underlying files.

Hands-on AWS experience, particularly S3, IAM and CloudWatch, with an understanding of role-based access, KMS encryption + diagnosing data access failures.

Owning incidents from investigation through recovery and closure. Diagnosing issues in Python, PySpark, SQL, Databricks jobs and AWS integrations + providing clear progress updates and timely escalation.

Working knowledge of Git, code reviews, CI/CD and controlled production deployments, including testing, rollback and release validation.

Advantageous: AWS Glue, Lambda, Step Functions, Linux, Shell Scripts, Terraform, Gitlab, Jenkins.

Benefits: £60,000 - £65,000 (DOE) + Remote/Hybrid Working + Pension + 22 days holiday + BHs (rising to 25 days) + Death in Service + Health Care Plan