Lead Data Engineer - Data Lake, Spark & Cloud (Hybrid)

Experian Group; Nottingham; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

A leading data and technology company in the UK seeks a Lead Engineer to join its agile team. The role requires overseeing high technical standards, building data pipelines, and ensuring regulatory compliance in collaboration with various departments. Applicants should have significant experience in lead engineering at large organizations, DevOps tooling, and programming in Scala or Python. This position offers a hybrid working environment along with an attractive benefits package, including a competitive salary and discretionary bonus plan.

Benefits

Hybrid and flexible working

Great compensation package

Pension and healthcare benefits

25 days annual leave plus bank holidays

Volunteering days

Qualifications

• Experience building data pipelines and understanding of data lake architectures.
• Familiarity with regulatory requirements such as GDPR and PCI DSS.
• Ability to work collaboratively within an agile team.

Responsibilities

• Ensure the team follows high technical standards.
• Collaborate with compliance teams on regulatory adherence.
• Maintain codebase and technical application ownership.

Skills

Lead Engineering experience

DevOps & IaC tooling - Terraform, CI/CD

Strong experience on Apache Spark/Hadoop

Knowledge of AWS services

Data pipeline and Data Lake construction

Programming using Scala or Python

Configuration as code principles

Data analysis and investigation skills

Automated testing methodologies

Job description

A leading data and technology company in the UK seeks a Lead Engineer to join its agile team. The role requires overseeing high technical standards, building data pipelines, and ensuring regulatory compliance in collaboration with various departments. Applicants should have significant experience in lead engineering at large organizations, DevOps tooling, and programming in Scala or Python. This position offers a hybrid working environment along with an attractive benefits package, including a competitive salary and discretionary bonus plan.