Lead Data Engineer

Experian Group; Nottingham; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

A leading data and technology company in the UK seeks a Lead Engineer to join its agile team. The role requires overseeing high technical standards, building data pipelines, and ensuring regulatory compliance in collaboration with various departments. Applicants should have significant experience in lead engineering at large organizations, DevOps tooling, and programming in Scala or Python. This position offers a hybrid working environment along with an attractive benefits package, including a competitive salary and discretionary bonus plan.

Benefits

Hybrid and flexible working

Great compensation package

Pension and healthcare benefits

25 days annual leave plus bank holidays

Volunteering days

Qualifications

• Experience building data pipelines and understanding of data lake architectures.
• Familiarity with regulatory requirements such as GDPR and PCI DSS.
• Ability to work collaboratively within an agile team.

Responsibilities

• Ensure the team follows high technical standards.
• Collaborate with compliance teams on regulatory adherence.
• Maintain codebase and technical application ownership.

Skills

Lead Engineering experience

DevOps & IaC tooling - Terraform, CI/CD

Strong experience on Apache Spark/Hadoop

Knowledge of AWS services

Data pipeline and Data Lake construction

Programming using Scala or Python

Configuration as code principles

Data analysis and investigation skills

Automated testing methodologies

Job description

We are looking for a Lead Engineer to join our established agile team, that supports innovation, learning and collaboration.

Reporting into our Engineering Director, you will ensure that the team follows the highest technical standards and supports Agile methods to deliver high value outcomes.

Main responsibilities

• Work in an outstanding Agile technical team
• Build data pipelines and data lake
• Deliver quality software
• Collaborate with the risk, security and compliance teams to ensure adherence to regulatory requirements (e.g., GDPR, PCI DSS) and industry standards related to data privacy and security
• Understand where there are overlapping technical requirements in your team and other teams and help build out technology roadmaps
• Codebase ownership
• Technical Application ownership

About Experian

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Experience and Skills

• Lead Engineering experience at a large organisation
• DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins
• Strong experience of developing on Apache Spark/Hadoop
• Significant knowledge of AWS cloud services including (but not limited to) AWS Glue, S3, StepFunction
• Experience building data pipelines and Data Lake
• Significant experience of programming using Scala or Python.
• Configuration as code principles and API integration
• Ability to analyse, investigate and compare large data sets when required
• Experience with automated testing methodologies

Additional Information

Benefits package includes:

• Hybrid and flexible working
• Great compensation package and discretionary bonus plan
• Core benefits include pension, Bupa healthcare, ShareSave scheme and more
• 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering… the list goes on. Experian's people first approach is award‑winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.