Lead Data Engineer

3C Deutschland GmbH; Nottingham; On-site; GBP 60,000 - 80,000; Full time

Job summary

A global data and technology company is seeking a Lead Engineer to join their Ascend Cloud Foundation Platform team. In this role, you will lead an Agile team dedicated to building data pipelines and ensuring adherence to technical standards. The ideal candidate will bring strong DevOps experience, particularly with AWS cloud services and a solid programming background in Scala or Python. This position offers a competitive compensation package along with numerous benefits for employee well-being.

Benefits

Great compensation package

Pension benefits

Bupa healthcare

Qualifications

• Significant experience in DevOps processes and tools.
• Ability to construct and manage cloud data environments.
• Experience working in Agile development teams.

Responsibilities

• Lead Agile technical teams ensuring high standards.
• Construct and manage data pipelines and data lakes.
• Collaborate on regulatory compliance and security.

Skills

DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins

Programming using Scala or Python

AWS cloud services

Building data pipelines and data lake

Automated testing methodologies

Tools

Apache Spark/Hadoop

BitBucket

Jira

Job description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Job Description

We are looking for a Lead Engineer to join our Ascend Cloud Foundation Platform team.

We unlock the power of data to create opportunities for consumers, businesses and society. At life's big moments – from buying a home or car, to sending a child to university, to growing a business exponentially by connecting it with new customers – we empower consumers and our clients to manage their data with confidence so they can maximize every opportunity.

Reporting into our Senior Client Delivery Manager, you will to join an established agile team, with a passion and lead a technical team that supports innovation, learning and collaboration. Ensure that the team follows the highest technical standards. Support Agile methods to deliver high value outcomes.

Main responsibilities:

• Lead an outstanding Agile technical team
• Build data pipelines and data lake
• Deliver quality software
• Collaborate with the risk, security and compliance teams to ensure adherence to regulatory requirements (e.g., GDPR, PCI DSS) and industry standards related to data privacy and security
• Understand where there are overlapping technical requirements in your team and other teams and help build out technology roadmaps
• Codebase ownership
• Technical Application ownership

Qualifications

• Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins
• Strong experience of developing on Apache Spark/Hadoop
• Strong experiencewith AWS cloud services including (but not limited to) AWS Glue, S3, Step
• Strong experience building data pipelines and data lake
• Experience of the full development lifecycle/application Lifecycle Management Tools - BitBucket & Jira
• Significant experience of programming using Scala or Python. Configuration as code principles and API integration
• Ability to explain solutions to technical and non-technical audiences
• Write clean, scalable and re-usable code that implements SOLID principles, common design patterns where applicable and adheres to published coding standards
• Ability to analyse, investigate and compare large data sets when required
• Functions, Lambdas, EventBridge, SQS and Lake formation
• Experience with automated testing methodologies

Additional Information

Benefits package includes:

• Great compensation package and discretionary bonus
• Core benefits include pension, bupa healthcare, sharesave scheme and more
• 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces 2024 (Fortune Top 25), Great Place To Work in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together