Data Engineering Lead & AI Solutions Manager

PwC UK; Belfast City District; On-site; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Empowered flexibility

Hybrid work week

Private medical cover

24/7 virtual GP access

Six volunteering days per year

Various benefits

Job summary

PwC UK seeks a Manager in our Data Engineering team to lead one or more squads delivering advanced data solutions. You’ll shape scalable data platforms powering analytics, AI and ML across industries including healthcare and financial services.

You’ll combine hands-on delivery with team leadership, driving modern data engineering practices. You’ll work cross-functionally with business and tech teams, setting direction for data pipelines, platforms and analytics infrastructure.

Qualifications

• Proven experience leading or managing data engineering teams or workstreams in complex environments.
• Strong object-oriented Python skills for developing, testing and packaging code, including experience with tools such as GitCliff and familiarity with frameworks such as PyTorch and TensorFlow where relevant to data and AI workloads.
• Experience with Apache Spark for large-scale data processing.
• Developing APIs using FastAPI or similar technologies to expose data and analytics services.
• Strong understanding of business intelligence needs and optimising data transformations for AI and BI applications.
• Solid understanding of best practices in data engineering architecture, including data modelling, orchestration, testing and observability.
• Familiarity with SDLC methodologies such as SAFe, Agile and JadX and experience applying them to data engineering projects.
• Experience using repositories and DevOps tooling including GitHub and Azure DevOps.
• Hands-on experience with major data engineering tools and platforms such as Databricks, Microsoft Fabric, Azure Data Factory and Palantir.
• Experience with at least one major cloud platform (Azure, AWS or GCP), ideally more than one, for data engineering workloads.

Responsibilities

• Leading and developing teams of data engineers, creating a collaborative, high-performing environment focused on building reliable and scalable data solutions.
• Providing technical direction for the design, build and support of data pipelines, data platforms and analytics infrastructure, ensuring alignment with organisational goals and industry best practices.
• Contributing hands-on to solution design, development and troubleshooting, including code reviews and resolution of complex technical issues.
• Building data engineering capability by driving adoption of modern techniques, tools and patterns, supporting the professional growth of your teams and the wider Data & AI capability.
• Engaging stakeholders across business, technology partners and clients to understand requirements, set priorities and deliver impactful data solutions.
• Ensuring quality by overseeing the development, deployment and validation of data solutions, maintaining high standards of accuracy, reliability and performance.

Skills

Python

GitCliff

PyTorch

TensorFlow

Apache Spark

Cursor

GitHub Copilot

FastAPI

APIs

BI requirements

DevOps tooling

Databricks

Microsoft Fabric

Azure Data Factory

Palantir

Azure

AWS

GCP

Tools

Databricks

Microsoft Fabric

Azure Data Factory

Palantir

Azure DevOps

Job description

PwC UK seeks a Manager in our Data Engineering team to lead one or more squads delivering advanced data solutions. You’ll shape scalable data platforms powering analytics, AI and ML across industries including healthcare and financial services.

You’ll combine hands-on delivery with team leadership, driving modern data engineering practices. You’ll work cross-functionally with business and tech teams, setting direction for data pipelines, platforms and analytics infrastructure.