Senior AI Data Scientist

Ofgem; Cardiff; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

An independent energy regulator is seeking a Senior AI Data Scientist to enhance data-driven decision making in the energy sector. You will design and deploy data science models using Python and Azure. The role emphasizes collaboration and innovative data solutions. Applicants should have extensive Python experience and a strong grasp of data governance. This position offers flexible working opportunities across Cardiff, Glasgow, and London.

Qualifications

• Extensive experience with Python and data science Python packages.
• Understanding of data science concepts and AI/ML models.
• Experience using business intelligence tools, preferably Power BI.
• Proven ability to deliver secure, scalable data science solutions.
• Able to achieve and maintain SC clearance.

Responsibilities

• Design and deploy data science workflows using Azure Machine Learning.
• Monitor model performance and implement retraining.
• Develop AI/ML proof-of-concepts.
• Collaborate with teams to manage interdependencies.
• Use data visualisation techniques to share insights.

Skills

Python

Data science concepts

Business intelligence tools

Power BI

Generative AI

Data governance

Model observability

Education

Microsoft certified: Azure Data Scientist Associate

Tools

Azure Machine Learning

scikit-learn

pandas

numpy

Job description

Successful candidates may be based in any of our office locations – Cardiff, Glasgow, or London. We especially welcome applicants from Cardiff and Glasgow.

Job Summary

Ofgem is Great Britain’s independent energy regulator. We’re at the forefront of change across the energy sector, driving toward Net Zero whilst protecting energy consumers – especially vulnerable people. We offer a diverse range of flexible working career opportunities: roles that are stimulating and rewarding, where you can get involved in ground‑breaking work. And it’s important to us that we recruit from a wide range of professional and personal backgrounds. Effective use of data and artificial intelligence (AI) are at the centre of our work to bring about a Net Zero energy supply. As the energy sector becomes more digitalised we have a key role to play in ensuring that this is underpinned with best practice and regulation.

As a Senior AI Data Scientist, you’ll be working in our dynamic and growing Data & AI team. It’s a team that’s cross‑functional, diverse and knowledgeable. You'll accelerate data‑driven decision making, digital transformation, and enable AI and self‑service analytics across Ofgem. You’ll be responsible for designing, building and deploying data science & AI models to answer strategic business questions using modern data science technologies such as Python, Azure Machine Learning, Azure AI Services, Copilot Studio, and Power BI. In this role, working closely with the Head of Data Science & AI, you’ll apply data science approaches and AI models across a wide range of energy market data and processes. You’ll embed and launch Data Science & AI models to help inform strategic decisions – assessing current software, architecture and capabilities, sourcing and preparing strategic data sets. You’ll also collaborate in the creation of Data Science & AI Best Practice and provide expertise to other Ofgem departments and external stakeholders. It’s a role that requires an understanding of strategic business initiatives and analysis, data assets, and Data Science product development as well as being able to use data visualisation and storytelling techniques to share conclusions and advise on impacts.

It’s essential that you can bring mathematical, statistical and analytical/research skills and your knowledge in the development of data science, machine learning, analytics or statistical data products should include a core data science language. Your professional expertise should be complemented by highly developed communication and presentation skills along with a methodical approach and a keen focus on quality.

Key Responsibilities

• Understand strategic business initiatives and analytical questions to answer.
• Design, develop, test, and deploy data science workflows using Microsoft Azure ML Studio with a Python data science stack.
• Ensure high‑quality delivery of accurate data science models, and review that proposed solutions meet security, compliance, and governance requirements.
• Monitor model performance, identify drift and implement model retraining when appropriate.
• Use data visualisation and storytelling techniques to share analytic conclusions and their strategic impact.
• Collaborate closely with other teams to manage interdependencies, risks and resourcing to support portfolio delivery.
• Develop AI/ML proof‑of‑concepts and assist the business with evaluations to measure success and estimate value proposition.

Key Outputs and Deliverables

• Data Science and machine learning capability for Ofgem, which may include reusable analytics tools and artefacts, such as data science workflows, ML pipelines, dashboards, actionable insights, etc.
• Expertise advising on selection of appropriate models and suitable algorithms depending on business requirements, aligning with best practice and ways of working.
• High‑quality delivery of data science work, including accurate models, insightful dashboards and data visualisations.
• AI/ML proof‑of‑concepts applicable to Ofgem business processes, and estimation of value proposition.
• Technical documentation and training materials for Ofgem colleagues.

Person specification

Essential Criteria

• Extensive experience with Python and data science Python packages (e.g. scikit‑learn, pandas, numpy, etc). (LEAD)
• Understanding of data science concepts, AI / ML models, evaluation approaches, and data science applications to enhance business processes. (LEAD)
• Able to achieve and maintain SC clearance, which includes residency in the UK for at least 3 of the last 5 years. (Lead criteria)
• Experience using business intelligence tools, preferably Power BI.
• Experience applying Generative AI and prompting techniques.
• Strong understanding of data governance, model observability, and compliance frameworks.
• Proven ability to deliver secure, scalable, and responsible data science solutions.
• Microsoft certified: Azure Data Scientist Associate, or equivalent experience.
• Knowledge of the Microsoft ecosystem, particularly M365, Power Platform, and Azure.
• Cyber security awareness.

Behaviours

We’ll assess you against these behaviours during the selection process:

Apply before 11:55 pm on Monday 17th November 2025