Senior AI Data Engineer

Ideagen; Ruddington; Remote; GBP 85,000 - 110,000; Full time

Job summary

Ideagen is actively seeking a Senior AI Data Engineer to design and build scalable data pipelines powering AI models and analytics. You will own responsible production data platforms, ensure reliability, and enable intelligent product capabilities in a cloud-centric environment.

You'll collaborate with AI engineers, software engineers, and product teams to deliver robust data solutions, mentor junior engineers, and drive best practices while advancing Ideagen's AI strategy and data governance

Qualifications

• Significant experience building, scaling, and supporting production data pipelines and data platforms.
• Strong expertise in Python and SQL, with a track record of developing high-quality, maintainable solutions.
• Hands-on experience with AWS services such as S3, Lambda, Glue, Athena, and cloud-native architectures.
• Experience operating production systems, resolving complex issues, and improving platform reliability.
• Strong understanding of data quality, governance, lineage, security, and auditability.
• Experience or strong interest in AI, machine learning, MLOps or large language model technologies.
• Proven ability to influence technical decisions, mentor engineers, and drive engineering best practices.

Responsibilities

• Designing and building scalable data pipelines that power AI models, machine learning workflows, and intelligent product capabilities.
• Owning the reliability, performance, and operational excellence of production data platforms.
• Developing ETL/ELT solutions using Python, SQL, AWS, and modern cloud-based data technologies.
• Implementing robust monitoring, alerting, testing, and data quality processes to ensure trusted datasets.
• Driving best practices in data governance, lineage, security, and dataset versioning.
• Collaborating with cross-functional teams to deliver innovative AI and data solutions.
• Mentoring engineers and contributing to engineering standards, technical direction, and continuous improvement.

Skills

Python

SQL

AWS

Data pipelines

Data governance

Mentoring

Tools

AWS S3

AWS Lambda

AWS Glue

AWS Athena

Job description

Role Purpose

Location- Nottinghamshire, United Kingdom

Level - Experienced Professional

Department - Product R&D

Working Pattern - Remote

Benefits - Benefits at Ideagen

Salary - To be discussed at next stage

At Ideagen, we're on a mission to embed AI at the heart of our products and create smarter experiences for customers around the world.

As a Senior AI Data Engineer, you'll be at the centre of this transformation, building the data platforms, pipelines, and processes that power our AI and machine learning capabilities. You'll play a key role in turning complex, large-scale data into trusted, AI-ready assets that support intelligent automation, advanced analytics, and next-generation AI products.

This is an opportunity to work on meaningful AI challenges while helping shape the technical foundations of our AI strategy. You'll collaborate with AI engineers, software engineers, and product teams to solve complex problems, influence technical direction, and ensure our data platforms are reliable, scalable, and built for the future. Alongside hands-on technical delivery, you'll support and mentor engineers across the team, helping to raise engineering standards and drive best practices.

Responsibilities

• Designing and building scalable data pipelines that power AI models, machine learning workflows, and intelligent product capabilities.
• Owning the reliability, performance, and operational excellence of production data platforms.
• Developing ETL/ELT solutions using Python, SQL, AWS, and modern cloud-based data technologies.
• Implementing robust monitoring, alerting, testing, and data quality processes to ensure trusted datasets.
• Driving best practices in data governance, lineage, security, and dataset versioning.
• Collaborating with cross-functional teams to deliver innovative AI and data solutions.
• Mentoring engineers and contributing to engineering standards, technical direction, and continuous improvement.

Skills and Experience

• Significant experience building, scaling, and supporting production data pipelines and data platforms.
• Strong expertise in Python and SQL, with a track record of developing high-quality, maintainable solutions.
• Hands-on experience with AWS services such as S3, Lambda, Glue, Athena, and cloud-native architectures.
• Experience operating production systems, resolving complex issues, and improving platform reliability.
• Strong understanding of data quality, governance, lineage, security, and auditability.
• Experience or strong interest in AI, machine learning, MLOps or large language model technologies.
• Proven ability to influence technical decisions, mentor engineers, and drive engineering best practices.

About Ideagen

Ideagen is the invisible force behind many things we rely on every day - from keeping airplanes soaring in the sky, to ensuring the food on our tables is safe, to helping doctors and nurses care for the sick. So, when you think of Ideagen, think of it as the silent teammate that's always working behind the scenes to help those people who make our lives safer and better. Everyday millions of people are kept safe using Ideagen software. We have offices all over the world including America, Australia, Malaysia and India with people doing lots of different and exciting jobs.We’re building a future-ready team, and AI is part of how we work smarter. If you're curious, adaptable and open to using AI to improve how you work, you’ll thrive at Ideagen!