Remote AI Data Engineer: Scalable Pipelines & ML Platforms

Ideagen; Ruddington; Remote; GBP 85,000 - 110,000; Full time

Job summary

Ideagen is actively seeking a Senior AI Data Engineer to design and build scalable data pipelines powering AI models and analytics. You will own responsible production data platforms, ensure reliability, and enable intelligent product capabilities in a cloud-centric environment.

You'll collaborate with AI engineers, software engineers, and product teams to deliver robust data solutions, mentor junior engineers, and drive best practices while advancing Ideagen's AI strategy and data governance

Qualifications

• Significant experience building, scaling, and supporting production data pipelines and data platforms.
• Strong expertise in Python and SQL, with a track record of developing high-quality, maintainable solutions.
• Hands-on experience with AWS services such as S3, Lambda, Glue, Athena, and cloud-native architectures.
• Experience operating production systems, resolving complex issues, and improving platform reliability.
• Strong understanding of data quality, governance, lineage, security, and auditability.
• Experience or strong interest in AI, machine learning, MLOps or large language model technologies.
• Proven ability to influence technical decisions, mentor engineers, and drive engineering best practices.

Responsibilities

• Designing and building scalable data pipelines that power AI models, machine learning workflows, and intelligent product capabilities.
• Owning the reliability, performance, and operational excellence of production data platforms.
• Developing ETL/ELT solutions using Python, SQL, AWS, and modern cloud-based data technologies.
• Implementing robust monitoring, alerting, testing, and data quality processes to ensure trusted datasets.
• Driving best practices in data governance, lineage, security, and dataset versioning.
• Collaborating with cross-functional teams to deliver innovative AI and data solutions.
• Mentoring engineers and contributing to engineering standards, technical direction, and continuous improvement.

Skills

Python

SQL

AWS

Data pipelines

Data governance

Mentoring

Tools

AWS S3

AWS Lambda

AWS Glue

AWS Athena

Job description

Ideagen is actively seeking a Senior AI Data Engineer to design and build scalable data pipelines powering AI models and analytics. You will own responsible production data platforms, ensure reliability, and enable intelligent product capabilities in a cloud-centric environment.

You'll collaborate with AI engineers, software engineers, and product teams to deliver robust data solutions, mentor junior engineers, and drive best practices while advancing Ideagen's AI strategy and data governance