Lead AI Data Engineer: Scalable Pipelines & Data Quality

Jobtailor; Nottingham; On-site; GBP 70,000 - 110,000; Full time

Job summary

Jobtailor in the United Kingdom invites a data engineer to design and build scalable data pipelines powering AI models and ML workflows. You will own the reliability, performance, and operational excellence of production data platforms.

Develop ETL/ELT solutions using Python, SQL and AWS, implement monitoring and data quality processes, and drive governance, lineage and security. You will mentor engineers and help set engineering standards and technical direction to continuously raise the bar.

Qualifications

• Significant experience building and scaling production data pipelines and data platforms.
• Strong Python and SQL skills with ability to deliver maintainable solutions.
• Hands-on AWS experience (S3, Lambda, Glue, Athena) and cloud-native architectures.
• Experience operating production systems, resolving complex issues, and improving reliability.
• Knowledge of data quality, governance, lineage, security, and auditability.
• Interest or experience in AI, ML, MLOps, or LLM technologies.
• Proven ability to influence technical decisions and mentor engineers.

Responsibilities

• Design and build scalable data pipelines powering AI models and ML workflows.
• Own reliability, performance, and operational excellence of production data platforms.
• Develop ETL/ELT solutions using Python, SQL, AWS, and modern cloud data tech.
• Implement monitoring, alerting, testing, and data quality processes.
• Drive data governance, lineage, security, and dataset versioning practices.
• Collaborate with cross-functional teams on AI and data solutions.
• Mentor engineers and contribute to engineering standards and direction.

Tools

AWS

Python

SQL

Job description

Jobtailor in the United Kingdom invites a data engineer to design and build scalable data pipelines powering AI models and ML workflows. You will own the reliability, performance, and operational excellence of production data platforms.

Develop ETL/ELT solutions using Python, SQL and AWS, implement monitoring and data quality processes, and drive governance, lineage and security. You will mentor engineers and help set engineering standards and technical direction to continuously raise the bar.