AI-Powered Data Engineering Manager

Archer; Glasgow; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

30 days vacation per year

Job summary

Archer, in collaboration with Accenture, is seeking an experienced Data Engineering Manager to lead AI-powered data engineering programs from pipeline design to data product delivery in a Glasgow-based role.

You will drive cloud-scale initiatives across Azure, Databricks, Snowflake, and other platforms, employing GenAI tooling and AI-assisted pipeline development to accelerate delivery while maintaining data quality and governance. A dynamic, innovation-driven environment awaits.

Qualifications

• Design and deliver cloud-scale data engineering solutions across major cloud platforms.
• Proven experience using GenAI tooling to accelerate engineering delivery.
• Data quality, observability and automated governance capabilities.
• Data modelling including dimensional design and medallion architecture.
• ETL/ELT delivery and legacy-to-cloud migration at scale.
• Data product thinking with consumption-first mindset.
• Experience with agentic AI patterns in data engineering context.
• CI/CD and engineering standards for data platforms, including testing.
• Mentoring engineering teams and setting technical direction.
• Experience contributing to commercial propositions or accelerators.

Responsibilities

• Lead delivery of cloud-scale data engineering programmes and platform migration.
• Drive AI-assisted pipeline development and govern AI-generated outputs.
• Design and implement data quality, lineage and drift detection with AI.
• Own data product design end-to-end from requirements to governance.
• Lead ETL/ELT modernisation and cloud migrations at scale.
• Architect observability, resiliency and self-healing pipelines with AI.
• Promote agentic pipeline patterns and autonomous AI workflows.
• Translate data models into reusable patterns and automation frameworks.
• Establish CI/CD, testing automation and engineering standards.
• Mentor teams and contribute to reusable data engineering assets.

Skills

Cloud-scale data engineering

GenAI tooling

Data quality & governance

Data modelling (dimensional/Kimball)

ETL/ELT delivery

Data product thinking

Agentic AI patterns

CI/CD for data platforms

Mentoring engineering teams

Observability & monitoring

Tools

Azure

Databricks

Microsoft Fabric

Snowflake

AWS

GCP

GenAI tooling

Job description

Archer, in collaboration with Accenture, is seeking an experienced Data Engineering Manager to lead AI-powered data engineering programs from pipeline design to data product delivery in a Glasgow-based role.

You will drive cloud-scale initiatives across Azure, Databricks, Snowflake, and other platforms, employing GenAI tooling and AI-assisted pipeline development to accelerate delivery while maintaining data quality and governance. A dynamic, innovation-driven environment awaits.