Lead Data Solutions Engineer: AI-Powered Pipelines

AND Digital; Birmingham; On-site; GBP 70,000 - 110,000; Full time

Benefits offered by this job

25 days holiday

Pension: 6% company + 2% employee

Aviva healthcare cover

Flexibenefit £1000

Life Assurance

Income Protection

Eye test + glasses

Parental Benefits

Job summary

AND Digital in the United Kingdom is seeking a Lead Data Solution Engineer to design, build and operate data pipelines for clients across industries. You’ll work in fast-moving agile teams, delivering modern data platforms and AI-enabled solutions on AWS, Azure, GCP or Snowflake.

You’ll combine hands-on data engineering with strategic thinking, ensuring data quality, governance and usability for downstream consumers.

Qualifications

• Hands-on data engineering with modern data platforms and Cloud services.
• Experience designing, deploying and maintaining data pipelines in production.
• Strong understanding of data modelling, quality and governance.

Responsibilities

• Develop pipelines that bring data to life for decision-making, either delivering insight or for more sophisticated AI & machine learning applications
• Experience in being hands on with data, applying the practicalities of quality, flow, and organisation of information, and an understanding of data modelling approaches.
• Be comfortable working in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms for different-size organisations.
• Practical hands-on experience of designing, architecting & deploying AI-enabled solutions at least one cloud data platform (e.g. Databricks, Snowflake, AWS, Azure or GCP) and experience of associated technologies (for example with AWS: DynamoDB, Redshift, Kinesis Pipelines, Glue, Lambda, QuickSight, etc) ideally including practical/hands-on experience of migration to or adoption of a cloud data platform.
• Strong Databricks expertise is a must (ideally with appropriate certifications) with Snowflake and/or MS Fabric experience a bonus.
• Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life.
• Hands-on DataOps experience (eg. CI/CD, version control, IaC, etc.)
• Have experience adopting a Data Product mindset, ensuring datasets are discoverable, addressable, trustworthy, and self-describing for downstream consumers.
• Ability to bridge the gap between technical engineering and business value, translating stakeholder needs into robust data product specifications.

Skills

Databricks

Snowflake

AWS

Azure

GCP

DataOps

CI/CD

IaC

dbt

Airflow

Prefect

Dagster

Data modeling

Data pipelines

Tools

DynamoDB

Redshift

Kinesis

Glue

Lambda

QuickSight

Job description

AND Digital in the United Kingdom is seeking a Lead Data Solution Engineer to design, build and operate data pipelines for clients across industries. You’ll work in fast-moving agile teams, delivering modern data platforms and AI-enabled solutions on AWS, Azure, GCP or Snowflake.

You’ll combine hands-on data engineering with strategic thinking, ensuring data quality, governance and usability for downstream consumers.