Hybrid Data Engineer: Lead Pipelines & AI-Driven Analytics

Welcome to the Jungle

Greater London

Hybrid

GBP 90,000 - 120,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Artefact is seeking a Senior Data Engineer to join our data-driven consultancy team in London. You will design and maintain scalable data pipelines using SQL and Python, work with Databricks, Snowflake, and cloud-based orchestration, and lead a small data engineering group.

Ideally you have 3+ years in data engineering, strong CI/CD experience, and a passion for data governance, security, and delivering business impact through reliable data assets.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science or Engineering.
  • 3+ years of industry experience in data engineering with proficiency in SQL and Python.
  • Experience with cloud-native orchestration tools and distributed data processing frameworks.
  • Infrastructure as Code tooling such as Terraform.
  • Strong CI/CD and DevOps/DevSecOps practices.
  • Proven leadership in data engineering teams.
  • Ability to work with ambiguity and solve problems.

Responsibilities

  • Design, build, and maintain scalable data pipelines using SQL and Python and tools like Databricks, Snowflake, Azure Data Factory or AWS Glue.
  • Lead the integration of complex data systems across platforms.
  • Implement CI/CD for data pipelines to improve efficiency and quality.
  • Collaborate with data architects, analysts and stakeholders to translate requirements into implementations.
  • Oversee and mentor a team of data engineers.
  • Develop and enforce data governance, security, and compliance practices.
  • Optimize data retrieval and develop dashboards/reports for business teams.
  • Continuously evaluate new technologies to enhance data engineering capabilities.

Skills

SQL
Python
Leadership
Communication
CI/CD
Data architecture
AI workflows

Education

Bachelor’s or Master’s degree in Computer Science/Engineering

Tools

Databricks
Snowflake
Azure Data Factory
AWS Glue
Airflow
PySpark
Terraform

Job description

Artefact is seeking a Senior Data Engineer to join our data-driven consultancy team in London. You will design and maintain scalable data pipelines using SQL and Python, work with Databricks, Snowflake, and cloud-based orchestration, and lead a small data engineering group.

Ideally you have 3+ years in data engineering, strong CI/CD experience, and a passion for data governance, security, and delivering business impact through reliable data assets.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Hybrid Lead Data Engineer for AI & Pipelines
Hybrid Lead Data Engineer for AI & Pipelines

Artefact • Greater London

Hybrid
GBP 70,000 - 110,000
Senior Data Engineer
Senior Data Engineer

Welcome to the Jungle • Greater London

Hybrid
GBP 90,000 - 120,000
Senior Data Engineer - Cloud Pipelines & Analytics
Senior Data Engineer - Cloud Pipelines & Analytics

Data Idols • Greater London

Hybrid
GBP 80,000 - 95,000
Data Engineer — AI-Driven Data Pipelines
Data Engineer — AI-Driven Data Pipelines

Transformuk • Greater London

On-site
GBP 65,000 - 95,000
Holiday entitlement, 28 days (buy/sell
Private healthcare
Pension eligibility
+5
Senior Data Engineer | Hybrid London | Lead Pipelines
Senior Data Engineer | Hybrid London | Lead Pipelines

dcoded. | B Corp ™ • Greater London

Hybrid
GBP 60,000 - 75,000
Hybrid working with flexible remote
9am–6pm working hours
Data Engineer: AI Pipelines on Databricks (Hybrid Cambridge)
Data Engineer: AI Pipelines on Databricks (Hybrid Cambridge)

Whitehall Resources Limited • Cambridgeshire and Peterborough

Hybrid
GBP 70,000 - 90,000
Hybrid AI Data Engineer: Build AI‑Ready Data Pipelines
Hybrid AI Data Engineer: Build AI‑Ready Data Pipelines

Capgemini • Greater London

Hybrid
GBP 65,000 - 90,000
Hybrid working
Extensive learning and development
Senior Data Scientist — ML, MLOps & Cloud Lead
Senior Data Scientist — ML, MLOps & Cloud Lead

Artefact • Greater London

On-site
GBP 90,000 - 140,000
Data Engineer
Data Engineer

dcoded. | B Corp ™ • Greater London

Hybrid
GBP 60,000 - 75,000
Hybrid working with flexible remote
9am–6pm working hours
AWS Data Engineer (PySpark/AI) - Hybrid London
AWS Data Engineer (PySpark/AI) - Hybrid London

Datatech Analytics • City Of London

Hybrid
GBP 45,000 - 75,000