Senior Data Engineer

Welcome to the Jungle

Greater London

Hybrid

GBP 90,000 - 120,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Artefact is seeking a Senior Data Engineer to join our data-driven consultancy team in London. You will design and maintain scalable data pipelines using SQL and Python, work with Databricks, Snowflake, and cloud-based orchestration, and lead a small data engineering group.

Ideally you have 3+ years in data engineering, strong CI/CD experience, and a passion for data governance, security, and delivering business impact through reliable data assets.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science or Engineering.
  • 3+ years of industry experience in data engineering with proficiency in SQL and Python.
  • Experience with cloud-native orchestration tools and distributed data processing frameworks.
  • Infrastructure as Code tooling such as Terraform.
  • Strong CI/CD and DevOps/DevSecOps practices.
  • Proven leadership in data engineering teams.
  • Ability to work with ambiguity and solve problems.

Responsibilities

  • Design, build, and maintain scalable data pipelines using SQL and Python and tools like Databricks, Snowflake, Azure Data Factory or AWS Glue.
  • Lead the integration of complex data systems across platforms.
  • Implement CI/CD for data pipelines to improve efficiency and quality.
  • Collaborate with data architects, analysts and stakeholders to translate requirements into implementations.
  • Oversee and mentor a team of data engineers.
  • Develop and enforce data governance, security, and compliance practices.
  • Optimize data retrieval and develop dashboards/reports for business teams.
  • Continuously evaluate new technologies to enhance data engineering capabilities.

Skills

SQL
Python
Leadership
Communication
CI/CD
Data architecture
AI workflows

Education

Bachelor’s or Master’s degree in Computer Science/Engineering

Tools

Databricks
Snowflake
Azure Data Factory
AWS Glue
Airflow
PySpark
Terraform

Job description

Senior Data Engineer
Who we are

Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.

Our broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients’ specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon the deep AI expertise we’ve acquired with our 1000+ client base around the globe.

We have over 2000 employees across 26 offices who are focused on accelerating digital transformation. Thanks to a unique mix of company assets: State of the art data technologies, lean AI agile methodologies for fast delivery, and cohesive teams of the finest business consultants, data analysts, data scientists, data engineers, and digital experts, all dedicated to bringing extra value to every client.

Job Summary

We are looking for a Senior Data Engineer to join our dynamic team. This role is ideal for someone with a deep understanding of data engineering and a proven track record of leading data projects in a fast-paced environment.

Key Responsibilities

  • Design, build, and maintain scalable and robust data pipelines using SQL and Python, and leveraging any of the following: Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow and Pyspark.
  • Lead the integration of complex data systems and ensure consistency and accuracy of data across multiple platforms.
  • Implement continuous integration and continuous deployment (CI/CD) practices for data pipelines to improve efficiency and quality of data processing.
  • Work closely with data architects, analysts, and other stakeholders to understand business requirements and translate them into technical implementations.
  • Oversee and manage a team of data engineers, providing guidance and mentorship to ensure high-quality project deliverables.
  • Develop and enforce best practices in data governance, security, and compliance within the organisation.
  • Optimise data retrieval and develop dashboards and reports for business teams.
  • Continuously evaluate new technologies and tools to enhance the capabilities of the data engineering function.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 3+ years of industry experience in data engineering with a strong technical proficiency in SQL, Python, and big data technologies.
  • Expertise in building scalable data workflows using cloud-native orchestration tools and distributed data processing frameworks.
  • Demonstrated experience with Infrastructure as Code tooling such as Terraform
  • Solid understanding of CI/CD principles and DevOps/DevSecOps practices.
  • Proven leadership skills and experience managing data engineering teams.
  • Excellent problem-solving skills and the ability to work with ambiguity.
  • Proficient in leveraging AI-assisted workflows to optimise task efficiency.
  • Strong communication and interpersonal skills.
  • Excellent understanding of data architecture involving data mesh, data lake, data warehouse and data lakehouse.

Preferred Qualifications:

  • Certifications in Azure, AWS, or GCP.
  • Certifications in Databricks, Snowflake or similar technologies.
  • Experience in the leading large scale data engineering projects.

Working Conditions

  • Hybrid work arrangement: two-three days per week working from the office
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

TrueNorth® • Manchester

On-site
GBP 60,000 - 90,000
Senior Data Engineer
Senior Data Engineer

ISx4 Group • Belfast City District

On-site
GBP 70,000 - 100,000
Senior Data Engineer
Senior Data Engineer

Nasstar • Greater London

Remote
GBP 60,000 - 80,000
Competitive salary and compensation package
Access to AWS & Databricks certifications
Remote work with team socials
Senior Data Engineer
Senior Data Engineer

Morson Edge (Technology) • West of England

On-site
GBP 60,000 - 90,000
Data Engineer
Data Engineer

dcoded. | B Corp ™ • Greater London

Hybrid
GBP 60,000 - 75,000
Hybrid working with flexible remote
9am–6pm working hours
Senior Data Engineer
Senior Data Engineer

ACCENTURE PTE LTD • Lee-on-the-Solent

On-site
GBP 90,000 - 130,000
Senior Data Engineer
Senior Data Engineer

Peaple Talent • West of England

On-site
GBP 70,000 - 110,000
Senior Data Engineer
Senior Data Engineer

Zealous Agency • Birmingham

On-site
GBP 55,000 - 75,000
Senior Data Engineer
Senior Data Engineer

Firstup • Greater London

On-site
GBP 90,000 - 150,000
Hybrid Data Engineer: Lead Pipelines & AI-Driven Analytics
Hybrid Data Engineer: Lead Pipelines & AI-Driven Analytics

Welcome to the Jungle • Greater London

Hybrid
GBP 90,000 - 120,000