Senior Data Engineer

Artefact; Greater London; Hybrid; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Hybrid work model (2 days in office)

Job summary

Artefact, a global data services provider, is seeking a Senior Data Engineer to join its fast-growing team in London. You will design and scale data pipelines, mentor engineers, and align data solutions with business goals.

You will work with SQL, Python and cloud-native tools like Databricks, Snowflake, and Airflow, shaping data governance and CI/CD practices while collaborating with analysts, architects and stakeholders.

Qualifications

• 3+ years of industry experience in data engineering.
• Strong proficiency in SQL and Python.
• Experience with cloud-native orchestration tools and distributed processing frameworks.
• Solid understanding of CI/CD and DevOps/DevSecOps practices.
• Experience leading on project workstreams.
• Excellent problem-solving and communication skills.
• Proficient in leveraging AI-assisted workflows to optimise task efficiency.

Responsibilities

• Design, build, and maintain scalable and robust data pipelines using SQL and Python, and leveraging technologies such as: Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow and Pyspark.
• Lead the integration of complex data systems and ensure consistency and accuracy of data across multiple platforms.
• Implement continuous integration and continuous deployment (CI/CD) practices for data pipelines to improve efficiency and quality of data processing.
• Work closely with data architects, analysts, and other stakeholders to understand business requirements and translate them into technical implementations.
• Oversee and manage a team of data engineers, providing guidance and mentorship to ensure high-quality project deliverables.
• Knowledge of best practices in data governance, security, and compliance within the organisation.
• Continuously evaluate new technologies, AI trends and tools to enhance the capabilities of the data engineering function.

Skills

SQL

Python

Databricks

Snowflake

Azure Data Factory

AWS Glue

Apache Airflow

PySpark

CI/CD

DevOps

Leadership

Education

Bachelor's or Master's degree in Computer Science/Engineering

Tools

Databricks

Snowflake

Azure Data Factory

AWS Glue

Apache Airflow

PySpark

Job description

Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.

Our broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients’ specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon the deep AI expertise we’ve acquired with our 1000+ client base around the globe.

We have over 2000 employees across 26 offices who are focused on accelerating digital transformation. Thanks to a unique mix of company assets: State of the art data technologies, lean AI agile methodologies for fast delivery, and cohesive teams of the finest business consultants, data analysts, data scientists, data engineers, and digital experts, all dedicated to bringing extra value to every client.

Job Summary

We are looking for a Senior Data Engineer to join our dynamic team. This role is ideal for someone with a deep understanding of data engineering and a proven track record of leading data projects in a fast-paced environment.

Key Responsibilities

• Design, build, and maintain scalable and robust data pipelines using SQL and Python, and leveraging technologies such as: Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow and Pyspark.
• Lead the integration of complex data systems and ensure consistency and accuracy of data across multiple platforms.
• Implement continuous integration and continuous deployment (CI/CD) practices for data pipelines to improve efficiency and quality of data processing.
• Work closely with data architects, analysts, and other stakeholders to understand business requirements and translate them into technical implementations.
• Oversee and manage a team of data engineers, providing guidance and mentorship to ensure high-quality project deliverables.
• Knowledge of best practices in data governance, security, and compliance within the organisation.
• Continuously evaluate new technologies, AI trends and tools to enhance the capabilities of the data engineering function.

Qualifications

• Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
• 3+ years of industry experience in data engineering with a strong technical proficiency in SQL, Python, and big data technologies.
• Expertise in building scalable data workflows using cloud-native orchestration tools and distributed data processing frameworks.
• Solid understanding of CI/CD principles and DevOps/DevSecOps practices.
• Experience leading on project workstreams.
• Excellent problem-solving skills and the ability to work with ambiguity.
• Proficient in leveraging AI-assisted workflows to optimise task efficiency.
• Strong communication and interpersonal skills.

Preferred Qualifications:

• Certifications in Azure, AWS, or GCP.
• Certifications in Databricks, Snowflake or similar technologies.
• Experience in the leading large scale data engineering projects.
• Excellent understanding of data architecture involving data mesh, data lake, data warehouse and data lakehouse.
• Demonstrated experience with Infrastructure as Code tooling such as Terraform

Why Joining Artefact?

Build the Future of Data & AI

Join one of the fastest-growing global data consulting companies and help leading organisations transform through data and AI.

Accelerate Your Growth

Work on cutting-edge projects with modern technologies including AI, Machine Learning, Cloud, and DevOps, while continuously developing your technical, consulting, and leadership skills.

Be part of a diverse, international, and action-oriented team of experts across data, consulting, engineering, and digital marketing.

We value initiative, innovation, and ownership. Your ideas matter, and you’ll have the opportunity to make a real impact from day one.

Working Conditions

• Hybrid work arrangement: two days per week working from the office