Lead Data Engineer - Pipelines, AI & Cloud (Hybrid)

Artefact; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

Artefact is a data service provider specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the value chain of organisations. We are looking for a Senior Data Engineer to join our dynamic team, bringing deep data engineering expertise and a proven track record of leading data projects in a fast-paced environment.

Artefact combines AI, analytics, and cloud technologies to deliver scalable data pipelines and advanced analytics,

Qualifications

• 3+ years of industry experience in data engineering with strong SQL, Python, and big data tech.
• Cloud-native orchestration and distributed processing experience.
• CI/CD principles and DevOps/DevSecOps practices.
• Experience leading project workstreams.
• Excellent problem-solving and ability to work with ambiguity.
• Proficient in leveraging AI-assisted workflows to optimise task efficiency.
• Strong communication and interpersonal skills.

Responsibilities

• Design, build, and maintain scalable data pipelines with SQL and Python.
• Lead integration of complex data systems across platforms.
• Implement CI/CD for data pipelines to improve data processing.
• Collaborate with data architects, analysts, and stakeholders to translate needs.
• Oversee and mentor a team of data engineers.
• Apply data governance, security, and compliance best practices.
• Evaluate new technologies and AI trends to enhance data engineering.

Skills

Leadership

Problem solving

Communication

Ambiguity handling

Mentorship

Education

Bachelor's or Master’s degree in Computer Science, Engineering, or a related field

Tools

Databricks

Snowflake

Azure Data Factory

AWS Glue

Apache Airflow

PySpark

SQL

Python

Job description

Artefact is a data service provider specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the value chain of organisations. We are looking for a Senior Data Engineer to join our dynamic team, bringing deep data engineering expertise and a proven track record of leading data projects in a fast-paced environment.

Artefact combines AI, analytics, and cloud technologies to deliver scalable data pipelines and advanced analytics,