DATA ENGINEER

Artificial Intelligence Jobs; Greater London; Hybrid; GBP 40,000 - 80,000; Full time

Benefits offered by this job

Flexible & Hybrid Working

Generous Annual Leave

Healthcare options

Pension scheme

Parental leave

Job summary

Artificial Intelligence Jobs is seeking a Data Engineer to join a UK-leading data division. The role is remote with a London-based office visit twice a month, offering a modern tech stack and opportunities for growth.

You will collaborate with data engineers, scientists, and product teams to build data products, optimize pipelines, and support GenAI and ML workflows. The package includes a competitive salary and hybrid flexibility.

Qualifications

• Experience with Databricks or Snowflake on AWS.
• Python with PySpark/Spark.
• Strong SQL with end-to-end data modelling.
• Batch and real-time data integrations.
• CI/CD with Git/Jenkins; IaC with Terraform.

Responsibilities

• Build and support robust data products on a cloud data platform.
• Design and deliver data solutions with engineers and product teams.
• Develop and optimize scalable data pipelines across the analytics platform.
• Integrate large diverse datasets with high quality and governance.
• Maintain data platform components and support AI infrastructure.

Skills

Python

PySpark

Spark

Airflow

SQL

CI/CD

Git

Tools

Databricks

Snowflake

AWS

Docker

Kubernetes

Terraform

Job description

Data Engineer

Location: Remote - with requirement to visit London based office twice a month

Hours:37.5 Hours a week (Monday - Friday 9:00am - 17:00pm)

Salary Range: £40,000 - £80,000 per annum (Depending on Experience)

Contract Type: Permanent, Full-Time

About the Opportunity

An outstanding opportunity has arisen for a Data Engineer with various levels of experience to join an innovative, forward-thinking Data division within a UK-leading, award-winning corporate organisation.

In this role, you will become part of a highly collaborative team comprising data and AI engineers, data scientists, developers, analysts, and architects. Together, you will design and build modern machine learning and AI services that support advanced analytics and directly improve products across the entire business.

This is a fantastic opportunity to work on a highly modern technology stack and learn from an exceptional team, offering immense scope for technical growth and career development.

Key Responsibilities

• Data Product Development: Build and support robust data products within a modern, cloud-based data platform.
• Collaborative Design: Design and deliver innovative data solutions alongside data engineers, scientists, and product teams.
• Pipeline Optimisation: Develop, maintain, and optimize scalable data pipelines across the analytics platform.
• Data Integration: Integrate large, diverse datasets from various sources while maintaining exceptionally high quality and governance standards.
• Platform Orchestration: Maintain the orchestration, proactive monitoring, and general performance of data platform components.
• Engineering Excellence: Champion high coding and data practice standards, helping to improve engineering processes across the wider data community.
• Innovation: Experiment with emerging data, machine learning (ML), and generative AI technologies to drive business value.
• Architectural Partnership: Partner with data architects on the high-level design of data products.
• Agile Squads: Work collaboratively within multi-functional agile squads.
• AI Infrastructure: Support machine learning and GenAI infrastructure and end-to-end workflows.

What We Are Looking For

To be successful in this role, you will have a genuine passion for building scalable, resilient cloud data platforms alongside the following technical expertise:

• Platform Experience: Strong, hands-on experience with Databricks or Snowflake on AWS.
• Programming & Orchestration: Proven Python skills, including deep expertise in PySpark (or Spark) and Airflow.
• Data Modelling: Advanced SQL skills and extensive experience with end-to-end data modelling.
• Data Integration: Proven experience building both batch and real-time data integrations.
• CI/CD & Infrastructure: Hands-on CI/CD experience with Git, Jenkins, or similar tools, along with knowledge of Terraform or equivalent Infrastructure as Code (IaC) tools.
• Data Ingestion: The ability to successfully ingest, cleanse, and structure large, complex datasets.
• Desirable Skills: Prior experience with Docker and Kubernetes, or exposure to production-level Generative AI, is highly beneficial.
• Collaboration: Strong communication and collaboration skills, coupled with a proactive, inquisitive attitude.

Salary, Benefits & Culture

This organisation has been officially recognised as a leading UK employer, offering an inclusive, supportive, and modern environment where your development is fully supported. Alongside a highly competitive salary, you will receive a comprehensive and flexible rewards package:

• Flexible & Hybrid Working: Modern hybrid working options designed to support work-life balance, with flexibility around working hours and genuine part-time or job-share arrangements available.
• Generous Annual Leave: A highly competitive annual leave allowance with options to customise your holiday balance through buying and selling schemes.
• Health & Wellbeing: Comprehensive healthcare options, including dental plans, health cash plans, screening services, and dedicated mental health and wellness support.
• Financial Benefits: Highly competitive corporate pension plans, regular salary reviews, discretionary bonus schemes, and exclusive employee savings and loan initiatives.
• Family-Friendly Policies: Enhanced paid parental and partner leave schemes, alongside structured return-to-work programmes to support family life.
• Perks & Lifestyle: Tech saving schemes, cycle-to-work programs, vehicle scheme options, and a variety of corporate lifestyle discounts and social club events.