Senior Data & AI Engineer, Data Products

Beacon; Greater London; Hybrid; GBP 80,000 - 90,000; Full time

Benefits offered by this job

Hybrid working

Flexible working arrangements

Bonus

Job summary

Beacon Intelligence in London seeks a Senior Data/AI Engineer to build and scale data products, collaborating with product, commercial and technical teams to transform datasets into customer-facing solutions.

You will shape the data platform using Databricks, Azure, Airbyte and CI/CD practices, applying AI/LLMs to deliver practical, product-ready capabilities while mentoring the team and driving commercial value. London hybrid pattern with growth opportunities.

Qualifications

• Deep, hands-on experience designing and operating production data platforms on Azure Databricks.
• Strong Spark, PySpark, Spark SQL and Delta Lake experience, incl. batch/streaming workloads.
• Experience with Unity Catalog, data governance and schema design for production assets.
• Advanced Python and SQL for production-scale data products and APIs.
• Experience applying AI and LLMs to real-world data solutions.
• CI/CD experience with Azure DevOps or GitHub Actions.

Responsibilities

• Design and build scalable data products underpinning Beacon’s offerings.
• Transform raw data into structured, enriched datasets for product use.
• Partner with product and commercial teams to package and monetize data.
• Enable delivery via APIs, internal tools and customer platforms.
• Apply AI/LLM capabilities to enrich data and build features.
• Own data platform architecture and cost optimisation.
• Mentor engineers and promote a data/AI engineering mindset.

Skills

Python

SQL

Spark

Data modeling

APIs

LLMs

Product thinking

Stakeholder collaboration

Tools

Azure Databricks

Azure Cloud

Airbyte

Terraform

GitHub Actions

LangChain

LlamaIndex

Azure DevOps

Job description

Beacon Intelligence in London seeks a Senior Data/AI Engineer to build and scale data products, collaborating with product, commercial and technical teams to transform datasets into customer-facing solutions.

You will shape the data platform using Databricks, Azure, Airbyte and CI/CD practices, applying AI/LLMs to deliver practical, product-ready capabilities while mentoring the team and driving commercial value. London hybrid pattern with growth opportunities.