Platform Engineer

Artificial Intelligence Jobs; Greater London; Hybrid; GBP 80,000 - 100,000; Full time

Benefits offered by this job

Hybrid working

Annual leave 25 days + holidays

Private medical insurance

Learning platforms

Career progression

Volunteer days

Job summary

Artificial Intelligence Jobs with a client in the UK seeks a Senior Platform Engineer to join its technology and data engineering team in a permanent hybrid role across Surrey and Greater London. You will help develop and optimise a Databricks data platform that supports analytics, machine learning and artificial intelligence across the business.

You will design, build and enhance a secure, scalable Databricks platform, develop batch and real-time data pipelines, apply infrastructure as code,

Qualifications

• Significant hands-on experience building and supporting scalable, production-grade data platforms.

Responsibilities

• Design, build and enhance a secure, scalable and reliable Databricks platform.
• Develop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta Lake.
• Contribute to platform architecture, engineering standards and best practices across the data estate.
• Work with Product, Analytics and Data Science teams to deliver effective data platform solutions.
• Support platform operations, monitoring, performance optimisation and reliability.
• Apply Infrastructure as Code principles to support consistent and efficient platform management.
• Share technical knowledge and contribute to continuous improvement across the engineering team.

Skills

Databricks

Apache Spark

Delta Lake

Python

SQL

Cloud data engineering

Terraform

Bicep

Data modeling

ETL/ELT

Education

Degree in Computer Science or related field

Tools

Terraform

Bicep

Job description

Our client is seeking a Senior Platform Engineer to join its technology and data engineering team in a permanent hybrid role across Surrey and Greater London. This is a hands-on opportunity to help develop and optimise a Databricks data platform that supports analytics, machine learning and artificial intelligence across the business.

Key Responsibilities:

• Design, build and enhance a secure, scalable and reliable Databricks platform
• Develop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta Lake
• Contribute to platform architecture, engineering standards and best practices across the data estate
• Work with Product, Analytics and Data Science teams to deliver effective data platform solutions
• Support platform operations, monitoring, performance optimisation and reliability
• Apply Infrastructure as Code principles to support consistent and efficient platform management
• Share technical knowledge and contribute to continuous improvement across the engineering team

Job Requirements:

• Significant experience building and supporting scalable, production-grade data platforms
• Strong hands-on expertise with Databricks, Apache Spark, Delta Lake, Python and SQL
• Good understanding of cloud-based data engineering, ideally within Microsoft Azure environments
• Experience with Infrastructure as Code tools such as Terraform, Bicep or similar
• Understanding of data modelling, ETL and ELT processes, data quality, security and governance
• Ability to collaborate effectively with technical and non-technical stakeholders
• Experience with Unity Catalog, MLflow or Databricks Asset Bundles would be advantageous
• Knowledge of dbt, Kafka, Event Hubs or other data transformation and streaming technologies would be beneficial

Desirable Experience:

• Databricks certifications
• Experience working with retail or consumer packaged goods data, including point-of-sale, inventory or supply chain datasets
• Understanding of modern data platform architecture and cloud engineering practices
• A degree in Computer Science, Data Engineering or a related discipline, or equivalent practical experience

Benefits:

• Hybrid working, typically with two days in the office, alongside a work-from-anywhere policy
• 25 days Annual leave allowance, bank holidays and an additional day off for a birthday
• Summer working hours and flexible working arrangements
• Access to learning platforms, professional development courses and structured career progression
• Private medical insurance, healthcare support and mental health services
• Home workspace assessment to support a safe and productive working environment
• Paid volunteering days and opportunities to support charitable causes
• Access to car purchase, gym, technology and other lifestyle benefits

If you are an experienced Platform Engineer with strong Databricks and data platform engineering expertise, this is an excellent opportunity to contribute to modern cloud data solutions at scale. Salary is negotiable but in the region of £80,000 plus bonus and other benefits.