Senior Data Platform Engineer — Snowflake & AI Enablement

Insight Investment; Manchester; Hybrid; GBP 95,000 - 130,000; Full time

Job summary

Insight Investment is seeking an experienced Principal Data Engineer to join the Data Platform team. You will contribute to a scalable data platform on Snowflake, evolve the data strategy, and collaborate across business areas to democratise data while upholding governance.

The role emphasizes Agile delivery, modern tooling, and a strong focus on ELT/ETL optimization, security, and compliance as part of the SDLC.

Qualifications

• Experience with end-to-end data pipelines in Snowpark or equivalent frameworks.
• Proficiency in Snowflake data platform fundamentals and ELT/ETL pipelines.
• Strong Python development, testing, and CI/CD practices.

Responsibilities

• Contribute to design and implement a scalable data platform using Snowflake and tooling.
• Evolve the organisation's data strategy and governance in collaboration with leadership.
• Set firm-wide standards for ingesting, governing, transforming, persisting, and democratizing data.
• Provide expertise in ELT pipeline performance optimization.
• Enable adoption of analytics and AI through best-in-class tooling.
• Collaborate with cloud engineering on infrastructure-as-code and security.

Skills

Agile teamwork

Communication

Independence

Problem solving

Tools

Snowflake

Pyspark

Polars

Dask

DBT

Python

GitHub Actions

TeamCity

Artifactory

Kafka

Pulsar

Azure Event Hub

Collibra

Iceberg

Arrow

Langchain

Llamaindex

Pinecone

Job description

Insight Investment is seeking an experienced Principal Data Engineer to join the Data Platform team. You will contribute to a scalable data platform on Snowflake, evolve the data strategy, and collaborate across business areas to democratise data while upholding governance.

The role emphasizes Agile delivery, modern tooling, and a strong focus on ELT/ETL optimization, security, and compliance as part of the SDLC.