Principal Data Platform Leader – Snowflake & AI Enablement

Insight Investment; Manchester; On-site; GBP 90,000 - 130,000; Full time

Job summary

Insight Investment is building a scalable data platform on Snowflake, extending governance and analytics across the business. You will join the Data Platform team, delivering ELT pipelines and enabling AI adoption while ensuring secure SDLC practices.

The Principal Data Engineer will shape strategy, set data standards, and collaborate with multiple business areas to drive innovation and reliable data access.

Qualifications

• Proficiency with Snowflake including Warehouses, Tasks/Streams, Snowpipe, Snowpark, Distributed UDF/Sproc, Time Travel, Cloning.

Responsibilities

• Contribute to the solution design and implementation of a robust and scalable data platform using Snowflake with complementary tooling to meet the organisation’s needs.
• Help evolve the Insight Data Strategy, communicate outcomes from a leadership through to team level.
• Set the firm-wide standards and conventions for ingesting, governing, transforming, persisting, and democratising data.
• Provide expertise in ELT pipeline performance optimisation
• Enable the adoption of advanced analytics & AI by configuring best-in-class tooling.
• Evolve the usage of infrastructure-as-code in collaboration with cloud engineering.
• Align technical designs with internal data, privacy, security and compliance policies.
• Stay abreast of industry trends and emerging technologies related to Snowflake and big data processing, recommending relevant advancements for consideration.

Skills

Strategic thinking

Problem solving

Independent worker

Communication

Agile collaboration

Tools

Snowflake

Snowpark

DBT

Python

SQL

CI/CD

Docker

Java/Scala

Kafka

Pulsar

Azure Event Hub

Collibra

Apache Iceberg

Apache Arrow

PySpark

AI engineering

Langchain

Llamaindex

Pinecone

Job description

Insight Investment is building a scalable data platform on Snowflake, extending governance and analytics across the business. You will join the Data Platform team, delivering ELT pipelines and enabling AI adoption while ensuring secure SDLC practices.

The Principal Data Engineer will shape strategy, set data standards, and collaborate with multiple business areas to drive innovation and reliable data access.