Senior Data Platform Engineer - Snowflake & AI

Insight Investment; Manchester; On-site; GBP 90,000 - 120,000; Full time

Job summary

Insight Investment is seeking an experienced Principal Data Engineer to drive the design, development, and governance of a scalable data platform. You will work within the Data Platform team, leveraging Snowflake and related tooling to deliver strategic data solutions across the business.

You will collaborate with multiple business areas, ensure alignment with privacy and security standards, and promote adoption of advanced analytics, AI, and cloud-native patterns.

Qualifications

• Snowflake-based data platform design and governance experience.

Responsibilities

• Contribute to the design and implementation of a scalable data platform using Snowflake and tooling.
• Help evolve the Insight Data Strategy and communicate outcomes from leadership to teams.
• Set firm-wide standards for ingested, governed, transformed, persisted data.
• Provide expertise in ELT pipeline performance optimization.
• Enable adoption of advanced analytics and AI via best-in-class tooling.
• Evolve infrastructure-as-code alongside cloud engineering.
• Align designs with data privacy, security, and compliance policies.
• Stay updated on Snowflake and big data trends and propose advancements.

Skills

Snowflake environment

End-to-end pipelines

Python programming

CI/CD processes

Agile teamwork

Docker

Event streaming

Pyspark

AI engineering awareness

Tools

Snowflake

Snowpark

Python

GitHub Actions

TeamCity

Artifactory

Docker

Kafka

Pulsar

Azure Event Hub

Collibra

Pyspark

Job description

Insight Investment is seeking an experienced Principal Data Engineer to drive the design, development, and governance of a scalable data platform. You will work within the Data Platform team, leveraging Snowflake and related tooling to deliver strategic data solutions across the business.

You will collaborate with multiple business areas, ensure alignment with privacy and security standards, and promote adoption of advanced analytics, AI, and cloud-native patterns.