Senior Data Engineer: Snowflake & AI-Powered Data Pipelines

Intercontinental Exchange Holdings, Inc.; Greater London; On-site; GBP 85,000 - 115,000; Full time

Job summary

Intercontinental Exchange (ICE) seeks a Senior Data Engineer to design and optimise SQL queries, develop Snowflake-based data warehouses, and modernise legacy applications to support ICE Derivatives and ICE Mortgage. Strong SQL, Python, and Snowflake expertise are required.

You will build and maintain data pipelines, collaborate with engineers and product owners, and contribute to AI-driven analytics initiatives. A Bachelor’s degree in CS/Engineering and 5+ years’ experience are expected.

Qualifications

• 5+ years of professional data engineering or database development experience.
• Strong SQL and stored procedures experience.
• Experience with Snowflake, cloud storage, and data pipeline development.

Responsibilities

• Provides Snowflake-based data warehouse design and development for projects involving new data integration, migration, and enhancement of existing pipelines.
• Designs and develops data transformation logic using SQL, Snowflake stored procedures, and Python-based scripts for ETL/ELT workloads.
• Builds and maintains robust data pipelines to support reporting, analytics, and application data needs.
• Creates and maintains Snowflake objects like tables, views, streams, tasks, file formats, and external stages.
• Participates in project meetings with data engineers, analysts, business users, and product owners to understand and implement technical requirements.
• Writes technical design documentation based on business requirements and data architecture principles.
• Develops and/or reviews unit testing protocols for SQL scripts, procedures, and data pipelines using automation frameworks.
• Completes documentation and procedures for pipeline deployment, operational handover, and monitoring.
• May mentor or guide junior developers and data engineers.
• Enable real-time and batch data processing architectures that support AI-driven analytics, recommendations, forecasting, and intelligent automation.
• Optimise cloud data platforms for AI scalability, including data lakehouse architectures, semantic layers, and high-performance data retrieval patterns.
• Stays current with Snowflake features, best practices, and industry trends in cloud data platforms.
• Performs additional related duties as assigned.

Skills

SQL

Stored Procedures

Python scripting

ETL/ELT

Git

Agile/Scrum

Data pipelines

Performance tuning

Education

Bachelor's degree in CS/Engineering

Tools

Snowflake

AWS S3

Azure Blob

Shell scripting

Job description

Intercontinental Exchange (ICE) seeks a Senior Data Engineer to design and optimise SQL queries, develop Snowflake-based data warehouses, and modernise legacy applications to support ICE Derivatives and ICE Mortgage. Strong SQL, Python, and Snowflake expertise are required.

You will build and maintain data pipelines, collaborate with engineers and product owners, and contribute to AI-driven analytics initiatives. A Bachelor’s degree in CS/Engineering and 5+ years’ experience are expected.