Senior Data Engineer

ICE; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

Intercontinental Exchange (ICE) seeks a Senior Data Engineer to design and optimise SQL queries, develop Snowflake stored procedures, and migrate legacy applications to support ICE Derivatives and ICE Mortgage.

You will build robust data pipelines, work with Python scripts, and collaborate with data teams to enable AI-driven analytics and scalable cloud data platforms.

Qualifications

• 5+ years in data engineering or database development.
• Writing complex SQL queries and stored procedures.
• Experience with Snowflake and cloud data platforms.
• Proficiency in Python or shell scripting for data processing.
• Familiarity with SDLC and Agile/Scrum environments.

Responsibilities

• Provides Snowflake-based data warehouse design and development for new data integration and migration.
• Designs data transformation logic using SQL, Snowflake procedures, and Python scripts for ETL/ELT.
• Builds and maintains data pipelines to support reporting and analytics.
• Maintains Snowflake objects: tables, views, streams, tasks, and external stages.
• Collaborates with data engineers, analysts, and product owners on requirements.
• Writes technical design documentation based on data architecture.
• Develops and reviews unit tests for SQL scripts and pipelines.
• Documents deployment procedures and monitoring; supports handover.
• Mentors junior developers and engineers as needed.
• Enables real-time and batch processing for AI-driven analytics and automation.
• Optimises cloud data platforms for AI scalability and high-performance data access.
• Keeps up-to-date with Snowflake features and best practices.

Skills

SQL queries

Stored procedures

Data pipelines

Python scripting

Snowflake

ETL/ELT

Git

Agile/Scrum

Communication

Education

Bachelor's degree in Computer Science / Engineering or related field

Tools

Snowflake

Git

AWS S3 / Azure Blob

Job description

Job Purpose

At Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk and make informed decisions globally. By leveraging our core strengths in technology, we continue to identify new ways to serve our customers and transform global markets.

Job Purpose

At Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk and make informed decisions globally. By leveraging our core strengths in technology, we continue to identify new ways to serve our customers and transform global markets. ICE is seeking a Senior Data Engineer who will be responsible for design and optimise SQL queries, develop stored procedures, and participate in the migration and modernisation of legacy applications to support ICE Derivatives and ICE Mortgage. The candidate should have a strong background in SQL and scripting.

Responsibilities

• Provides Snowflake-based data warehouse design and development for projects involving new data integration, migration, and enhancement of existing pipelines.
• Designs and develops data transformation logic using SQL, Snowflake stored procedures, and Python-based scripts for ETL/ELT workloads.
• Builds and maintains robust data pipelines to support reporting, analytics, and application data needs.
• Creates and maintains Snowflake objects like tables, views, streams, tasks, file formats, and external stages.
• Participates in project meetings with data engineers, analysts, business users, and product owners to understand and implement technical requirements.
• Writes technical design documentation based on business requirements and data architecture principles.
• Develops and/or reviews unit testing protocols for SQL scripts, procedures, and data pipelines using automation frameworks.
• Completes documentation and procedures for pipeline deployment, operational handover, and monitoring.
• May mentor or guide junior developers and data engineers.
• Enable real-time and batch data processing architectures that support AI-driven analytics, recommendations, forecasting, and intelligent automation.
• Optimise cloud data platforms for AI scalability, including data lakehouse architectures, semantic layers, and high-performance data retrieval patterns.
• Stays current with Snowflake features, best practices, and industry trends in cloud data platforms.
• Performs additional related duties as assigned.

Knowledge And Experience

• 5+ years of professional experience in data engineering or database development.
• Strong Hands-on experience:
  • Writing complex SQL queries and stored procedures
  • Database stored procedures, functions, views, and schema design
  • Using Streams, Tasks, Time Travel, and Cloning
• Proficiency in database performance tuning and performance optimisation — clustering, warehouse sizing, caching, etc.
• Experience configuring external stages to integrate with cloud storage (AWS S3, Azure Blob, etc.).
• Experience writing Python/Shell scripts for data processing.
• Expert knowledge of Snowflake (Tidal is an added advantage).
• Proficiency in using Git and working within Agile/Scrum SDLC environments.
• Familiarity working in a Software Development Life Cycle (SDLC) leveraging Agile principles.
• Excellent analytical, decision-making, and problem-solving skills.
• Ability to multitask in a fast-paced environment with a focus on timeliness, documentation, and communication with peers and business users.
• Strong verbal and written communication skills to engage both technical and non-technical audiences at various organisational levels.
• Bachelor’s degree in computer science, Engineering, or related field (or equivalent experience).