Senior Data Engineer

Test Triangle; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

Test Triangle is seeking a highly skilled Senior Data Engineer with 8–15 years of experience to design, develop and implement enterprise-scale data solutions. The ideal candidate will have strong expertise in Snowflake and hands-on experience with Python, PySpark, AWS and Airflow to build scalable data platforms.

You will lead technical efforts, collaborate with cross-functional teams, and ensure data quality, governance and cost optimization.

Qualifications

• 8–15 years of experience designing and delivering enterprise-scale data solutions.
• Strong expertise in Snowflake and hands-on with Python, PySpark, AWS, and Airflow.
• Ability to lead technically and collaborate with cross-functional teams.

Responsibilities

• Design, develop, and optimize data pipelines and data models using Snowflake for enterprise analytics and reporting.
• Write and optimize complex SQL / PL‑SQL queries, procedures, and transformations to support large-scale data processing.
• Build and optimize enterprise data warehouse solutions on Snowflake.
• Develop data ingestion, transformation, and orchestration workflows using Python, PySpark, and Airflow.
• Develop and optimize complex SQL queries, stored procedures, views, streams, and tasks in Snowflake.
• Implement scalable cloud‑based data solutions leveraging AWS services.
• Ensure data quality, governance, security, and compliance across the data platform.
• Perform query tuning, performance optimization, and cost optimization within Snowflake.
• Automate deployment and monitoring through CI/CD and DevOps practices.
• Collaborate with business stakeholders, architects, analysts, and engineering teams to translate business requirements into technical solutions.
• Troubleshoot production issues and implement preventive measures to enhance platform reliability.

Skills

Python

SQL

Data modelling

Leadership

Cloud concepts

Tools

Snowflake

PySpark

Airflow

AWS

SQL optimization

Job description

We are seeking a highly skilledSenior Data Engineerwith 8–15 years of experience in designing, developing, and implementing enterprise-scale data solutions. The ideal candidate will possess strong expertise inSnowflakeand hands‑on experience withPython, PySpark, AWS, and Airflowfor building scalable, high-performance data platforms. The role demands strong technical leadership, problem‑solving capabilities, and the ability to collaborate effectively with cross‑functional teams to deliver robust data engineering solutions.

Key Responsibilities

• Design, develop, and optimize data pipelines and data modelsusing Snowflakefor enterprise analytics and reporting
  
• Write and optimize complex SQL / PL‑SQL queries, procedures, and transformations to support large‑scale data processing
  
• Build and optimize enterprise data warehouse solutions on Snowflake.
  
• Develop data ingestion, transformation, and orchestration workflows using Python, PySpark, and Airflow.
  
• Develop and optimize complex SQL queries, stored procedures, views, streams, and tasks in Snowflake.
  
• Implement scalable cloud‑based data solutions leveraging AWS services.
  
• Ensure data quality, governance, security, and compliance across the data platform.
  
• Perform query tuning, performance optimization, and cost optimization within Snowflake.
  
• Automate deployment and monitoring through CI/CD and DevOps practices.
  
• Collaborate with business stakeholders, architects, analysts, and engineering teams to translate business requirements into technical solutions.
  
• Troubleshoot production issues and implement preventive measures to enhance platform reliability.
  

Preferred Experience

• Experience in large-scale cloud data migration initiatives.
  
• Strong understanding of enterprise data architecture and modern data platforms.
  
• Experience working with structured, semi-structured, and unstructured data.
  
• Exposure to Banking, Financial Services, or other large enterprise environments will be an added advantage.
  
• Experience in leading technical discussions and mentoring engineering teams.