Senior Data Engineer

Test Triangle Limited; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

Test Triangle Limited in London seeks a Senior Data Engineer to design, build, and operate enterprise-scale data solutions. You will leverage Snowflake with hands-on Python, PySpark, AWS and Airflow to create scalable data platforms and robust analytics capabilities.

The role emphasizes technical leadership, governance, and collaboration with cross-functional teams to deliver high-performance data services for the business.

Qualifications

• Experience designing and implementing enterprise-scale data solutions.
• Strong expertise in Snowflake data platforms and cloud data architectures.
• Proficient in Python and PySpark for data processing and orchestration.
• Hands-on experience with AWS and Airflow for data pipelines and workflows.

Responsibilities

• Design, develop, and optimize data pipelines and data models in Snowflake.
• Write and optimize SQL queries, procedures, and transformations for large-scale data processing.
• Build and optimize data warehouse solutions on Snowflake.
• Develop data ingestion, transformation, and orchestration using Python, PySpark, and Airflow.
• Ensure data quality, governance, security, and compliance across the platform.
• Collaborate with stakeholders to translate requirements into technical solutions.
• Troubleshoot production issues and drive platform reliability.

Skills

Snowflake

Python

PySpark

AWS

Airflow

Job description

We are seeking a highly skilledSenior Data Engineerwith 8–15 years of experience in designing, developing, and implementing enterprise-scale data solutions. The ideal candidate will possess strong expertise inSnowflakeand hands‑on experience withPython, PySpark, AWS, and Airflowfor building scalable, high-performance data platforms. The role demands strong technical leadership, problem‑solving capabilities, and the ability to collaborate effectively with cross‑functional teams to deliver robust data engineering solutions.

Key Responsibilities

• Design, develop, and optimize data pipelines and data modelsusing Snowflakefor enterprise analytics and reporting
• Write and optimize complex SQL / PL‑SQL queries, procedures, and transformationsto support large‑scale data processing
• Build and optimize enterprise data warehouse solutions on Snowflake.
• Develop data ingestion, transformation, and orchestration workflows using Python, PySpark, and Airflow.
• Develop and optimize complex SQL queries, stored procedures, views, streams, and tasks in Snowflake.
• Implement scalable cloud‑based data solutions leveraging AWS services.
• Ensure data quality, governance, security, and compliance across the data platform.
• Perform query tuning, performance optimization, and cost optimization within Snowflake.
• Automate deployment and monitoring through CI/CD and DevOps practices.
• Collaborate with business stakeholders, architects, analysts, and engineering teams to translate business requirements into technical solutions.
• Troubleshoot production issues and implement preventive measures to enhance platform reliability.

Preferred Experience

• Experience in large‑scale cloud data migration initiatives.
• Strong understanding of enterprise data architecture and modern data platforms.
• Experience working with structured, semi‑structured, and unstructured data.
• Exposure to Banking, Financial Services, or other large enterprise environments will be an added advantage.
• Experience in leading technical discussions and mentoring engineering teams.