Data Engineer (Snowflake & Kafka)

Lorien; Greater London; Hybrid; GBP 55,000 - 70,000; Full time

Job summary

Lorien is seeking a Data Analyst/Engineer on a 6-month contract in Greater London to join a UK banking client. The role emphasizes Snowflake data warehousing, Airflow orchestration, AWS services (S3, Lambda), Kafka, and Python for building scalable data pipelines.

The successful candidate will lead technical initiatives, mentor junior engineers, and contribute to code reviews and best practices within a cloud-native environment in the UK.

Qualifications

• Experience with Snowflake for data warehousing and writing efficient SQL.
• Orchestration and workflow management using Airflow.
• Hands-on experience with AWS services, especially S3 and Lambda.
• Familiarity with Kafka concepts and streaming data pipelines integration.
• Strong data modelling, ETL/ELT, and performance optimization.
• Proficiency in Python for data engineering tasks and automation.

Responsibilities

• Lead technical initiatives within the team and drive best practices.
• Mentor junior engineers on coding standards and design patterns.
• Participate in code reviews and foster continuous improvement.

Skills

Snowflake

Airflow

AWS

S3

Lambda

Kafka

Data modelling

ETL/ELT

Python

Data pipelines

Git

Code reviews

Mentoring

CI/CD

Tools

Git

CI/CD

Job description

Our UK leading banking client are looking for a Data Analyst to join their team on an initial 6-month contract.

Core Technical Requirements

• Strong experience with Snowflake for data warehousing, including writing efficient SQL and managing schemas.
• Proficiency in Airflow for orchestration and workflow management.
• Hands-on experience with AWS services, particularly S3 for storage and Lambda for serverless processing.
• Familiarity with Kafka concepts (producers, consumers, topics) and ability to integrate with streaming data pipelines.
• Solid understanding of data modelling, ETL/ELT processes, and performance optimization.
• Proficiency in Python for data engineering tasks and automation.
• Ability to design and implement scalable, maintainable data pipelines.
• Experience with version control systems (e.g., Git) and collaborative development workflows.
• Ability to lead technical initiatives within the team and drive best practices.
• Experience in mentoring junior engineers, providing guidance on coding standards, design patterns, and career development.
• Comfortable with code reviews and fostering a culture of continuous improvement.

Best Practices & Mindset

• Strong grasp of data quality principles, including validation and monitoring.
• Ability to read, understand, and refactor existing code effectively.
• Familiarity with CI/CD practices for data pipeline deployment.
• Comfortable working in cloud-native environments and following security/compliance standards.

Nice-to-Have

• Exposure to streaming data architectures and event-driven systems.
• Knowledge of Snowflake performance tuning and cost optimization.