Data Engineer - Azure Cloud Data Pipelines & ML

Cerberus Capital Management; Greater London; On-site; GBP 60,000 - 100,000; Full time

Job summary

A financial services firm is seeking a Data Engineer to expand their capabilities in building modern, scalable data platforms. The role involves designing cloud-based data pipelines and utilizing tools such as dbt and Airflow. The ideal candidate will possess strong Python skills, experience with Azure, and an understanding of data warehousing with Snowflake. This position provides opportunities for impact within a small, agile team dedicated to optimizing data for advanced analytics and machine learning applications, promoting a collaborative and innovative culture.

Qualifications

• Hands-on experience in production environments emphasizing performance optimization.
• Advanced proficiency in Python for data engineering and pipeline development.
• Proven expertise with Snowflake in schema design and data ingestion.

Responsibilities

• Design and build scalable, cloud-based data pipelines and architectures.
• Develop ELT workflows using tools like dbt and SQL.
• Collaborate with data scientists to ensure data integration for analytics.

Skills

Python expertise

Cloud platforms (Azure)

Data modeling (dbt)

SQL databases (PostgreSQL, MySQL)

Workflow orchestration (Apache Airflow)

Infrastructure as code (Terraform, Pulumi)

Communication and problem-solving

Education

Degree in STEM field

Tools

Azure

Snowflake

Apache Airflow

Job description

A financial services firm is seeking a Data Engineer to expand their capabilities in building modern, scalable data platforms. The role involves designing cloud-based data pipelines and utilizing tools such as dbt and Airflow. The ideal candidate will possess strong Python skills, experience with Azure, and an understanding of data warehousing with Snowflake. This position provides opportunities for impact within a small, agile team dedicated to optimizing data for advanced analytics and machine learning applications, promoting a collaborative and innovative culture.