Data Engineer - Real-Time Pipelines (Hybrid Work)

Clio; Manchester; Hybrid; GBP 70,000 - 94,000; Full time

Benefits offered by this job

Competitive salary

Flexible hybrid work environment

25 days holiday + bank holidays

Private Healthcare with Life Insurance

Pension contribution

Professional development and growth

Clioversary recognition

Job summary

Clio in Manchester is seeking an Intermediate Data Engineer to join the expanding Data Engineering team. You will build data pipelines from scratch, make datasets accessible to partner teams, and contribute to platform tools for data at Clio by writing production-ready code.

You will work with real-time and batch ingestion, design data lakes and warehouses, and develop interactive reports for internal and client use, collaborating across engineering and analytics to deliver elegant, scalable

Qualifications

• Experience in software development and data engineering or data analytics.
• Cloud experience with Azure.
• Proficiency in Python/Scala/SQL and writing maintainable code.
• Experience with Spark and Airflow for streaming and batch data.
• Data warehousing using MS Fabric or similar.
• Proficiency with Power BI for reports.

Responsibilities

• Ingest data real-time and batch using Azure-based pipelines.
• Build and maintain data transformation pipelines and notebooks.
• Collaborate with engineers to promote best data practices.
• Develop proofs of concept for new technical solutions.
• Create interactive reports for internal and customer use.

Skills

Python/Scala/SQL

Data engineering

Azure cloud

Streaming & batch data

Collaboration & comms

Tools

Spark

Airflow

MS Fabric

Power BI

Job description

Clio in Manchester is seeking an Intermediate Data Engineer to join the expanding Data Engineering team. You will build data pipelines from scratch, make datasets accessible to partner teams, and contribute to platform tools for data at Clio by writing production-ready code.

You will work with real-time and batch ingestion, design data lakes and warehouses, and develop interactive reports for internal and client use, collaborating across engineering and analytics to deliver elegant, scalable