Data Engineer: Real-Time Pipelines & Azure Data Lake

Clio; Greater Manchester; Hybrid; GBP 70,000 - 94,000; Full time

Benefits offered by this job

Flexible hybrid work environment

25 days holiday + bank holidays

Private Healthcare with Life Insurance

Job summary

Clio, the global leader in legal AI technology, is seeking an Intermediate Data Engineer in Manchester to join our Data Engineering team. You will build data pipelines, make datasets accessible to partner teams, and contribute to platforms and tools for data at Clio.

You will work with state-of-the-art technologies to solve complex problems, ingesting data in real-time and batch modes, and delivering interactive reports for internal and customer use.

Qualifications

• Experience in software development, as well as experience in data engineering or data analytics.
• Experience with cloud infrastructure (Azure).
• Proficiency in at least one major language (e.g., Python, Spark SQL, or Scala) and SQL; ability to write clean, maintainable code.
• Experience with streaming and batch data tools: Spark, Airflow.
• Data warehousing experience with MS Fabric or similar.
• Experience using visualization tools (e.g., Power BI).
• Exceptional collaboration and communication skills; ability to derive clarity in ambiguous environments.
• Experience using mirroring or other replication tools.
• You are a self-starter and thrive on feedback.

Responsibilities

• Implement data ingestion (real-time and batch) using best practices in data modeling, ETL/ELT processes leveraging Azure technologies.
• Design, build, and maintain data transformation pipelines and notebooks consolidating data sources into Data Lakes/ Data Warehouses.
• Collaborate with engineers to adopt best practices in data system creation, data integrity, testing, analysis, validation, and documentation.
• Develop prototype or proof-of-concept implementations for projects with unknown or unproven solutions.
• Build interactive reports for internal and customer consumption.

Skills

Software development

Data engineering

SQL proficiency

Python/Scala

Spark/Streaming

Airflow

Power BI

Collaboration

Self-motivation

Tools

Azure

MS Fabric

Power BI

Job description

Clio, the global leader in legal AI technology, is seeking an Intermediate Data Engineer in Manchester to join our Data Engineering team. You will build data pipelines, make datasets accessible to partner teams, and contribute to platforms and tools for data at Clio.

You will work with state-of-the-art technologies to solve complex problems, ingesting data in real-time and batch modes, and delivering interactive reports for internal and customer use.