Azure Data Engineer

Charles Russell Speechlys LLP; London; On-site; GBP 55,000 - 85,000; Full time

Job summary

A leading law firm seeks a skilled Azure Data Engineer to enhance their data infrastructure using Microsoft Azure. You will build robust data pipelines, ensure data integrity, and support analytics, making a significant impact in a progressive environment focused on data-driven decision-making.

Qualifications

• Proven experience in building ELT/ETL pipelines and managing data workflows.
• Proficiency in PySpark, Python, SQL, or Scala.
• Solid understanding of data modelling and relational database concepts.

Responsibilities

• Build and maintain scalable data pipelines on Azure.
• Develop and maintain ELT/ETL processes for the Data Platform.
• Implement data governance policies in compliance with UK regulations.

Skills

ELT

ETL

Azure Data Factory

SQL

Python

Data Modelling

GDPR knowledge

Education

Bachelor’s degree in computer science or related field

Microsoft Azure Data Engineer Associate certification

Tools

Power BI

Job description

We are seeking a skilled and proactive Azure Data Engineer to join our Data team. This role is critical in design input and development to managing and optimising our data infrastructure using Microsoft Azure. The role will play a key part in enabling data-driven decision-making by developing robust data pipelines, ensuring data integrity, and supporting analytics and reporting functions.

This role is perfect for a driven Azure Data Engineer who thrives on solving complex data challenges and contributing to the success of a forward-thinking law firm.

Roles and Responsibilities

Data Infrastructure Development

• Build and maintain scalable data pipelines as defined by our Senior Data Architectures on Azure.

• Develop and manage ingestion, transform, and process data pipelines from various sources with tools such as Tray.io, Azure Data Factory.

• Implement data lakes and data warehouses using Azure Synapse Analytics, Azure Data Fabric or similar tools.

Data Integration & Transformation

• Develop and maintain ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes to support the Data Platform development enabling best practice reporting and analytics.

• Integrate data from multiple systems, including legal practice/matter/finance management system, HR system (SF) and CRM platforms.

• Feed into Master Data Management process definition.

• Ensure data consistency and accuracy across all systems.

Data Governance & Security

• Implement and enforce data governance policies in compliance with UK regulations, including GDPR.

• Ensure secure data storage and transfer, leveraging Azure security features.

• Monitor and manage access controls to safeguard sensitive personal, legal and client information.

Performance Optimization

• Optimize the performance of data storage and processing systems.

• Conduct regular audits and fine-tune Azure resources to maintain cost efficiency.

• Monitor and troubleshoot data workflows to ensure reliability and scalability.

• Work closely with data team, IT teams, and legal professionals to understand data requirements.

• Provide support for analytics and reporting teams by ensuring access to clean and structured data.

• Document processes and provide training on data tools and workflows.

Skills and experience

• Experience in building ELT/ETL pipelines and managing data workflows.

• Proficiency in programming languages such as PySPark, Python, SQL, or Scala.

• Solid understanding of data modelling and relational database concepts.

• Knowledge of GDPR and UK data protection regulations.

Preferred Skills:

• Experience with Power BI for data visualization and reporting.

• Familiarity with legal industry systems, such as case or practice management platforms.

• Knowledge of evolving data tooling, technologies and concepts.

Education & Certifications:

• If possible, a Bachelor’s degree in computer science, data engineering, or a related field.

• Microsoft certifications such as Azure Data Engineer Associate or Azure Solutions Architect are highly desirable.