Data Platform Engineer: Scalable Pipelines & Lakes

A&O Shearman; Greater London; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Pension scheme

Private medical insurance

Wellbeing resources

Onsite gym

Job summary

A&O Shearman in London is seeking a Data Engineer to join the Information Technology team. The role designs, builds, and optimizes data pipelines and architectures to enable scalable, reliable, and secure data solutions, reporting to the Data Platform Owner.

The role collaborates with data scientists, analysts, and stakeholders to deliver robust data platforms supporting strategic decision-making and AI initiatives, while managing third-party service providers as needed.

Qualifications

• Proficiency in Python, SQL, and distributed data processing frameworks.
• Experience with cloud platforms (Azure, AWS) and data services (Snowflake).
• Familiarity with data lake medallion architecture and ETL workflows.

Responsibilities

• Develop and maintain data models, schemas, and integration frameworks.
• Implement data validation, cleansing, and transformation processes.
• Ensure compliance with data governance, security, and privacy standards.
• Act as a technical resource for design, build, and maintenance of the firmwide data lake and analytics platform.
• Identify opportunities for continuous improvement in scalable data pipelines and infrastructure.
• Provide support to define, implement and operate data pipelines ensuring reliable data flow between systems.
• Develop relationships with stakeholders from other IT teams to support function goals.
• Support supplier management processes for their area.
• Manage the data platform team's budget and benefits delivery.

Skills

Python

SQL

Data Modeling

Data Lakes

CI/CD

Tools

Snowflake

MS Fabric

Azure

AWS

Job description

A&O Shearman in London is seeking a Data Engineer to join the Information Technology team. The role designs, builds, and optimizes data pipelines and architectures to enable scalable, reliable, and secure data solutions, reporting to the Data Platform Owner.

The role collaborates with data scientists, analysts, and stakeholders to deliver robust data platforms supporting strategic decision-making and AI initiatives, while managing third-party service providers as needed.