Data Engineer

A&O Shearman; Greater London; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Pension scheme

Private medical insurance

Wellbeing resources

Onsite gym

Job summary

A&O Shearman in London is seeking a Data Engineer to join the Information Technology team. The role designs, builds, and optimizes data pipelines and architectures to enable scalable, reliable, and secure data solutions, reporting to the Data Platform Owner.

The role collaborates with data scientists, analysts, and stakeholders to deliver robust data platforms supporting strategic decision-making and AI initiatives, while managing third-party service providers as needed.

Qualifications

• Proficiency in Python, SQL, and distributed data processing frameworks.
• Experience with cloud platforms (Azure, AWS) and data services (Snowflake).
• Familiarity with data lake medallion architecture and ETL workflows.

Responsibilities

• Develop and maintain data models, schemas, and integration frameworks.
• Implement data validation, cleansing, and transformation processes.
• Ensure compliance with data governance, security, and privacy standards.
• Act as a technical resource for design, build, and maintenance of the firmwide data lake and analytics platform.
• Identify opportunities for continuous improvement in scalable data pipelines and infrastructure.
• Provide support to define, implement and operate data pipelines ensuring reliable data flow between systems.
• Develop relationships with stakeholders from other IT teams to support function goals.
• Support supplier management processes for their area.
• Manage the data platform team's budget and benefits delivery.

Skills

Python

SQL

Data Modeling

Data Lakes

CI/CD

Tools

Snowflake

MS Fabric

Azure

AWS

Job description

We are recruiting a Data Engineer to join our Information Technology team in London. Reporting to the Data Platform Owner, this officer/specialist level role will design, build, and optimize data pipelines and architectures to enable scalable, reliable, and secure data solutions. The role is a member of the data platform team and is responsible for managing and motivating a of skilled IT professionals and directing external third-party service providers.

The role is accountable for ensuring that data is accessible, high-quality, and ready for advanced analytics and AI initiatives. The role also requires collaboration with data scientists, analysts, and business stakeholders to deliver robust data platforms that support strategic decision-making.

Role & responsibilities

• Develop and maintain data models, schemas, and integration frameworks
• Implement data validation, cleansing, and transformation processes
• Ensure compliance with data governance, security, and privacy standards
• Act as a key technical resource for matters related to the design, build, and maintenance of the firmwide data lake and analytics platform.
• Identify opportunities for continuous improvement in the design, build, and maintenance of scalable, reliable data pipelines and infrastructure.
• Provide support to define, implement and operate the firm's data pipelines to ensure reliable, efficient data flow between systems.
• Develop working relationships with stakeholders from other IT teams to contribute to the overall goals of the function.
• Support supplier management processes for their area.
• Support the management of the data platform team's budget and benefits delivery processes.
• Identify opportunities for continuous improvement in building and maintaining data pipelines to ensure reliable, efficient data flow between systems.

Key requirements

• Proficiency in Python, SQL, and distributed data processing frameworks
• Experience with cloud platforms (Azure, AWS), and data services (MS Fabric, Snowflake)
• Experience with MS Fabric a plus.
• Familiarity with data lake medallion architecture
• Familiarity with designing data warehouses, data lakes, and ETL workflows
• Knowledge of IT strategic planning, design, and operations processes.
• Familiarity with CICD methodology and techniques in cloud data platforms
• Knowledge of current IT and data market trends and technology innovations.
• Proven track record of collaborating with business teams
• At least 3 years background in the IT industry, with experience managing data engineering
• Good stakeholder engagement and communication skills.
• Good commercial and financial acumen with strong numerical reasoning skills.
• Ability to mentor colleagues and help others to develop in their jobs.
• Lives the firm's values at all times and is able to collaborate widely when needed.

Should you require additional support at any stage of the recruitment process due to a disability or a health condition, please do not hesitate to contact a member of our recruitment team who will work with you to provide any adjustments as required.

We are an equal opportunities recruiter and do not discriminate on the basis of race, colour, sex, religion, sexual orientation, national origin, disability, or any other protected characteristic.

We recognise that our people are our most valuable asset, which is reflected in the wide range of benefits that are available to our employees. Some of these benefits include: our occupational pension scheme, group income protection cover, private medical insurance, mental health resources and free apps, health and wellbeing services encompassing an onsite gym, wellbeing centre and GP service, emergency back-up care support, parental and special leave, holiday entitlement increasing with length of service, holiday trading, season ticket loans and online discounts and lifestyle management services.