Data Engineering Consultant

Turnertownsend; Greater London; On-site; GBP 65,000 - 100,000; Full time

Job summary

Turner & Townsend is seeking a data engineer to design, build and maintain scalable data pipelines using cloud technologies. You will collaborate with developers, managers and business stakeholders to translate data needs into pragmatic solutions.

The role requires hands-on experience with Databricks, Azure Data Factory, Data Lake and Synapse, plus SQL, Python and Spark. You will mentor peers, promote inclusive culture and contribute to documentation.

Qualifications

• Proven ability to design and maintain scalable data pipelines with cloud tech.
• Experience translating end-user requirements into data solutions.
• Strong collaboration with developers, managers and stakeholders.

Responsibilities

• Understand and define components of the data landscape and how it relates to the data strategy.
• Translate end-user requirements into designs and delivery plans for data solutions.
• Design, develop, execute, and maintain highly automated data pipelines using cloud technologies.
• Analyse and resolve data quality issues.
• Build and support data workflows and necessary infrastructure within the data analytics delivery team.
• Mentor and develop others in the team and promote commitment and enthusiasm.
• Foster an inclusive team culture focusing on service excellence and performance.

Skills

SQL

Python

Spark

DAX

Tools

Databricks

Azure Data Factory

Azure Data Lake

Azure Synapse

SSIS

Azure Analysis Services

Kubernetes

Docker

Git

Job description

Due to growing demand for our Infrastructure Digital - Data and Analytics services, we are seeking to recruit a data engineer with excellent technical knowledge of designing, building, and maintaining scalable data pipelines that will enable our clients to extract value from their data assets.

The Role

As part of the role you will:

• Work with developers, managers, and business stakeholders to understand and define components of the data landscape and how it relates to the data strategy
• Understand and translate end-user requirements into designs and delivery plans for effective data solutions
• Design, develop, execute, and maintain highly automated data pipelines using cloud technologies
• Analyse and resolve data quality issues
• Build, maintain, and support data workflows and the necessary infrastructure as part of a data and analytics delivery team
• Identify opportunities for improvement and promote theses through the team
• Actively mentor and develop others in the team and inspire them through commitment and enthusiasm
• Foster and demonstrate an inclusive team culture focusing on service excellence and exceptional performance
• Take knowledge or experience and translate into new ideas or solutions
• Contribute to the development and maintenance of T&Ts documentation and processes

Skills required for this role are:

Proven ability to work with with:

• Databricks
• Azure Data Factory
• Azure Data Lake
• Azure Synapse (and data warehousing approaches) or SSIS
• Azure Analysis Services

Experience in programming languages such as:

• SQL
• Python
• Spark
• DAX

Exceptional communication skills, both written and verbal - able to translate complex technical subject matter into easily understood presentations and written documentation for mixed technical audiences.

A good understanding of Devops practices:

• CI/CD (Azure DevOps preferable)
• GIT and Version Control

Desirable:

• MLFlow and other MLOps / Machine Learning Engineering processes to support advanced analytical use cases
• Data modelling including Kimball
• Container technologies such as Kubernetes and Docker
• Experience translating designs of Azure data solutions into action
• Analysis/requirements gathering, solution design, and implementation of data platform and Azure technologies
• Experience in collaborating in multi-disciplinary teams, including software engineers, DevOps and infrastructure teams, data scientists etc.

Our inspired people share our vision and mission. We provide a great place to work, where each person has the opportunity and voice to affect change.

We want our people to succeed both in work and life. To support this we promote a healthy, productive and flexible working environment that respects work-life balance.

Turner & Townsend is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and actively encourage applications from all sectors of the community.

Please find out more about us at www.turnerandtownsend.com/