Senior Data Engineer

Employment Type : Fixed Term - Full Time

Location : London or Manchester UK

About us :

We're Transform. We turn data and tech into competitive advantage and social impact for the world's most complex organisations, both public and private. Organisations like Toyota, the Cabinet Office, Transport for London, Public Health England, Historic Royal Palaces, HM Courts and Tribunal Service, Santander, Department for Education and Domino’s. We're not here to generate more business for ourselves. We're here to create startling, ambitious outcomes for clients - leaving them with the capabilities they need to take it from there. We love creating real change. Making a big impact on people's lives. Optimising services, driving business growth or realising social change. To do that, we built an inclusive, high-performance culture where the world's most talented people do the best work of their careers. That's what gets us out of bed every day. We hope you feel the same. We're part of the Next 15 group, a multi-national organisation spanning over 25 brands.

The Role :

Senior Data Engineer, 9 month fixed term contract

The Senior Data Engineer will be responsible for working with a data engineering squad providing maternity cover for 9 months building data pipelines for a key automotive client initially i.e. Toyota Lexus, using Azure Data Factory and Databricks using SQL, Python, Pyspark and use of Azure cloud technologies as well as Databricks Deltalake. The data will be used for marketing, insight and analytics and dashboards.

Key Responsibilities

• Managing quality of own and teams’ outputs
• Delivering data engineering on a range of complex marketing and research processes
• Working with clients to understand needs, and best implement that with our available technology solutions
• Working with a range of data sources such as CRM, sales, research and HR data.
• Building Single Customer Views or CDPs or Data Warehouses / Data Lakes to merge disparate data sets for marketing or sales activation
• Building and configuring data ingestion methods from APIs, flat files, streaming, public data sources and survey data

Skills, Knowledge and Expertise

• Expert experience with Azure Data Factory or Python / Airflow and a range of associated libraries for data processing and manipulation
• Experience with a range of database technologies including data lakes such as Azure SQL or SQL Server, Azure Data Lake, PostgreSQL, Snowflake, MySQL, Cosmos DB or Mongo DB
• Must have experience of using Azure Databricks