Data Engineer

Transform; London; On-site; GBP 42,000 - 85,000; Full time

Job summary

A leading data and tech company in London is seeking a Data Engineer to join their Agile delivery team. The role involves developing data engineering pipelines, working with various data sources, and ensuring high-quality data outputs. The ideal candidate will have several years of experience in data engineering, particularly with Azure technologies. Competitive salary and benefits offered in an inclusive work environment.

Benefits

28 days holiday with option to buy/sell days

Day off for your birthday

Matched pension contributions up to 5%

Life assurance

Enhanced maternity and paternity leave

Cycle to work scheme

Qualifications

• 2-3 years of hands-on data engineering experience.
• Experience with Azure Data Factory, Databricks, and Python.
• Familiarity with database technologies such as Azure SQL and Data Lakes.

Responsibilities

• Develop data engineering pipelines for various data products.
• Build and configure data ingestion methods from APIs and files.
• Ensure quality of data outputs and work with data from multiple sources.

Skills

Data Engineering

Python

Azure Data Factory

Azure Databricks

Data Warehousing

Agile Methodology

Tools

Azure SQL

Databricks

Job description

Join to apply for the Data Engineer role at Transform

Join to apply for the Data Engineer role at Transform

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Transform

TA & Recruitment Nerd | Attracting talented people | Building quality teams across all practices within Transform | Tech, Delivery, Data, DevOps…

About us

We're Transform.

We turn data and tech into competitive advantage and social impact for the world's most complex organisations, both public and private.

Organisations like Toyota Lexus, Anglian Water, the Cabinet Office, Transport for London, Public Health England, HM Courts and Tribunal Service, Santander, Department for Education and Domino’s. To name but a few.

We're not here to generate more business for ourselves. We're here to create startling, ambitious outcomes for clients - leaving them with the capabilities they need to take it from there.

We love creating real change. Making a big impact on people's lives. Optimising services, driving business growth or realising social change.

To do that, we built an inclusive, high-performance culture where the world's most talented people do the best work of their careers.

That's what gets us out of bed every day. We hope you feel the same.

We're part of the Next 15 group, a multi-national organisation spanning over 25 brands. Brands like ours, looking to stand out from the crowd as they deliver best in class work for their clients. Find out more at: www.transformUK.com

The Role:

The Data Engineer will be responsible for working as part of an Agile delivery squad with other data engineers and senior data engineers. Working to deliver data engineering pipelines for a range of data products for use in insight, reporting and analytics including AI, working for a senior data engineer/lead data engine and will be part of a team with product owners, business analysts, data architects, data analysts, delivery projects managers, test engineers and data scientists.

Key Responsibilities:

• Delivering data engineering pipelines for a range of creation of key datasets/data products to support single customer views, complex marketing and research processes
• Adapt to use of new any data engineering technologies, frameworks and approaches by our senior or lead data engineers
• Ensuring quality of own outputs in terms of data engineering data pipelines and quality outputs
• Working with a range of data sources such as CRM, sales, pupil, customer, research, HR data including structured and unstructured data.
• Support building of Single Customer Views or data products or Data Warehouses/Data Lakes to merge disparate data sets for analysis/reporting, marketing or sales activation
• Build and configure data ingestion methods from APIs, flat files, streaming, public data sources and survey data

Key Skills/Experiences:

• Around 2 – 3 years’ hands on data engineering experience
• Around 2 years’ experience with Azure Data Factory, Python and Azure SQL
• Minimum of 1 year commercial experience with Azure Databricks/Pyspark and a range of associated Python libraries for data processing and manipulation
• Experience with a range of database technologies including data lakes such as Azure SQL, SQL Server or Azure Data Lake
• Use of Azure DevOps and CI/CD processes
• Experience of data warehouse or data lakes with SCVs and helping build data products for analysis, reporting and insight
• Experience of data ingestion of streaming data using Databricks, Deltalake and Pyspark
• Ability to work well as part of, a data engineering team using the agile methodology
• Azure Data Factory and Databricks in an Azure Cloud environment and use of Azure DevOps
• Knowledge of other ELT/ETL tools such as Informatica DEI/BDM and Talend would be beneficial

Our culture is built on:

• Being one team; looking out for each other as a team
• The world never stops changing and we’ll never stop learning
• Infinity & Beyond; we’re crazy ambitious, not afraid to fail along the way (it’s just falling with style)
• Integrity is everything; we’re honest with each other and with our clients
• Diversity is our superpower; everyone’s story is different, and we celebrate differences
• We’re all in; we take on tough, complex challenges with lots of moving parts and we’re committed to the work, our clients and each other

Our benefits include:

• Holiday entitlement, 28 days with the option to buy/sell up to 5 days
• Day off (on or in the week of) your birthday
• Pension eligibility, up to 5% matched contributions
• Life assurance
• Enhanced maternity and enhanced paternity and shared parental leave
• Cycle to work & electric car schemes
• A range of other benefits from our flexible benefits package

At Transform we believe in a culture of inclusivity, we celebrate difference and believe that diversity makes our business more relevant, our work more meaningful and our people more empowered. We’re committed to equality of opportunity for all, and we actively seek applications from all ethnicities, orientations, beliefs, gender identities + those with neurodiverse traits and disabilities. We want you to have the best opportunity to show us who you are and what you can do. Please do let us know if you need any adjustments now or at any point in the recruitment process.

If this sounds like you, please get in touch to discuss in more detail.

Use of AI in CV and Interviews

Whilst we are a technology company and promote using AI the right and ethical way, we value authenticity and transparency in our hiring process. To ensure fairness and accuracy in assessing your skills and experience, we kindly request that you refrain from using AI-assisted tools to generate answers during interviews or enhancing your CV.

We are looking for genuine insights into your abilities, experiences, and personality. Any misrepresentation through AI-generated content may impact our ability to make an informed decision. We look forward to getting to know the real you!

Seniority level

• Seniority level

  Associate

Employment type

• Employment type

  Full-time

Job function

• Job function

  Consulting, Engineering, and Other

• Industries

  Business Consulting and Services and IT Services and IT Consulting

Referrals increase your chances of interviewing at Transform by 2x

Sign in to set job alerts for “Data Engineer” roles.

Greater London, England, United Kingdom 2 days ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 day ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

City Of London, England, United Kingdom £75,000.00-£85,000.00 10 hours ago

London, England, United Kingdom 1 day ago

London, England, United Kingdom 1 week ago

Greater London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 5 days ago

London Area, United Kingdom £42,000.00-£45,000.00 5 hours ago

City Of London, England, United Kingdom £60,000.00-£70,000.00 2 weeks ago

London, England, United Kingdom 1 day ago

London, England, United Kingdom 7 hours ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 2 days ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

London Area, United Kingdom £90,000.00-£90,000.00 12 hours ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.