Azure Data Engineer: Build Scalable Data Products

JATO Dynamics Ltd

Uxbridge

Hybrid

GBP 60,000 - 90,000

Full time

14 days+

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

JATO Dynamics Ltd. is hiring an Azure Data Engineer to join agile teams and help build next-generation SaaS data solutions for the automotive sector. You will design, implement and operate data pipelines in Azure, turning data assets into usable data products for internal and external customers.

You will collaborate with Operations, Architecture, Delivery, Product and Software Engineering to release platform increments, improve data quality and enforce DevOps practices across CI/CD pipelines.

Qualifications

Minimum 2+ years’ hands-on experience designing and developing complex ETL/ELT pipelines in the cloud (Azure Data Factory and Azure Synapse).
Experience of preparing data mappings based on high level requirements and taking those to a solution level details.
Firm understanding of data warehousing concepts in the lake and traditional database with experience of working end-to-end in a ETL lifecycle from data acquisition to the consumption layer.
Knowledge and experience in value-added areas of automation, scripting.
Hands-on analytical and data exploration skills.
Experience of working in Agile methodology.
Good knowledge and hands-on experience of developing Stored Procedures.
Experience of working with PySpark Notebooks for data ingestion and provision.
Practical experience of improving data quality and efficiency in data pipelines.
Solid understanding of DevOps and CI/CD.
Understanding of compliance and lifecycle of data management.

Responsibilities

Ingest, warehouse, and store data at scale in the Azure cloud platform as JATO Data Assets.
Build Data Products from Data Assets and provision to customers to satisfy commercial requirement.
Work closely with colleagues in Operations, Architecture, Delivery, Product, and Software Engineering to collaboratively release platform increments.
Contribute toward solution level architecture and design.
Own your release from development to production following DevOps method.
Contribute towards ADF and Synapse pipeline design improvement and best practices and following design principles.
Understand data issues and able to analyse and work with Architects in addressing design challenge.
Migrate data from legacy databases and storage to Azure cloud-based lake and warehouse.