Sr Data Engineer

Response Informatics; Salford; Hybrid; GBP 40,000 - 55,000; Full time

Job summary

A data solutions company in Salford is seeking a professional to design and maintain metadata-driven data pipelines. The candidate will build and implement metadata frameworks while optimizing data workflows with ADF, Databricks, SparkSQL, and Pandas. This is a hybrid role requiring onsite presence. The position lasts for 4 months and focuses on ensuring scalability and reusability of data solutions.

Responsibilities

• Design, develop, and maintain metadata-driven data pipelines using ADF and Databricks.
• Build and implement end-to-end metadata frameworks, ensuring scalability and reusability.
• Optimize data workflows leveraging SparkSQL and Pandas.

Job description

Job Description

• Duration of assignment : 4 Months
• Onsite Days : 5
• Work Location : UK Salford
• Hybrid : Hybrid,State : Manchester; City : Salford Zip : M50 2UE

Job description : Key Responsibilities

• Design, develop, and maintain metadata-driven data pipelines using ADF and Databricks.
• Build and implement end-to-end metadata frameworks, ensuring scalability and reusability.
• Optimize data workflows leveraging SparkSQL and Pandas for...

ZIPC1_UKTJ

• ...