Hybrid Data Engineer - PySpark, SQL & Cloud Solutions

First Central; Manchester; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

1st Central is seeking a Data Engineer to design and build scalable data pipelines and governance across data lake, warehouse and BI environments. You’ll work on projects and long-term products, with ownership of data solutions and observability.

Strong PySpark, Python and SQL experience is required, along with Azure Data Factory/Synapse and CI/CD mindset. Flexible hybrid work across multiple sites, with a focus on delivering high-quality data solutions."

Qualifications

• Experience designing and building end-to-end data solutions (2-5 years).
• Engineering and database skills in SQL Server and/or Azure Data Factory/Synapse.
• Experience with large, event-based datasets in an enterprise environment.
• Experience with testing techniques and tools.

Responsibilities

• Develop low to high complexity, secure, governed data pipelines from varied data sources.
• Ensure data is cleansed, mapped, transformed and optimised for storage for business and technical use cases.
• Build data observability and data quality into pipelines with self-testing where possible.
• Create data lake, data warehouse, and BI reporting structures.
• Design physical data models to meet business needs and optimise storage.

Skills

Cloud & Data Engineering

Problem-Solving

Organisation & Delivery

Collaboration & Teamwork

Mentoring & Coaching

Tools

PySpark

Python

SQL Server

Azure Data Factory

Azure Synapse

Job description

1st Central is seeking a Data Engineer to design and build scalable data pipelines and governance across data lake, warehouse and BI environments. You’ll work on projects and long-term products, with ownership of data solutions and observability.

Strong PySpark, Python and SQL experience is required, along with Azure Data Factory/Synapse and CI/CD mindset. Flexible hybrid work across multiple sites, with a focus on delivering high-quality data solutions."