Senior Data Engineer and Platform Lead

Morgan Advanced Materials; United Kingdom; Hybrid; GBP 50,000 - 90,000; Full time

Job description

Overview

Role: Senior Data Engineer and Platform Lead

Location: Hybrid / Remote

Position: Staff

Morgan Advanced Materials is a world leader in the development and production of advanced materials. We produce a wide range of specialist, high specification materials that have extraordinary attributes and properties. Despite the complexity of our technologies, our focus is simple – we supply innovative, differentiated products made from advanced materials that enable our customers’ products to perform more efficiently, more reliably and for longer.

Morgan is making a significant investment in establishing a world-class global data team, and we are excited to welcome new employees who will play a crucial role in this initiative. As part of this team, you will be instrumental in building the future data platform that will drive the success of our enterprise. Your contributions will not only shape the foundation of our data capabilities but also help position Morgan as a leader in leveraging data to achieve strategic business goals. This is a unique opportunity to be a part of a transformative journey, where your efforts will directly impact the future growth and innovation of the company.

Responsibilities

Role Description:

• Take ownership of the Azure-hosted analytical platform, ensuring it meets current and future business requirements.
• Optimize the platform for performance, security, and scalability, ensuring alignment with best practices.
• Design and develop scalable ETL pipelines and data solutions using Azure Data Factory, Synapse Analytics, and related tools.
• Work closely with stakeholders to understand business needs and translate them into actionable data solutions.
• Lead and mentor the Data & Analytics team, ensuring the smooth operation of data pipelines and alignment with organizational objectives.

Team Leadership and Coordination:

• Provide technical guidance and mentorship to the Data & Analytics team.
• Oversee the team’s Agile processes including sprints, task prioritization and issue resolution.
• Define best practices for data pipeline design, development, and maintenance.
• Coordinate with the solution architect to ensure platform architecture meets current and future requirements.
• Act as a point of escalation for complex data engineering challenges.

Data Engineering:

• Design, build, and maintain data pipelines for seamless integration of ERP and other critical data sources into Azure Synapse.
• Ensure data workflows are optimized for performance, scalability, and reliability.
• Lead efforts to standardize ETL/ELT processes and enforce data quality standards across the platform.
• Implement data transformation logic to create clean, usable datasets for reporting and analytics.

Platform Administration and Optimization:

• Monitor and optimize Azure Synapse Analytics performance, ensuring cost efficiency and resource utilization.
• Implement monitoring and alerting for pipeline performance, failures, and resource consumption.
• Suggest and implement automation for repetitive tasks using tools like Azure Logic Apps, Power Automate, or custom scripting.
• Collaborate with the Data Governance Lead to ensure compliance with governance and security standards.

Business and Stakeholder Collaboration:

• Work closely with business units to understand data requirements and ensure outputs align with business needs.
• Validate that datasets and reports delivered by Power BI developers meet performance and usability standards.
• Support data-driven decision-making by ensuring high-quality and accessible data across the organization.

Innovation and Strategy:

• Stay updated on advancements in Azure, Synapse, data engineering tools and other relevant technologies to recommend and implement improvements.
• Identify opportunities to leverage advanced data processing techniques (e.g., big data, real-time processing) and AI.
• Contribute to the long-term strategy for the GDP, including scaling the platform for future needs.

Qualifications

EXPERIENCE & BACKGROUND

Qualifications/Experience

• Bachelor or Master degree in a related field of study.
• 5+ years of experience in data engineering, with a strong focus on Azure cloud services across a mixture of Enterprise and SME environments.
• Proficiency in Python, SQL, Azure Data Factory, Azure Synapse Analytics, Azure Data Lakes, and big data technologies like Apache Spark.
• Experience with DevOps practices and CI/CD pipelines in an Azure environment is a plus.
• Certification in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate) is highly desirable.
• Excellent problem-solving abilities, strong communication skills, ability to work collaboratively in a team environment, and a keen attention to detail.
• Fully up to speed with Agile development methodologies e.g., DevOps, Scrum (EPICs, Stories, Task, Issues, Bugs).
• Excellent analytical and problem-solving skills and the ability to troubleshoot complex issues.
• Excellent stakeholder management, communication and interpersonal skills.
• Ability to thrive in a fast-paced and collaborative environment.
• Detail-oriented and well-organized.

Morgan Advanced Materials is an EEO/AA/M/W/D/V Employer Ind-1