Job Overview
Job level: 10. Lead Data Engineer to join our Data Engineering and Analytics practice in Manchester (Remote / once a month). Salary: £85,000 - £95,000 per annum.
Responsibilities
- Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing opportunities to reuse data flows where possible.
- Coordinate teams and set best practices and standards when it comes to data engineering principles.
- Champion data engineering across projects and clients.
- Lead by example, holding responsibilities for team culture and ensuring projects deliver the most impact and value to our clients.
- Be accountable for the strategic direction, delivery and growth of our work.
- Lead teams, strands of work and outcomes, owning commercial responsibilities.
- Hold and manage uncertainty and ambiguity on behalf of clients and our teams.
- Ensure teams and projects are inclusive through your leadership and management style.
- Effectively own and narrate the story of our work, measuring progress against client goals and DT missions.
- Work with teams to influence and own how we deliver more value to clients within time and budget constraints.
- Strategically plan overall projects and apply methods and approaches.
- Demonstrably share work with wider audiences and elevate ideas through clear communication.
Professional Knowledge and Experience
- Proven experience in data engineering, data integration and data modelling.
- Expertise with cloud platforms (AWS, Azure, GCP) and modern cloud data platforms (Microsoft Fabric, Databricks).
- Expertise with multiple data analytics tools (e.g. Power BI).
- Deep understanding of data warehousing concepts, ETL/ELT pipelines and dimensional modelling.
- Proficiency in advanced programming languages (Python/PySpark, SQL).
- Experience in data pipeline orchestration (Airflow, Data Factory).
- Familiarity with DevOps and CI/CD practices (Git, Azure DevOps).
- Ability to communicate technical concepts to both technical and non‑technical audiences.
- Proven experience delivering complex projects in a fast‑paced environment with tight deadlines.
- Advanced knowledge of data governance, data standards and best practices (desirable).
- Experience in a consultancy environment, demonstrating flexibility and adaptability to client needs.
- Experience defining and enforcing data engineering standards, patterns and reusable frameworks.
- Professional certifications in relevant technologies (e.g. Microsoft Azure Data Engineer, AWS Data Analytics, Databricks Certified Professional Data Engineer).
Technical and Leadership Skills
- Design, build and test data products that are complex or large scale.
- Build and lead teams to complete data integration services and reusable pipelines that meet performance, quality and scalability standards.
- Collaborate with architects to align solutions with enterprise data strategy and target architectures.
- Work with data analysts, engineers, data science and AI specialists to design and deliver products effectively.
- Understand the reasons for cleansing and preparing data before inclusion in products and implement reusable processes and checks.
- Access and use a range of architectures (cloud and on‑premise) and data manipulation and transformation tools deployed within the organisation.
- Optimize data pipelines and queries for performance and cost efficiency in distributed environments.
- Review requirements and define system integration testing conditions for complex data products.
- Identify and manage issues and risks associated with complex data products.
- Analyse and report system test activities and results.
- Develop and maintain complex data models (conceptual, logical, physical).
- Strong skills in data governance and metadata management.
- Write efficient, maintainable code for large‑scale data systems.
- Experience with CI/CD pipelines, version control and infrastructure‑as‑code.
- Strong stakeholder communication skills, translating technical concepts into business terms.
- Mentor junior engineers, fostering collaboration and building a high‑performing data engineering culture.
About Us
We are a purpose‑driven organisation, supporting organisations to build a better future for people, places and the planet. Combining vast experience in the public, private and third sectors with expertise in human‑centred design, data, experience and technology, we create sustainable solutions for an ever‑evolving world.
Benefits
- 30 days holiday + bank holidays
- 2 volunteer days for causes you are passionate about
- Maternity/paternity leave: 6 months maternity + 3 months paternity
- Life assurance
- Employer pension contribution of 5%
- Health cash plan
- Personal learning and development budget
- Employee Assistance Programme
- Access to equity in the business through a Share Incentive Plan
- Green incentive programmes including Electric Vehicle Leasing and the Cycle to Work Scheme
- Financial advice and health assessments