- Location: Central London - Hybrid (3 days on-site, 2 days remote)
- Contract Length: 6 Months (with potential extension)
- Rate: Inside IR35
About the role
A global consulting practice is seeking an experienced, high-calibre Senior Data Engineer to join a flagship enterprise transformation programme.
In this role, you will act as a subject matter expert and technical anchor, designing and delivering robust, scalable data foundations and end-to-end data solutions. Operating at the intersection of technical architecture and commercial value, you will translate strategic data visions into production-ready platforms while fostering data-driven thinking across multidisciplinary teams and business stakeholders.
Key Responsibilities
- Solution Architecture & Delivery: Design, build, and optimize scalable, end-to-end data pipelines and modern lakehouse architectures to support critical business initiatives.
- Technical Leadership & Mentorship: Serve as an SME across core data disciplines, providing hands-on leadership, establishing engineering standards, and mentoring junior engineers.
- Stakeholder Engagement: Translate complex data strategy into tangible IT deliverables, communicating effectively with both deep-technical squads and executive business leads.
- Governance & Reliability: Coordinate change management, problem resolution, and incident response across critical pipelines, driving continuous improvement through CI/CD, rigorous testing, and code quality controls.
- Community & Practice: Champion best practices across internal Centers of Excellence (CoE) and Communities of Practice (CoP).
Key Skills & Experience
- Cloud Platforms: Advanced, production-level expertise across major cloud ecosystems (Azure, AWS, or enterprise enterprise data environments like SAP).
- Data Engineering Core: Mastery in modern ELT patterns, complex data modelling (dimensional, semantic, or lakehouse frameworks), and large-scale data ingestion and transformation.
- Pipeline & Analytics Tooling: Hands-on experience with modern data stacks such as Databricks, Azure Data Factory / Synapse, AWS Glue / Redshift, or Airflow / Stream Analytics.
- Engineering Best Practices: Proven track record applying software craftsmanship principles to data pipelines, including automated CI/CD (GitHub Actions, Azure DevOps), unit testing (PyTest), and automated code analysis (SonarQube).
- Consulting Mindset: Excellent communication, cross-functional collaboration, and the ability to navigate complex, fast-paced enterprise environments.
- Exposure to large-scale, complex trading, commodities, energy, supply chain, or planning/finance data domains.
- Experience leading or acting as a technical lead/Scrum Master within Agile delivery squads.
- Hands-on knowledge of modern technical documentation tooling (e.g., MkDocs).