Data Engineer Manager

Young's; City of Westminster; Hybrid; GBP 85,000 - 95,000; Full time

Job summary

A well-established global E-commerce business is looking for a Data Engineer Manager to lead a team and manage their data platform development. This hybrid role offers the opportunity to play a pivotal role in shaping data strategies and troubleshooting technical issues. The ideal candidate has experience in modern data infrastructure and team leadership. Salary is competitive, in the range of £85,000 - £95,000 plus bonuses.

Benefits

Career development opportunities

Flexible work from home

Qualifications

• Experience leading data or platform teams in a production environment as a Senior Data Engineer or similar.
• Hands-on knowledge of modern data infrastructure and tools.
• Excellent communication and stakeholder management skills.

Responsibilities

• Define and own the roadmap for the Data Platform development.
• Implement scalable data pipelines and ETL/ELT processes.
• Lead a team of Data Engineers while overseeing platform optimization.

Skills

Azure Data Factory

Databricks

Python

Apache Spark

Stakeholder management

Problem-solving skills

Tools

MS Fabric

Kafka

DBT

Azure Synapse

Job description

• Define and take ownership of the roadmap for the ongoing development and enhancement of the Data Platform.
• Design, implement, and oversee scalable data pipelines and ETL/ELT processes within MS Fabric, leveraging expertise in Azure Data Factory, Databricks, and other Azure services.
• Advocate for engineering best practices and ensure long-term sustainability of systems.
• Integrate principles of data quality, observability, and governance throughout all processes.
• Participate in recruiting, mentoring, and developing a high-performing data organization.
• Demonstrate pragmatic leadership by aligning multiple product workstreams to achieve a unified, robust, and trustworthy data platform that supports production services such as dashboards, new product launches, analytics, and data science initiatives.
• Develop and maintain comprehensive data models, data lakes, and data warehouses (eg, utilizing Azure Synapse).
• Collaborate with data analysts, Analytics Engineers, and various stakeholders to fulfil business requirements.
  
  This newly created Data Engineer Managers position is an excellent opportunity for a hands on Senior Data Engineer/Technical Lead/Engineering Team Lead etc looking to move into a Management position. The postholder will lead and mentor a team of 3 Data Engineers whilst overseeing data platform development and optimisation. Our client is a well-established and rapidly growing global E-commerce business with its headquarters based in London. They've been expanding at pace and have ambitious plans to take the business even further. The Data Engineer Manager will play a pivotal role at the heart our clients data & analytics operation. Having implemented a new MS Fabric based Data platform, the need is now to scale up to meet the demand to deliver data driven insights and strategies right across the business globally. The role will require someone thats happy to be hands on as you'll be troubleshooting, doing code reviews, steering the team through deployments and an escalation point for
technical issues etc. Previous experience with MS Fabric would be highly beneficial but is not essential.,
• Experience leading data or platform teams in a production environment as a Senior Data Engineer, Tech Lead, Data Engineering Manager etc.
• Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines
• Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar
• Experience building, defining, and owning data models, data lakes, and data warehouses
• Programming proficiency in Python, Pyspark, Scala or Java.
• Experience operating in a cloud-native environment (eg Fabric, AWS, GCP, or Azure).
• Excellent stakeholder management and communication skills.
• A strategic mindset, with a practical approach to delivery and prioritisation.
• Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines.
• Experience building, defining, and owning data models, data lakes, and data warehouses.
• Exposure to data science concepts and techniques is highly desirable.
• Strong problem-solving skills and attention to detail.
  
  This is a hybrid role based in Central/West London with the flexibility to work from home 2 or 3 days per week. Our client can offer an excellent career development opportunity whilst working in a modern and vibrant environment. Salary will be dependent on experience and in the region of £85,000 - £95,000 + an attractive bonus scheme.