Senior Data Engineer Senior Data Engineer

The Crown Estate; London; Hybrid; GBP 100,000 - 125,000; Full time

Job summary

A leading property management organization located in London is seeking a Senior Data Engineer to design and maintain Azure-based data platforms. This role involves building robust data pipelines, applying industry best practices, and supporting team members to ensure data integrity. Candidates should have a degree in a relevant field and experience with Azure technologies. The position promotes flexible working schedules and offers comprehensive family-friendly benefits.

Benefits

Flexible working policies

28 days holiday plus options to buy more

Private healthcare

Wellbeing support

Shopping discounts

Qualifications

• Education in a relevant field or equivalent experience.
• Experience with data pipelines for big data and relational databases.
• Hands-on experience with Azure tools.

Responsibilities

• Build and manage high-performance data pipelines.
• Apply industry standards for development and documentation.
• Ensure data pipelines are consistently available.

Skills

Data pipelines development

Azure technologies

Programming in PySpark, Python, SQL

CI/CD practices

API development

Problem solving

Stakeholder engagement

Education

Degree in Computer Science, Engineering, or Mathematics

Tools

Azure Data Factory

Azure SQL DB

Databricks

Job description

Overview

Senior Data Engineer role focused on designing, building and maintaining Azure-based data platforms to deliver end-to-end analytical solutions that are reliable, scalable, secure, and cost-effective. The role emphasizes automating data pipelines using Azure technologies and delivering high-quality data services that support strategic goals.

Responsibilities

• Design & Implement: Build and manage high-performance data pipelines for reporting, analytics, and data science.
• Champion Best Practices: Apply industry standards for development, testing, CI/CD, and documentation.
• Monitor & Maintain: Ensure data pipelines are consistently available and complete.
• Analyse & Improve: Identify performance insights and opportunities for optimisation.
• Collaborate & Mentor: Support and guide team members to ensure data usability and integrity.
• Engage Stakeholders: Understand and deliver on stakeholder requirements.
• Prioritise Security: Maintain robust information security practices.
• Stay Curious: Keep up with emerging cloud technologies and trends.
• Engage with the organization’s diversity, equity and inclusion efforts and support inclusive, customer-focused solutions.

Qualifications

• Education/Experience: Degree in a relevant field (e.g. Computer Science, Engineering, Mathematics) or equivalent practical experience.
• Technical Skills: Experience developing data pipelines for big data, relational databases, and data warehousing.
• Azure Expertise: Hands-on experience with Azure tools like Bicep, Data Factory, Functions/Durable, Synapse, Azure SQL DB, Event Hubs, and Databricks.
• Programming Knowledge: Proficiency in PySpark, Python, SQL, and streaming technologies.
• DevOps Familiarity: Experience with CI/CD and Azure DevOps.
• API Development: Ability to build scalable and efficient API data services.
• Problem Solving: Proactive approach to identifying and resolving issues.
• Bonus Skills: Experience with geospatial data, machine learning, or AI is a plus.
• Stakeholder Engagement: Strong relationship-building skills across all levels.

What You'll Bring

• A collaborative mindset and a passion for continuous learning.
• A proactive approach to problem-solving and process improvement.
• Clear communication skills, especially when explaining technical concepts.
• A commitment to inclusive and customer-focused solutions.
• The ability to influence and align teams around shared goals.

Benefits & Culture

• Flexible working and hybrid working policies.
• Market-leading family-friendly policies, including 28 days holiday with the option to buy more and additional volunteering days.
• Private healthcare; life and critical illness cover.
• Wellbeing and work-life balance support.
• Shopping discounts in the West End and other perks.

About The Crown Estate

Digital · The Crown Estate, 1 St James Market · Hybrid. We welcome applicants from all backgrounds and experiences. If you don’t meet every requirement but feel excited about the role, we encourage you to apply.

How to Apply

Are you passionate about data and cloud technologies? Join us as a Senior Data Engineer and help shape the future of The Crown Estate's Azure data platform. In this role, you\'ll contribute to building and evolving our cloud-based data infrastructure, supporting technical data engineering initiatives and delivering end-to-end analytical solutions that are reliable, scalable, secure, and cost-effective.