Senior Data Engineer

The Crown Estate; City Of London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading organization in property management is seeking a Senior Data Engineer to enhance their Azure cloud data platform. In this role, you will build scalable data pipelines, ensure data quality, and support technical initiatives. Ideal candidates should have expertise with Azure tools, strong problem-solving skills, and the ability to engage stakeholders effectively. This position offers a hybrid work model and generous benefits.

Benefits

Competitive salary

Pension

Performance related bonus

Flexible working

Private healthcare

28 days holiday with option to buy more

Qualifications

• Experience developing data pipelines for big data and data warehousing.
• Hands-on experience with Azure tools such as Bicep, Data Factory, and Azure SQL.
• Proficiency in PySpark, Python, and SQL.

Responsibilities

• Build and manage high-performance data pipelines.
• Apply industry standards for development and documentation.
• Ensure data pipelines are consistently available.

Skills

Data pipeline development

Data quality assurance

Problem-solving

Stakeholder engagement

Education

Degree in Computer Science, Engineering, or Mathematics

Tools

Azure Data Factory

Databricks

Bicep

Azure SQL DB

Job description

Overview

Advert Closes: Wednesday 1st October. Are you passionate about data and cloud technologies? Join us as a Senior Data Engineer and help shape the future of The Crown Estate's Azure data platform.

In this role, you'll contribute to building and evolving our cloud-based data infrastructure. You'll support technical data engineering initiatives and deliver end-to-end analytical solutions that are reliable, scalable, secure, and cost-effective. Your focus will be on automating data pipelines using Azure technologies such as Bicep, Durable Functions, Data Factory, Databricks, and Synapse.

We're looking for someone who enjoys making sense of data, ensuring its quality and delivering impactful data services that support our strategic goals.

Key Responsibilities

• Design & Implement: Build and manage high-performance data pipelines for reporting, analytics, and data science.
• Champion Best Practices: Apply industry standards for development, testing, CI/CD, and documentation
• Monitor & Maintain: Ensure data pipelines are consistently available and complete.
• Analyse & Improve: Identify performance insights and opportunities for optimisation.
• Collaborate & Mentor: Support and guide team members to ensure data usability and integrity.
• Engage Stakeholders: Understand and deliver on stakeholder requirements.
• Prioritise Security: Maintain robust information security practices.
• Stay Curious: Keep up with emerging cloud technologies and trends.

What We're Looking For

We welcome applicants from all backgrounds and experiences. If you don't meet every requirement but feel excited about the role, we encourage you to apply.

• Education/Experience: Degree in a relevant field (e.g. Computer Science, Engineering, Mathematics) or equivalent practical experience.
• Technical Skills: Experience developing data pipelines for big data, relational databases, and data warehousing.
• Azure Expertise: Hands-on experience with Azure tools like Bicep, Data Factory, Functions/Durable, Synapse, Azure SQL DB, Event Hubs, and Databricks.
  Programming Knowledge: Proficiency in PySpark, Python, SQL, and streaming technologies.
• DevOps Familiarity: Experience with CI/CD and Azure DevOps.
• API Development: Ability to build scalable and efficient API data services.
• Problem Solving: Proactive approach to identifying and resolving issues.
• Bonus Skills: Experience with geospatial data, machine learning, or AI is a plus.
• Stakeholder Engagement: Strong relationship-building skills across all levels.

What You'll Bring

• A collaborative mindset and a passion for continuous learning.
• A proactive approach to problem-solving and process improvement.
• Clear communication skills, especially when explaining technical concepts.
• A commitment to inclusive and customer-focused solutions.
• The ability to influence and align teams around shared goals.

Join Us

Join us and be part of a diverse, forward-thinking team that's driving innovation in data engineering. We value different perspectives and are committed to creating an inclusive workplace where everyone can thrive.

Apply now and make a meaningful impact with your skills and ideas.

Our Offering / Benefits

As well as a competitive salary, pension and performance related bonus offering, we have a wealth of benefits available ranging from flexible working; market leading family policies and shopping discounts in the West End, to private healthcare; life and critical illness cover and 28 days holiday with the option to buy more. We value work life balance and your wellbeing highly, enabling you to be your best self to work.

Disability Disclosure

We are a proud disability confident employer and operate the offer of interview scheme Disability Confident employer scheme - GOV.UK (www.gov.uk).

We are happy to offer alternative application methods or formats and can be flexible on our process to enable you to have the best opportunity.

If you have any questions about our recruitment process or would like to talk about adjustments, please contact us on [e-mail]

Department Digital Locations The Crown Estate, 1 St James Market Remote status Hybrid Employment type Full-time