Senior Data Engineer

TN United Kingdom; City of Edinburgh; On-site; GBP 45,000 - 55,000; Full time

Job summary

An established industry player is seeking a Senior Data Engineer to enhance their analytics capabilities. This role offers the chance to design and optimize cloud-based solutions, particularly using Databricks, while collaborating with cross-functional teams. The ideal candidate will have a strong background in data engineering, cloud technologies, and programming languages like Python and SQL. Join a forward-thinking organization committed to innovation and making a real difference in customer experience. With a focus on flexibility and inclusivity, this opportunity promises a rewarding career path in a supportive environment.

Benefits

Private Medical Cover

38 Days Annual Leave

Excellent Pension

16% Bonus

Career Breaks

Income Protection

Volunteering Days

Qualifications

• Proven experience in data engineering with cloud technologies and Databricks.
• Strong programming skills in Python, SQL, or Scala.

Responsibilities

• Design and optimize analytics infrastructure on cloud platforms.
• Develop and maintain Databricks notebooks for data exploration.
• Collaborate with teams to integrate diverse data sources.

Skills

Cloud Technologies

Data Engineering

Databricks

Python

SQL

Problem-solving

Analytical Skills

Collaboration

Education

Experience in Data Engineering

Proficiency in Cloud Platforms

Tools

Azure

Databricks Notebooks

Job description

We have an incredible opportunity to join us here at Phoenix as a Senior Data Engineer in our Engineering & Delivery function with Group IT.

Job Type: Permanent

Location: This role could be based in either our Wythall, Telford or Edinburgh offices with time spent working in the office and at home.

Flexible working: All of our roles are open to part-time, job-share and other types of flexibility. We will discuss what is important to you and balancing this with business requirements during the recruitment process.

Closing Date: 26/03/2025

Salary and benefits: £45,000 - £55,000 plus 16% bonus up to 32%, private medical cover, 38 days annual leave, excellent pension, 12x salary life assurance, career breaks, income protection, 3x volunteering days and much more.

Who are we?

We want to be the best place that any of our 6,600 colleagues have ever worked. We’re the UK’s largest long-term savings and retirement business. We offer a range of products across our market-leading brands, Standard Life, SunLife, Phoenix Life and ReAssure. Around 1 in 5 people in the UK has a pension with us. We’re a FTSE 100 organisation that is tackling key issues such as transitioning our portfolio to net zero by 2050, and we’re not done yet.

The Role

We are seeking a Senior Data Engineer to join our Engineering & Delivery function within Group IT. This role offers candidates with a strong background in data & analytics engineering the opportunity to inform operational decisions and influence change that can really make a difference to our customer experience.

As a Senior Data Engineer, you will be responsible for designing, implementing, and optimizing our analytics solutions on cloud platforms, with a strong emphasis on Databricks. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure the seamless integration of data and analytics capabilities into our business processes.

Key Responsibilities:

1. Design, implement, and optimize analytics infrastructure on cloud platforms such as Azure.
2. Utilize best practices for data storage, processing, and retrieval in cloud environments. Implement and manage data pipelines for efficient data processing and analysis.
3. Serve as the subject matter expert on Databricks, ensuring effective utilization of the platform for analytics and data science activities.
4. Develop and maintain Databricks notebooks for data exploration, feature engineering, and model development.
5. Optimize Databricks workflows for performance and scalability.
6. Collaborate with data engineering teams to integrate diverse data sources into the analytics environment.
7. Implement and maintain data connectors and ETL processes for seamless data flow.
8. Identify and address performance bottlenecks in analytics processes and queries.
9. Implement optimizations for large-scale data processing and analysis.
10. Implement security best practices to safeguard sensitive data.
11. Ensure compliance with data governance and regulatory requirements.
12. Work closely with data scientists, analysts, and other stakeholders to understand analytics requirements.
13. Create comprehensive documentation for analytics infrastructure and processes.

Qualifications:

1. Proven experience as a Data Engineer, with a focus on cloud technologies and Databricks.
2. Strong proficiency in cloud platforms (AWS, Azure, or Google Cloud) and related analytics services.
3. Expertise in building and optimizing data pipelines and workflows.
4. In-depth knowledge of Databricks, including notebook development and optimization.
5. Solid programming skills in languages such as Python, Scala, or SQL.
6. Experience with data modeling, warehousing, and analytics technologies.
7. Strong problem-solving and analytical skills.
8. Excellent communication and collaboration skills.

We want to hire the whole version of you.

We are committed to ensuring that everyone feels accepted and welcome applicants from all backgrounds. If your experience looks different from what we’ve advertised and you believe that you can bring value to the role, we’d love to hear from you.

If you require any adjustments to the recruitment process, please let us know so we can help you to be at your best.

Please note that we reserve the right to remove adverts earlier than the advertised closing date. We encourage you to apply at the earliest opportunity.