Senior Data Engineer

ZipRecruiter; Glasgow; Hybrid; GBP 80,000 - 100,000; Full time

Job summary

A large global consultancy is seeking a Senior Data Engineer in Glasgow to develop and maintain innovative technology solutions. The position requires 8+ years of data engineering experience, strong skills in Python and Databricks, and offers a contract lasting 6 months with a competitive daily rate. You will work in a collaborative environment, contributing to applications that support thousands of developers worldwide.

Qualifications

• 8+ years experience in data engineering or related roles.
• Strong expertise in Python and Databricks.
• Experience with developing and maintaining ESM applications.

Responsibilities

• Design, develop, and maintain ESM applications across data management, automation, orchestration, and service management.
• Build and support self-service portals, incident/change management, and capacity management tools.
• Collaborate with cross-functional teams to design scalable and reliable ETL processes.

Skills

Data engineering

Python

Databricks

Job description

Job Description

Senior Data Engineer ESM

Contract: 6 months
Rate: £500 - £550 per day (inside IR35)
Location: Glasgow (3 days onsite per week)
Start date: ASAP

Our client, a large global consultancy, is seeking a Senior Data Engineer to join an Enterprise Systems Management (ESM) team on a contract basis. ESM plays a critical role in developing and maintaining applications across the business, enabling the delivery of innovative technology solutions for a global banking environment.

You will join a diverse and collaborative chapter of 70+ developers, working closely with over 15 agile squads and contributing to technology solutions that support more than 10,000 developers and production engineers worldwide.

Key Responsibilities:

1. Design, develop, and maintain ESM applications across data management, automation, orchestration, and service management.
2. Build and support self-service portals, incident/change management, and capacity management tools.
3. Develop event management solutions, including monitoring, log-collection, correlation, and analytics dashboards.
4. Implement application performance monitoring across large-scale distributed systems.
5. Collaborate with cross-functional teams to design scalable and reliable ETL processes using Python and Databricks.
6. Develop and deploy ETL jobs, extracting and transforming data from multiple sources.
7. Take ownership of the full engineering lifecycle: data extraction, cleansing, transformation, and loading.
8. Create and manage data pipelines with robust error handling and data consistency.

Your Profile:

Essential Skills & Experience:

• 8+ years experience in data engineering or related roles.
• Strong expertise in Python and Databricks.
• Experience with developing and maintaining ESM applications.

Desirable Skills:

• Proven experience managing end-to-end data engineering lifecycles.
• Strong background in data pipelines, error handling, and ensuring accuracy and consistency.

If you have the required skills and experience, please submit your application promptly, ensuring the skills are highlighted on your CV. Please note that due to the volume of applications, feedback on individual applications may not be provided.