Senior Data Engineer (SC Cleared)

JR United Kingdom; Aberdeen City; On-site; GBP 50,000 - 80,000; Full time

Job summary

A leading company in technology consulting is seeking a Senior Data Engineer to oversee complex data engineering projects. The ideal candidate will have extensive experience with cloud-native data services, including Microsoft Azure and modern data engineering tools. This role requires strong collaboration skills, the ability to educate teams on best practices, and a proactive approach to problem-solving. Join us to lead innovative solutions and enhance data management capabilities.

Qualifications

• Strong communicator able to engage with clients and stakeholders.
• Direct experience with cloud-native data services, particularly Microsoft Azure.
• Experience with data security best practices and regulatory requirements.

Responsibilities

• Lead technical delivery of data engineering projects ensuring scalability and security.
• Design and implement high-quality data pipelines.
• Mentor and support data engineering teams and contribute to best practices.

Skills

Data Engineering

Cloud Services

Python

SQL

ETL/ELT Frameworks

DevOps Principles

Data Governance

Job description

Social network you want to login/join with:

col-narrow-left

Client:

CALIO Consulting Group (CCG)

Location:

Job Category:

Other

-

EU work permit required:

Yes

col-narrow-right

Job Views:

3

Posted:

10.06.2025

Expiry Date:

25.07.2025

col-wide

Job Description:

Key Responsibilities

• Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals.
• Design and build high-quality data pipelines and integration workflows, setting the technical direction and ensuring engineering best practices are followed throughout the development lifecycle.
• Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements.
• Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence.
• Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts to define test strategies, implement automated tests, and validate data quality and integrity.
• Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities.
• Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively.
• Champion engineering standards, contributing to the development and adoption of data engineering guidelines, design patterns, and delivery methodologies that contribute to our delivery framework.
• Stay current with emerging technologies, evaluating their relevance and potential impact, and promoting innovation within the firm and clients.
• Contribute to internal capability building, helping shape data engineering practices, tools, and frameworks that enhance delivery quality and efficiency.
• Strong communicator, able to clearly articulate technical concepts to both technical and non-technical stakeholders.
• Confident working independently or as part of a collaborative, cross-functional team.
• Skilled at building trust with clients and colleagues, with a consultative and solution-focused approach.
• Demonstrated leadership and mentoring capabilities, supporting the growth and development of engineering teams.
• Organised and adaptable, with excellent time management and the ability to respond to shifting priorities.
• Self-motivated, proactive, and committed to continuous learning and improvement.
• Creative problem-solver with the ability to think critically and deliver innovative, practical solutions.
• Team-oriented, with a positive attitude and a strong sense of ownership and accountability.

Technologies, Methodologies and Frameworks:

• Direct delivery experience using cloud-native data services, specifically in Microsoft Azure, Fabric, Dataverse, Synapse, Data Lake, Purview.
• Deep expertise in data engineering tools and practices, including Python, SQL, and modern ETL/ELT frameworks (e.g., Azure Data Factory, Talend, dbt).
• Experience designing and implementing scalable data pipelines and integration patterns across structured and unstructured data sources (e.g., Azure SQL, MySQL, MongoDB).
• Familiarity with data governance, metadata management, and data quality frameworks.
• Practical experience applying DevOps principles to data engineering, including CI/CD pipelines, infrastructure as code, and monitoring.
• Solid understanding of data security and compliance best practices, including secure data handling and regulatory requirements (e.g., Secure by design).
• Comfortable working in agile, multi-disciplinary teams, contributing across the full delivery lifecycle and supporting continuous improvement.
• Adaptable and quick to learn new tools, frameworks, and technologies to meet the needs of diverse client projects.