Senior Data Engineer

Mirai Talent; Manchester; On-site; GBP 50,000 - 75,000; Full time

Job summary

A growing analytics consultancy in Manchester seeks a Senior Data Engineer to design and implement data architectures while mentoring junior engineers. This role offers excellent career progression, competitive salary, and the chance to impact client success in a collaborative environment. With responsibilities that include developing efficient data solutions and managing CI/CD pipelines, the successful candidate will play a crucial part in delivering data-driven solutions.

Benefits

Career progression opportunities

Continuous training and professional development

Personalised development plans

Hybrid work pattern

Potential for equity participation

Qualifications

• Minimum 3 years’ experience as a Data Engineer, DevOps Engineer, or Systems Engineer.
• Experience with Microsoft Azure and CI/CD methodologies.
• Strong Python skills in data processing and automation.

Responsibilities

• Design and implement scalable and secure data architectures.
• Manage client data onboarding and ensure compliance.
• Develop performant data retrieval solutions using APIs and web scrapers.

Skills

Python

Data Engineering

CI/CD

SQL

NoSQL

Automation

Education

Degree in Computer Science, Mathematics or related discipline

Tools

Microsoft Azure

Terraform

Docker

Kubernetes

Job description

Social network you want to login/join with:

• Excellent progression and career prospects!

Mirai is working with a growing analytics consultancy based in Manchester, seeking talented individuals to deliver data-driven solutions to complex business challenges. This consultancy prioritises collaboration and individual growth within its engineering teams. If you’re seeking an environment where your contributions are valued and you can directly impact clients’ success, this could be the opportunity for you.

The Opportunity:

This consultancy is seeking a Senior Data Engineer to join its cross-functional feature development team. The successful candidate will play a key role in designing and implementing scalable and secure data architectures, contributing to all aspects of the data engineering lifecycle. This position requires demonstrable technical skills, a collaborative approach, and a commitment to continuous improvement.

Responsibilities:

• Collaborate with the team to define and deliver data features aligned with business objectives.
• Develop performant data retrieval solutions (APIs, web scrapers, SFTP), ensuring security and efficiency.
• Manage client data onboarding, ensuring compliance with relevant security standards and policies.
• Provide technical guidance and mentorship to junior engineers, promoting code quality and best practices.
• Implement and maintain Infrastructure as Code (Terraform) to manage secure FTP configurations and remediate vulnerabilities.
• Develop efficient code and maintain reusable libraries using Python.
• Design and implement ELT workflows utilising both SQL and NoSQL databases.
• Contribute to the ongoing development and maintenance of CI/CD pipelines.

Requirements:

• A minimum of 3 years’ experience as a Data Engineer, DevOps Engineer, or Systems Engineer.
• Strong Python programming skills with experience in data processing, automation, and integration.
• Experience with the Microsoft Azure platform, including key services for data engineering and analytics (e.g., Data Factory, Data Lake, Functions).
• Practical experience with CI/CD methodologies and associated tools.
• Experience in configuring and managing FTP (SFTP/FTPS) environments.
• Solid understanding of both SQL and NoSQL databases and their application within ELT workflows.
• A degree in Computer Science, Mathematics, or a related discipline.

Desired Skills:

• Experience working within Agile development teams.
• Familiarity with the payments industry.
• Experience with Azure Databricks.
• Experience with containerisation technologies such as Docker and Kubernetes.
• Experience using IaC tools like Terraform and Bicep.
• Proficiency in scripting languages such as Scala, PowerShell, or YAML.
• Competitive salary and performance-related bonuses.
• Career progression opportunities within a rapidly expanding company.
• Potential for equity participation.
• Continuous training and professional development opportunities.
• Personalised development plans to support your career aspirations.
• Hybrid work pattern: 2 days per week based in their Manchester city centre office.

Mirai believes in the power of diversity and the importance of an inclusive culture. It welcomes applications from individuals of all backgrounds, understanding that a range of perspectives strengthens both its team and the teams of its partners. This is just one of the ways that they’re taking positive action to shape a collaborative and diverse future in the workplace.