Senior Data Engineer

Made Tech Limited; Wales; Hybrid; GBP 55,000 - 75,000; Full time

Job summary

A technology consultancy in the UK is seeking a Senior Data Engineer to enhance public sector organizations with data-driven solutions. You will develop and maintain data platforms while mentoring clients. Knowledge in Infrastructure as Code, DevOps practices, and modern data system architectures is essential. This role offers flexible working arrangements, 30 days holiday, and paid counselling services.

Benefits

30 days Holiday

Remote Working

Paid counselling

Qualifications

• Proven ability to deliver outcomes for users.
• Experience in implementing SOLID, DRY, and TDD principles.
• Ability to document and present end-to-end data processing diagrams.

Responsibilities

• Develop, operate, and maintain data platforms and services.
• Assume multiple roles based on clients' needs.
• Support project delivery as a senior contributor.

Skills

Enthusiasm for learning

Proficiency in Git

Experience gathering requirements

Experience in Infrastructure as Code

Managing cloud infrastructure

Handling and transforming data types

Understanding modern data system architectures

Creating data pipelines

Implementing robust DevOps practices

Agile methodologies

Mentoring and team support

Commercial mindset

Tools

Apache Spark

Databricks

Hadoop

Docker

Job description

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders.

Key Responsibilities

As a Senior Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account.

You'll need a drive to deliver outcomes for users, considering the broader context of delivery and maintaining alignment between operational and analytical aspects of the engineering solution.

Skills, Knowledge and Expertise

We seek candidates with a range of skills and experience; please apply even if you don't meet all criteria.

• Enthusiasm for learning and self-development
• Proficiency in Git (including Github Actions) and understanding of branch strategies
• Experience gathering and meeting requirements from clients and users on data projects
• Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments
• Managing cloud infrastructure with a DevOps approach
• Handling and transforming various data types (JSON, CSV, etc.) using Apache Spark, Databricks, or Hadoop
• Understanding modern data system architectures (Data Warehouse, Data Lakes, Data Meshes) and their use cases
• Creating data pipelines on cloud platforms with error handling and reusable libraries
• Documenting and presenting end-to-end data processing system diagrams (C4, UML, etc.)
• Implementing robust DevOps practices in data projects, including DataOps tools for orchestration, data integration, and analytics
• Enhancing resilience through vulnerability checks and testing strategies (unit, integration, data quality)
• Applying SOLID, DRY, and TDD principles practically
• Agile methodologies such as Scrum, XP, and Kanban
• Designing and implementing efficient batch and streaming data transformations at scale
• Mentoring, team support, and line management skills
• Commercial mindset to grow accounts organically with senior stakeholders

Experience in the following areas is desirable but not essential:

• Working in a technology consultancy
• Using Docker and virtual environments in CI/CD
• Engaging with senior stakeholders for requirements gathering
• Collaborating with engineers via pair or mob programming
• Working with data scientists to productionize machine learning models
• Knowledge of statistics
• Collaborating across multidisciplinary teams
• Experience within the public sector

Support in Applying

If you need this job description in another format or require support in applying, please email.

We believe technology can improve public services and that diversity within our team enhances this mission. We encourage applicants from underrepresented groups to apply.

We are committed to accessibility and inclusion, offering adjustments for interview processes and welcoming feedback on our candidate experience.

We foster community through Slack channels and communities of practice, covering interests like music, food, pets, and professional development. If you'd like to connect with these groups, please contact a Made Tech talent team member.

Our benefits include flexible schemes like Smart Tech, Cycle to Work, and personalized benefit allowances. We promote connection through social and wellbeing events.

Our popular benefits:

• 30 days Holiday - paid leave plus bank holidays
• Remote Working - part-time remote options
• Paid counselling - mental health, legal, and financial advice

Candidates must be eligible for SC security clearance, requiring 5 years of UK residency. If eligibility is not confirmed during the process, we cannot proceed with your application.

Interested? Join us in using technology to improve society. Our transparent and supportive hiring process guides candidates at each stage, with feedback provided throughout. Shortlisted candidates will be invited for screening. Register your interest to stay updated on relevant roles.