Intermediate Data Engineer

CDL Software; Manchester; Hybrid; GBP 40,000 - 45,000; Full time

Benefits offered by this job

Hybrid Working

25 days holiday

Training & development

Pension scheme

Health & Wellbeing

EV scheme

Job summary

CDL Software in Manchester is seeking an Intermediate Data Engineer to join our Insurance Retail department, supporting development squads with reliable, automated and cloud-ready data solutions. You will work with AWS, PostgreSQL and modern DevOps practices to build, maintain and improve data pipelines, data services and infrastructure.

You will use AI-assisted engineering tools responsibly to accelerate development, enhance documentation and automate repeatable tasks.

Qualifications

• Experience with AWS data services (RDS, S3) and PostgreSQL.
• Strong SQL skills with PostgreSQL optimization.
• Knowledge of CI/CD pipelines and Terraform/OpenTofu.
• Familiarity with security and data governance.
• Ability to communicate with stakeholders.

Responsibilities

• Build, test, monitor and maintain data pipelines and infrastructure.
• Apply security best practices across data pipelines and cloud infra.
• Design and support data solutions using AWS and PostgreSQL.
• Embrace AI-assisted engineering practices to improve delivery.
• Develop automated deployment, testing and workflows with GitLab, Terraform/OpenTofu.
• Contribute to data quality, governance and observability.
• Investigate issues and propose improvements.
• Collaborate with stakeholders to understand requirements.
• Contribute to database and platform upgrades.
• Document processes and mentor others.
• Deliver small to medium features with teams.

Skills

SQL

AWS data engineering

CI/CD

AI-assisted engineering

Observability tools

Tools

GitLab

Terraform/OpenTofu

OpenSearch

Dynatrace

CloudWatch

GitHub Copilot

Job description

Description

We’re seeking an Intermediate Data Engineer to join our Insurance Retail department, supporting development squads with reliable, automated and cloud‑ready data solutions. This role is suited to someone who can combine strong SQL, scripting and AWS experience with modern DevOps practices to build, maintain and improve data pipelines, data services and supporting infrastructure.

AI is a key part of the role. You will be expected to use AI‑assisted engineering tools responsibly to accelerate development, improve documentation, support analysis and identify opportunities to automate repeatable data engineering and operational tasks. Working closely with engineers, analysts, architects and stakeholders, you will help turn data requirements into maintainable, observable and secure solutions.

You will maintain awareness of industry and technology developments, contribute to technical discussions, and support continuous improvement across data engineering, automation and operational practices. The role includes ownership of work throughout its lifecycle, from development and testing through to production support, incident resolution, continuous improvement and knowledge sharing across the department.

Department

Department: Insurance Retail

Location

Location: North West UK - Hybrid

Compensation

Compensation: £40,000 - £45,000 / year

About CDL

CDL is one of the UK’s leading software development houses, employing over 600 people at its campus in Stockport. It has a consistent history in the high‑volume retail insurance sector. CDL has spearheaded developments in the aggregator, web and telematics space, including connected home, enrichment and self‑service solutions. As a result, the company’s robust and innovative technologies have enabled its customers to thrive in the highly competitive UK insurance marketplace.

We have built a collaborative and creative culture, leveraging AI‑driven solutions to enhance our products, processes and decision‑making. We pride ourselves on cultivating an inspiring working environment with our employees at the heart of our company.

In a nutshell we are the market leading software house in our industry, creating the software, websites & apps for the Insurance & Finance sector across the UK. If you were to go on a price comparison website, approximately 65% of the companies on there are our clients!

What You’ll Do

• Building, testing, monitoring and maintaining data pipelines and infrastructure to support the Data Platform using best practices including CI/CD, IaC and DevOps.
• Apply security best practices across data pipelines, cloud infrastructure and operational processes, ensuring data is protected through appropriate access controls, encryption, monitoring and secure engineering practices
• Use AWS services and PostgreSQL/AWS RDS knowledge to design, deliver and support scalable, reliable and secure data solutions, ensuring appropriate governance, resilience and protection of business data.
• Actively embrace AI‑assisted engineering practices and demonstrate a willingness to learn, experiment with and responsibly adopt emerging AI tools such as Kiro, GitHub Copilot or equivalent technologies to improve delivery flow, quality, documentation, analysis and operational efficiency.
• Develop and maintain automated deployment, testing and operational workflows using GitLab pipelines, version control, Terraform/OpenTofu and scripting.
• Contribute to data quality, lineage, governance and observability practices to ensure data is trusted, traceable, secure and supportable throughout its lifecycle.
• Investigate data quality, platform reliability, pipeline performance and operational issues, identifying practical improvements, preventative actions and automation opportunities that enable squads to move faster and more safely.
• Working with business stakeholders, analysts and architects to understand business and technical requirements, designing data models and data structures that support reporting, analytics and operational use cases.
• Contribute to database and data platform activities such as upgrades, data migrations, schema updates and platform modernisation initiatives.
• Documenting processes and products, sharing knowledge across the squad and wider business, and supporting the development of less experienced engineers through mentoring, pairing or technical guidance where appropriate.
• Contribute significantly to small‑to‑medium feature deliveries and multi‑person initiatives, collaborating with engineers and stakeholders to deliver reliable outcomes.

About You

• Hold, or be willing to obtain, a relevant AWS certification that can be registered against the CDL APN.
• Proven experience working with AWS services relevant to data engineering and operational support, such as RDS, S3, Lambda, ECS, EC2, VPC, CloudWatch and related services.
• Experience with MySql and Oracle databases would be advantageous.
• Strong SQL skills, including PostgreSQL experience, query optimisation awareness and the ability to investigate data or performance issues.
• Good understanding of security principles including least‑privilege access, encryption, secrets management, vulnerability remediation and secure handling of sensitive data.
• Experience with CI/CD pipelines, automated testing and deployment practices using GitLab or similar tooling.
• Experience with Infrastructure as Code tools such as Terraform, OpenTofu or CloudFormation.
• Good understanding of version control workflows, branching strategies and GitLab best practice.
• Experience of, or a strong willingness to learn, AI‑assisted engineering tools such as Kiro, GitHub Copilot or similar technologies to improve engineering effectiveness and delivery outcomes.
• Familiarity with observability and troubleshooting tooling such as Dynatrace, OpenSearch/Elasticsearch or CloudWatch logs.
• Ability to communicate clearly, analyse problems, work collaboratively and explain technical concepts to both technical and non‑technical stakeholders.
• Familiarity with Agile methodologies and operational tooling such as Jira and ServiceNow.

What You’ll Get

Salary

The salary for the role of Intermediate Data Engineer pays up to £45,000p.a (Level 4) providing a fantastic opportunity for career progression through CDL’s clearly defined career framework (https://progression.cdl.co.uk/).

Your growth and advancement within CDL are only limited by your own ambition and effort.

Benefits

• Hybrid Working (2 Days a Week in the office - SK4 2HD)
• Flexible working.
• 25 days holiday to start, increasing by 1 day per 1 year of service up to 30 days.
• Top employer for 10th year running
• Excellent training and development platform
• Opportunities for career progression
• Health and Wellbeing Programme
• Virtual activities, lunch and learns, coffee mornings and meetups.
• Life and health assurance
• Electric Vehicle Scheme
• Established Recognition Award System
• Great Parental Benefits
• Diversity and Inclusion network
• Pension scheme
• Community projects and volunteer days
• Refer a friend bonus

Campus Benefits

• On‑site free parking
• Open plan modern offices
• Quiet Spaces are also available
• Shuttle bus to and from the station
• Subsidised restaurant
• Games room, pool & table‑tennis tables and chill out zone
• Annual Hackathon & Deep Racer Events
• Social activities, regular social events through our social group Xtra, including a summer BBQ, competitions, bowling, go‑karting, football games, Winter party and much more!
• Car wash, barber, yoga classes, boot camp and massage services all on site
• Cycle to work scheme
• Shower and dry rooms

Diversity and inclusion

We’re on a journey to keep innovating, that means welcoming new ideas and ways of thinking.

CDL recognises that building a diverse workforce is critical to the success of our business. We strongly encourage applications from a diverse talent pool and welcome the opportunity to discuss flexibility requirements and workplace adjustments with all our applicants.