Intermediate Data Engineer

CDL IT SOLUTIONS LIMITED; North West Leicestershire; Hybrid; GBP 40,000 - 45,000; Full time

Benefits offered by this job

Hybrid working (2 days in office)

Flexible working

25 days holiday (increasing with time)

Training & development

Pension

Career progression

Job summary

CDL IT SOLUTIONS LIMITED, located in the UK, seeks an Intermediate Data Engineer to join the Insurance Retail team, building cloud‑ready data pipelines with SQL, AWS and DevOps practices.

You will work with AI‑assisted tooling to accelerate development, improve documentation, support analysis and automate repeatable tasks while ensuring data security, governance and observability across the data platform.

Qualifications

• Strong SQL skills with PostgreSQL experience.
• Experience with AWS data services and RDS/S3/Lambda/ECS knowledge.
• CI/CD pipelines and GitLab tooling experience.
• Infrastructure as Code tools: Terraform/OpenTofu/CloudFormation.
• Security best practices: least-privilege, encryption and Secrets management.
• Familiarity with AI-assisted engineering tools.
• Observability tools like Dynatrace/OpenSearch/CloudWatch.
• Agile methodologies; Jira and ServiceNow familiarity.

Responsibilities

• Building, testing, monitoring and maintaining data pipelines and infrastructure using CI/CD, IaC and DevOps practices.
• Applying security best practices across data pipelines and cloud infra.
• Using AWS services and PostgreSQL/AWS RDS to design scalable, secure data solutions.
• Embracing AI-assisted engineering tools to accelerate delivery and quality.
• Developing automated deployment, testing and operational workflows with GitLab, Terraform/OpenTofu.
• Contributing to data quality, lineage, governance and observability.
• Investigating data quality and pipeline reliability, driving improvements and automation.
• Collaborating with stakeholders to design data models for reporting and analytics.
• Participating in upgrades, migrations and platform modernization initiatives.
• Documenting processes and mentoring engineering peers.

Skills

SQL

AWS experience

CI/CD

IaC

GitLab

Security principles

Observability

AI-assisted engineering

Agile methodologies

Tools

Terraform

OpenTofu

CloudFormation

GitLab

Jira

ServiceNow

Dynatrace

OpenSearch

PostgreSQL

MySQL

Oracle

Kiro

GitHub Copilot

Job description

We’re seeking an Intermediate Data Engineer to join our Insurance Retail department, supporting development squads with reliable, automated and cloud‑ready data solutions. This role is suited to someone who can combine strong SQL, scripting and AWS experience with modern DevOps practices to build, maintain and improve data pipelines, data services and supporting infrastructure.

AI is a key part of the role. You will be expected to use AI‑assisted engineering tools responsibly to accelerate development, improve documentation, support analysis and identify opportunities to automate repeatable data engineering and operational tasks. Working closely with engineers, analysts, architects and stakeholders, you will help turn data requirements into maintainable, observable and secure solutions.

You will maintain awareness of industry and technology developments, contribute to technical discussions, and support continuous improvement across data engineering, automation and operational practices. The role includes ownership of work throughout its lifecycle, from development and testing through to production support, incident resolution, continuous improvement and knowledge sharing across the department.

About CDL

CDL is one of the UK’s leading software development houses, employing over 600 people at its campus in Stockport. It has a consistent history in the high‑volume retail insurance sector. CDL has spearheaded developments in the aggregator, web and telematics space, including connected home, enrichment and self‑service solutions. As a result, the company’s robust and innovative technologies have enabled its customers to thrive in the highly competitive UK insurance marketplace.

We have built a collaborative and creative culture, leveraging AI‑driven solutions to enhance our products, processes and decision‑making. We pride ourselves on cultivating an inspiring working environment with our employees at the heart of our company.

In a nutshell we are the market leading software house in our industry, creating the software, websites & apps for the Insurance & Finance sector across the UK. If you were to go on a price comparison website, approximately 65% of the companies on there are our clients!

Department: Insurance Retail
Employment Type: Permanent - Full Time
Location: North West UK - Hybrid
Address: Kings Reach Road, Stockport, England, SK4 2HD
Workplace type: Hybrid
Compensation: £40,000 - £45,000 / year

What You’ll Do

• Building, testing, monitoring and maintaining data pipelines and infrastructure to support the Data Platform using best practices including CI/CD, IaC and DevOps.


• Apply security best practices across data pipelines, cloud infrastructure and operational processes, ensuring data is protected through appropriate access controls, encryption, monitoring and secure engineering practices


• Use AWS services and PostgreSQL/AWS RDS knowledge to design, deliver and support scalable, reliable and secure data solutions, ensuring appropriate governance, resilience and protection of business data.


• Actively embrace AI‑assisted engineering practices and demonstrate a willingness to learn, experiment with and responsibly adopt emerging AI tools such as Kiro, GitHub Copilot or equivalent technologies to improve delivery flow, quality, documentation, analysis and operational efficiency.


• Develop and maintain automated deployment, testing and operational workflows using GitLab pipelines, version control, Terraform/OpenTofu and scripting.


• Contribute to data quality, lineage, governance and observability practices to ensure data is trusted, traceable, secure and supportable throughout its lifecycle.


• Investigate data quality, platform reliability, pipeline performance and operational issues, identifying practical improvements, preventative actions and automation opportunities that enable squads to move faster and more safely.


• Working with business stakeholders, analysts and architects to understand business and technical requirements, designing data models and data structures that support reporting, analytics and operational use cases.


• Contribute to database and data platform activities such as upgrades, data migrations, schema updates and platform modernisation initiatives.


• Documenting processes and products, sharing knowledge across the squad and wider business, and supporting the development of less experienced engineers through mentoring, pairing or technical guidance where appropriate.


• Contribute significantly to small‑to‑medium feature deliveries and multi‑person initiatives, collaborating with engineers and stakeholders to deliver reliable outcomes.

About You

• Hold, or be willing to obtain, a relevant AWS certification that can be registered against the CDL APN.


• Proven experience working with AWS services relevant to data engineering and operational support, such as RDS, S3, Lambda, ECS, EC2, VPC, CloudWatch and related services.


• Experience with MySql and Oracle databases would be advantageous.


• Strong SQL skills, including PostgreSQL experience, query optimisation awareness and the ability to investigate data or performance issues.


• Good understanding of security principles including least‑privilege access, encryption, secrets management, vulnerability remediation and secure handling of sensitive data.


• Experience with CI/CD pipelines, automated testing and deployment practices using GitLab or similar tooling.


• Experience with Infrastructure as Code tools such as Terraform, OpenTofu or CloudFormation.


• Good understanding of version control workflows, branching strategies and GitLab best practice.


• Experience of, or a strong willingness to learn, AI‑assisted engineering tools such as Kiro, GitHub Copilot or similar technology to improve engineering effectiveness and delivery outcomes.


• Familiarity with observability and troubleshooting tooling such as Dynatrace, OpenSearch/Elasticsearch or CloudWatch logs.


• Ability to communicate clearly, analyse problems, work collaboratively and explain technical concepts to both technical and non‑technical stakeholders.


• Familiarity with Agile methodologies and operational tooling such as Jira and ServiceNow.

What You’ll Get

Salary

The salary for the role of Intermediate Data Engineer pays up to £45,000p.a. (Level 4) providing a fantastic opportunity for career progression through CDL’s clearly defined career framework (https://progression.cdl.co.uk/).

Your growth and advancement within CDL are only limited by your own ambition and effort.

Benefits

• Hybrid Working (2 Days a Week in the office - SK4 2HD)


• Flexible working.


• 25 days holiday to start, increasing by 1 day per 1 year of service up to 30 days.


• Top employer for 10th year running


• Excellent training and development platform


• Opportunities for career progression


• Health and Wellbeing Programme


• Virtual activities, lunch and learns, coffee mornings and meetups.


• Life and health assurance


• Electric Vehicle Scheme


• Established Recognition Award System


• Great Parental Benefits


• Diversity and Inclusion network


• Pension scheme


• Community projects and volunteer days


• Refer a friend bonus

Campus Benefits

• On‑site free parking


• Open plan modern offices


• Quiet Spaces are also available


• Shuttle bus to and from the station


• Subsidised restaurant


• Games room, pool & table‑tennis tables and chill out zone


• Annual Hackathon & Deep Racer Events


• Social activities, regular social events through our social group Xtra, including a summer BBQ, competitions, bowling, go‑karting, football games, Winter party and much more!


• Car wash, barber, yoga classes, boot camp and massage services all on site


• Cycle to work scheme


• Shower and dry rooms

Diversity And Inclusion

We’re on a journey to keep innovating, that means welcoming new ideas and ways of thinking.

CDL recognises that building a diverse workforce is critical to the success of our business. We strongly encourage applications from a diverse talent pool and welcome the opportunity to discuss flexibility requirements and workplace adjustments with all our applicants.