AI‑Driven Data Engineer (AWS, Pipelines & Observability)

CDL IT SOLUTIONS LIMITED; North West Leicestershire; Hybrid; GBP 40,000 - 45,000; Full time

Benefits offered by this job

Hybrid working (2 days in office)

Flexible working

25 days holiday (increasing with time)

Training & development

Pension

Career progression

Job summary

CDL IT SOLUTIONS LIMITED, located in the UK, seeks an Intermediate Data Engineer to join the Insurance Retail team, building cloud‑ready data pipelines with SQL, AWS and DevOps practices.

You will work with AI‑assisted tooling to accelerate development, improve documentation, support analysis and automate repeatable tasks while ensuring data security, governance and observability across the data platform.

Qualifications

• Strong SQL skills with PostgreSQL experience.
• Experience with AWS data services and RDS/S3/Lambda/ECS knowledge.
• CI/CD pipelines and GitLab tooling experience.
• Infrastructure as Code tools: Terraform/OpenTofu/CloudFormation.
• Security best practices: least-privilege, encryption and Secrets management.
• Familiarity with AI-assisted engineering tools.
• Observability tools like Dynatrace/OpenSearch/CloudWatch.
• Agile methodologies; Jira and ServiceNow familiarity.

Responsibilities

• Building, testing, monitoring and maintaining data pipelines and infrastructure using CI/CD, IaC and DevOps practices.
• Applying security best practices across data pipelines and cloud infra.
• Using AWS services and PostgreSQL/AWS RDS to design scalable, secure data solutions.
• Embracing AI-assisted engineering tools to accelerate delivery and quality.
• Developing automated deployment, testing and operational workflows with GitLab, Terraform/OpenTofu.
• Contributing to data quality, lineage, governance and observability.
• Investigating data quality and pipeline reliability, driving improvements and automation.
• Collaborating with stakeholders to design data models for reporting and analytics.
• Participating in upgrades, migrations and platform modernization initiatives.
• Documenting processes and mentoring engineering peers.

Skills

SQL

AWS experience

CI/CD

IaC

GitLab

Security principles

Observability

AI-assisted engineering

Agile methodologies

Tools

Terraform

OpenTofu

CloudFormation

GitLab

Jira

ServiceNow

Dynatrace

OpenSearch

PostgreSQL

MySQL

Oracle

Kiro

GitHub Copilot

Job description

CDL IT SOLUTIONS LIMITED, located in the UK, seeks an Intermediate Data Engineer to join the Insurance Retail team, building cloud‑ready data pipelines with SQL, AWS and DevOps practices.

You will work with AI‑assisted tooling to accelerate development, improve documentation, support analysis and automate repeatable tasks while ensuring data security, governance and observability across the data platform.