Data Engineer – Cloud Pipelines & DataOps (Hybrid)

Searchability NS&D; Lancashire; Hybrid; GBP 68,000 - 83,000; Full time

Benefits offered by this job

6% pension

30 days leave

Job summary

Searchability NS&D is seeking a hands-on data engineering specialist to join our Manchester team in a hybrid role. You will build and maintain scalable data platforms and pipelines, delivering Python-based solutions for batch and streaming data, ETL/ELT processes and data transformations.

You will implement CI/CD, IaC and DataOps in production, translate client requirements into technical outcomes, and provide technical leadership where needed.

Qualifications

• Experience in Python development and data engineering.
• Hands-on experience with AWS or Azure.
• Proficiency with Terraform or IaC.
• Experience building data pipelines and ETL/ELT processes.
• Familiarity with testing (unit, PyTest) and CI/CD.

Responsibilities

• Build and maintain scalable data platforms, pipelines and services.
• Develop robust Python-based data solutions using modern engineering practices.
• Deliver batch, streaming, ETL/ELT and data transformation solutions.
• Implement CI/CD, IaC and DataOps across production environments.
• Translate client requirements into technical solutions and measurable outcomes.
• Provide technical leadership and mentoring when required.

Skills

Python

AWS/Azure

Data engineering

Terraform/IaC

Testing (PyTest)

CI/CD/DevOps

Tools

Terraform

PyTest

CI/CD tooling

Job description

Searchability NS&D is seeking a hands-on data engineering specialist to join our Manchester team in a hybrid role. You will build and maintain scalable data platforms and pipelines, delivering Python-based solutions for batch and streaming data, ETL/ELT processes and data transformations.

You will implement CI/CD, IaC and DataOps in production, translate client requirements into technical outcomes, and provide technical leadership where needed.