SC-Cleared Senior Python / Data Engineer | Hybrid Cardiff

Searchability NS&D; Cardiff; Hybrid; GBP 60,000 - 75,000; Full time

Job summary

Searchability NS&D in Cardiff is seeking a Senior Python / Data Engineer with SC clearance to join our growing engineering team. You will design and build modern data platforms, pipelines and services for public sector projects.

You'll work hands-on across the engineering lifecycle using Python, cloud tech and data tooling, mentoring engineers and collaborating with data scientists and delivery teams in a hybrid setup.

Qualifications

• Strong commercial experience with Python.
• Solid understanding of backend / software engineering principles.
• Experience with AWS, Azure or GCP.
• Experience with Git, CI/CD and automated testing.
• Knowledge of databases and data processing.
• Experience building APIs, services or data pipelines.
• Understanding of ETL/ELT and data engineering principles.
• Experience with Terraform or another Infrastructure as Code tool.
• Experience working in modern Agile engineering environments.
• Strong communication skills and the ability to work with technical and non-technical stakeholders.
• Active SC Clearance.

Responsibilities

• Developing high-quality, production-ready Python applications and services.
• Building and maintaining data pipelines, including ETL/ELT and batch/streaming workloads.
• Working with cloud platforms including AWS, Azure or GCP.
• Designing and integrating APIs, databases and data services.
• Applying software engineering principles including SOLID, DRY and TDD.
• Using Git and CI/CD pipelines to maintain code quality and support deployments.
• Working with data transformation, cleansing and standardisation.
• Supporting modern data architectures including data lakes and data warehouses.
• Using Terraform / Infrastructure as Code to build and manage environments.
• Implementing logging, monitoring and alerting across production systems.
• Working with technologies such as Pandas, Pydantic, Airflow, AWS Glue, Docker, JSON and Parquet.
• Working alongside data scientists, engineers and multidisciplinary delivery teams.
• Supporting and mentoring other engineers and sharing technical knowledge.

Skills

Python

Backend engineering

AWS/Azure/GCP

Git

CI/CD

Automated testing

APIs

Data pipelines

ETL/ELT

Terraform

Agile

Communication

SC Clearance

Tools

Pandas

Airflow

Docker

Git

Job description

Searchability NS&D in Cardiff is seeking a Senior Python / Data Engineer with SC clearance to join our growing engineering team. You will design and build modern data platforms, pipelines and services for public sector projects.

You'll work hands-on across the engineering lifecycle using Python, cloud tech and data tooling, mentoring engineers and collaborating with data scientists and delivery teams in a hybrid setup.