Senior Python Engineer - SC Cleared

Searchability NS&D; Cardiff; Hybrid; GBP 68,000 - 83,000; Full time

Job summary

Searchability NS&D in Cardiff is seeking a Senior Python / Data Engineer with SC clearance to join a growing engineering team on complex public sector data projects. This hands-on role requires a strong backend Python background and experience with data platforms.

You will design and build modern data platforms, data pipelines and APIs, working with cloud technologies (AWS/Azure/GCP), ETL/ELT and data lakes, while mentoring engineers and collaborating with data scientists in a hybrid, permanent

Qualifications

• Strong Python backend/software engineering experience with data-focused projects.
• Experience with cloud platforms (AWS, Azure or GCP) and data pipelines.
• Familiarity with ETL/ELT, data lakes/warehouses, and modern CI/CD workflows.

Responsibilities

• Design and build production-grade Python data applications and services.
• Develop and maintain data pipelines (ETL/ELT, batch/streaming).
• Collaborate with data scientists and engineers in Agile teams.

Skills

Python

Backend engineering

Data pipelines

Cloud platforms

ETL/ELT

Terraform

CI/CD

Git

TDD

APIs

Tools

Pandas

Pydantic

Airflow

AWS Glue

Docker

JSON

Parquet

Job description

SENIOR PYTHON / DATA ENGINEER - SC CLEARED

NEW PERMANENT OPPORTUNITY AVAILABLE FOR AN SC CLEARED PYTHON ENGINEER WITH DATA ENGINEERING EXPERIENCE

• Salary: Up to £75,000
• Location: Cardiff
• Working Pattern: Hybrid
• Clearance: SC Clearance required to start
• Type: Permanent

I'm currently working with a leading technology consultancy delivering a range of complex digital and data projects across the public sector.

They're looking for a Senior Python / Data Engineer to join their growing engineering team in Cardiff.

This role could be a great fit for someone from a strong backend Python / software engineering background who has experience working with data, cloud platforms or data-intensive applications. You don't need to have worked across every area of data engineering - strong software engineering fundamentals are key.

THE ROLE

You'll work as a hands-on senior engineer, designing and building modern data platforms, services and applications for public sector clients.

You'll be involved across the engineering lifecycle, working with Python, cloud technologies, data pipelines and modern software engineering practices. You'll also have the opportunity to work closely with clients and support the development of other engineers.

Key responsibilities

• Developing high-quality, production-ready Python applications and services
• Building and maintaining data pipelines, including ETL/ELT and batch/streaming workloads
• Working with cloud platforms including AWS, Azure or GCP
• Designing and integrating APIs, databases and data services
• Applying software engineering principles including SOLID, DRY and TDD
• Using Git and CI/CD pipelines to maintain code quality and support deployments
• Working with data transformation, cleansing and standardisation
• Supporting modern data architectures including data lakes and data warehouses
• Using Terraform / Infrastructure as Code to build and manage environments
• Implementing logging, monitoring and alerting across production systems
• Working with technologies such as Pandas, Pydantic, Airflow, AWS Glue, Docker, JSON and Parquet
• Working alongside data scientists, engineers and multidisciplinary delivery teams
• Supporting and mentoring other engineers and sharing technical knowledge

WHAT WE'RE LOOKING FOR

We're particularly interested in engineers with:

• Strong commercial experience with Python
• A solid understanding of backend / software engineering principles
• Experience working with AWS, Azure or GCP
• Experience with Git, CI/CD and automated testing
• Knowledge of databases and data processing
• Experience building or working with APIs, services or data pipelines
• Understanding of ETL/ELT and data engineering principles
• Experience with Terraform or another Infrastructure as Code tool
• Experience working in modern Agile engineering environments
• Strong communication skills and the ability to work with technical and non-technical stakeholders
• Active SC Clearance

DESIRABLE

• Airflow or AWS Glue
• Pandas / Pydantic
• Docker
• Data lakes / data warehouses
• Batch and streaming systems
• Data quality and schema management
• Experience productionising machine learning or data science solutions
• Consultancy experience
• Public sector experience
• Pair programming / mob programming
• Experience working within multidisciplinary technology teams

You don't need to tick every box. If you're a strong Senior Python / Backend Engineer with some experience around data, cloud or data platforms, I'd still be keen to speak with you.