Tech Lead - Data Engineering

Permanent Futures Ltd; Bristol; On-site; GBP 60,000 - 100,000; Full time

Job summary

An innovative firm is searching for a Tech Lead to spearhead a national policing programme. This pivotal role combines engineering management and technical leadership, guiding a talented team of Data Engineers. You will oversee the design and development of bespoke software applications, focusing on entity management and data analysis. Your expertise in AWS, Python, and modern data engineering practices will be crucial in ensuring the success of mission-critical applications. Join this forward-thinking organization and make a significant impact on public safety through technology.

Qualifications

• Strong leadership experience within technical teams.
• Hands-on expertise with AWS, Python, and Apache Airflow.

Responsibilities

• Lead and mentor a multidisciplinary engineering team.
• Design and build scalable data solutions and infrastructure.
• Oversee application integration, data pipelines, and cloud deployment.

Skills

Leadership

Python

AWS

Apache Airflow

Data Engineering

DevOps

Scala

ReactJS

NodeJS

Tools

Docker

Jenkins

Ansible

Apache Spark

Postgres

MongoDB

Opensearch

MinIO

Job description

Tech Lead – National Programme (Major Police Platform)

We are seeking an experienced Tech Lead to join a major national policing programme, leading a team of talented Data Engineers working on mission-critical applications for entity management and data pattern analysis.

In this role, you will act as both Engineering Manager and Technical Lead, overseeing the design, development, and deployment of bespoke software applications now live in production. You will guide the development of entity resolution and graphing solutions, ETL processes, data pipelines, and infrastructure implementations.

Key Technologies:

• Cloud: AWS
• Languages: Python, Scala, ReactJS, NodeJS
• Data Engineering: Apache Airflow, Apache Spark, Postgres, MongoDB, Opensearch, MinIO
• DevOps: Docker/Docker Swarm, Jenkins, Ansible

Key Responsibilities:

• Lead and mentor a multidisciplinary engineering team.
• Design and build scalable data solutions and infrastructure.
• Oversee application integration, data pipelines, and cloud deployment.
• Ensure best practices in engineering, security, and performance.

Ideal Candidate:

• Strong leadership experience within technical teams.
• Hands-on expertise with AWS, Python, and Apache Airflow.
• Solid understanding of modern data engineering and DevOps practices.
• Experience in developing applications for large-scale data management and analysis.