Data Engineer - active NPPV3 clearance required

RDA Placements Limited; London; On-site; GBP 50,000 - 80,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer to design and develop robust data infrastructures that support advanced analytics within the police department. This role involves building data pipelines, ensuring data integrity, and collaborating with analysts to transform data into actionable intelligence. The ideal candidate will leverage cutting-edge technologies to drive innovation in data management while ensuring compliance with stringent security standards. If you are passionate about data and public safety, this is an exciting opportunity to make a significant impact.

Qualifications

• Proficiency in Python and SQL for data manipulation and analysis.
• Experience with Kafka and Airflow for data pipeline management.
• Strong knowledge of database management systems and data security.

Responsibilities

• Design and implement data architectures and models for data organization.
• Build data pipelines to process and analyze intelligence data.
• Administer databases ensuring data availability and integrity.

Skills

Python

SQL

Kafka

Airflow

AWS

Azure

Database Management

Data Security

Tools

Data Pipelines

Data Warehousing

Job description

PLEASE NOTE - That to be considered you must be in possession of active NPPV3 clearance.

THE ROLE

• To design, implement, and develop robust and scalable data infrastructure that supports advanced analytics and intelligence operations within the police department, enabling data-driven decision-making for crime prevention, investigations, and public safety.
• This post will work within a 130-strong team of intelligence professionals.
• Enabling seamless integration and analysis of complex criminological and intelligence data, empowering analysts and investigators to identify crime patterns, predict future incidents, and enhance investigative outcomes.
• Ensuring the integrity, security, and ethical use of sensitive criminal justice information, adhering to stringent compliance standards and fostering public trust.
• Drive innovation in data management and analytics, leveraging cutting-edge technologies to enhance the department's ability to respond to evolving crime trends and emerging threats.
• Empower the department with the tools to transform data into actionable intelligence.

PRIME RESPONSIBILITIES

• Design and implement data architectures and data models. This involves creating blueprints for how data is organized, stored, and accessed. It includes defining data schemas, relationships, and flows, ensuring data consistency and efficiency.
• Build data pipelines to process and analyse intelligence data from various sources to identify relevant threats.
• Develop data solutions to support the analysis of complex intelligence networks and identify potential criminal activity.
• Administer and maintain databases, ensuring data availability, integrity, and security. It also involves designing and implementing data warehouses to support analytical reporting and data mining. Implement and enforce data security and compliance measures.
• Collaborate closely with stakeholders to understand their data requirements and develop customized data solutions.
• Optimize data infrastructure performance and troubleshoot issues by monitoring system performance, identifying bottlenecks, and implementing solutions to improve efficiency. It also includes diagnosing and resolving technical problems.
• Manage cloud-based data infrastructure, optimise cost, performance, and scalability.
• Establish and enforce data governance and quality standards by defining and implementing policies and procedures to ensure data accuracy, consistency, and completeness. It also includes establishing data lineage and metadata management processes.
• Participate in the development of data strategies and initiatives, identifying opportunities to leverage new technologies, and driving innovation in data management practices.
• Work closely with data scientists, intelligence analysts, and other stakeholders to understand their data needs and provide effective solutions. It also involves communicating complex technical concepts clearly and concisely.

SKILLS ATTRIBUTES

• Proficiency in advanced programming languages used for data engineering tasks, including data manipulation, transformation, and analysis (Python, SQL, etc.).
• Experience with tools and technologies used to build and manage data pipelines, including message queues, orchestration tools, and data integration platforms (Kafka, Airflow, etc.).
• Familiarity with cloud-based data services, including storage, compute, and analytics (AWS, Azure).
• Knowledge of database management systems (relational and NoSQL) and data warehousing concepts and technologies.
• Understanding of data security principles and compliance requirements, particularly related to sensitive data.
• Ability to support team members, share knowledge, and foster their professional development.
• Ability to identify and resolve complex technical problems and analyse data to identify trends and patterns.
• Ability to communicate technical concepts clearly and concisely and work effectively with stakeholders from diverse backgrounds.