Secure Data Engineer | Azure & Databricks Architect

Capgemini; Birmingham; Hybrid; GBP 70,000 - 90,000; Full time

Benefits offered by this job

Flexible working arrangements

Training and development opportunities

Positive work-life balance

Job summary

A leading consulting firm is seeking a Solution Architect with a focus on Azure and Databricks to join their Data Platforms team in Birmingham. This role involves designing and building scalable data applications and workflows for Defence customers, requiring core engineering expertise especially in Python and familiarity with various data technologies. The role promotes a hybrid working model, providing opportunities for professional growth and flexible working arrangements.

Qualifications

• Proficient in building scalable data applications for Defence customers.
• Experience with distributed processing engines and data workflows.
• Understanding of operationalising machine learning models.

Responsibilities

• Developing modular software components for data analytics.
• Designing real-time data ingestion patterns.
• Containerising services and deploying in secure environments.

Skills

Expert level Python

Data Engineering Stack Experience

Orchestration Experience

Data Quality and Lineage

AI and MLOps

Containerisation and Kubernetes

DevOps Mindset

Tools

Apache Spark

Kafka

PostgreSQL

Airflow

Terraform

Job description

A leading consulting firm is seeking a Solution Architect with a focus on Azure and Databricks to join their Data Platforms team in Birmingham. This role involves designing and building scalable data applications and workflows for Defence customers, requiring core engineering expertise especially in Python and familiarity with various data technologies. The role promotes a hybrid working model, providing opportunities for professional growth and flexible working arrangements.