Data Engineer – 15343

Comxps Ltd; United Kingdom; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Comxps Ltd in the United Kingdom is seeking a data engineering specialist to strengthen our data pipelines. You will build and maintain pipelines using Python with Azure and Kubernetes, and leverage Apache Airflow and Apache Spark. Palantir experience is a nice to have for advanced data integration.

The role requires DV clearance and offers a hybrid work model with four days on-site near Regent's Park and one day remote, with a PERM or CONTRACT arrangement available (inside IR35).

Qualifications

• Experience with Python, Azure and Kubernetes in data pipelines.
• Hands-on with Apache Airflow and Spark for data processing.
• Palantir environment experience is a nice to have.

Responsibilities

• Building and maintaining new and existing data pipelines with the tools above.
• Ensure data governance keeps data on Defence-owned infrastructure, not Palantir hosted.

Skills

Python

Azure

Kubernetes

Tools

Apache Airflow

Apache Spark

Palantir

Job description

Salary: £Please confirm competitive rate or annual salary / contact us to discuss further

Location: days a week onsite in Regents Park - 4 days per week on-site. 1 day per week remote/off-site. Flexibility may be required based on programme and operational needs.

Contract Length: PERM OR CONTRACT AVAILABLE (INSIDE IR35)

Clearance: DV

Requirements

• Core Stack: Python with Azure (Low side) and Kubernetes (high side)
• Tools: Apache Airflow, Apache Spark
• Built in Palantir environment is a nice to have
• No AWS knowledge required
• Data governance goal is to keep Data on Defence owned infrastructure, not Palantir hosted
• Building and maintaining new and existing data pipelines with the tools above
• Project has been running for a long time but requires additional support

Our dedicated team would be pleased to discuss in more detail how we may be able to help