Senior Data Engineer - Real-Time AI Pipelines

Vortexa; Greater London; Hybrid; GBP 60,000 - 75,000; Full time

Benefits offered by this job

Private Health Insurance

Global Volunteering Policy

Flexible working policy

Job summary

A dynamic technology company in London is seeking a Mid-Senior Level Data Engineer. This role involves designing and building robust data pipelines to handle vast data and ML models. The ideal candidate is experienced in distributed data processing using AWS and Kubernetes, with strong skills in Python. Join a vibrant team in a start-up environment focused on leveraging cutting-edge technology. A flexible working policy and health benefits provided.

Qualifications

• Experience in building and deploying distributed scalable backend data processing pipelines.
• Fluent in Python with solid software engineering fundamentals.
• Experience of the full software development life cycle including technical design and deployment.

Responsibilities

• Design and build infrastructure for data pipelines and ML models.
• Ensure 100% uptime and fault-tolerance of data pipelines.
• Bridge the gap between scientific experiments and commercial products.

Skills

Distributed scalable backend data processing

AWS

Kubernetes

Airflow

Python

Software development life cycle (SDLC)

Tools

Apache Kafka

Flink

Job description

A dynamic technology company in London is seeking a Mid-Senior Level Data Engineer. This role involves designing and building robust data pipelines to handle vast data and ML models. The ideal candidate is experienced in distributed data processing using AWS and Kubernetes, with strong skills in Python. Join a vibrant team in a start-up environment focused on leveraging cutting-edge technology. A flexible working policy and health benefits provided.