Lead Data Engineer: Design, Scale & Optimize Pipelines

Kainos; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

Kainos is seeking a Lead Data Engineer (Consultant) to oversee the development of data-intensive components and lead a team. Responsibilities include collaborating with architects for data processing, defining best practices, and ensuring operational readiness.

The ideal candidate will have experience in Java, Scala, or Python, SQL expertise, and a strong interest in AI technologies. This role is crucial for delivering cutting-edge solutions.

Qualifications

• Experience leading a team of engineers in data system components.
• Proficient in Java, Scala, or Python for development.
• Expertise in SQL or SQL extensions for analytics.

Responsibilities

• Develop components or subsystems including design, code, testing.
• Work with project architects for ETL/ELT data processing.
• Manage and coach team staff and ensure operational readiness.

Skills

Leadership

Java

Scala

Python

SQL

Data Processing

Communication

AI Technologies

Tools

Informatica

Azure Databricks

ETL Tools

Job description

Kainos is seeking a Lead Data Engineer (Consultant) to oversee the development of data-intensive components and lead a team. Responsibilities include collaborating with architects for data processing, defining best practices, and ensuring operational readiness.

The ideal candidate will have experience in Java, Scala, or Python, SQL expertise, and a strong interest in AI technologies. This role is crucial for delivering cutting-edge solutions.