Senior Data Engineer: Scalable Pipelines, AI & Cloud

Kainos; Birmingham; On-site; GBP 85,000 - 120,000; Full time

Job summary

Kainos in the United Kingdom is seeking a Senior Data Engineer to design and develop data processing software for large-scale systems and to work within agile teams delivering production-ready data solutions. You will collaborate with Architects and Lead Engineers, own components end-to-end, mentor teammates, and help ensure performance, reliability and scalability in demanding environments.

This role offers exposure to cutting-edge data technologies and requires strong coding, testing and CI/CD

Qualifications

• Strong software development experience in Java, Scala, or Python.
• Experience with data-processing platforms (AWS, Azure, GCP, Databricks).
• Experience building large-scale data processing components for production.
• Proficient in SQL and SQL extensions for analytical queries.
• Solid understanding of ETL/ELT pipelines and design patterns.
• Familiar with distributed data processing frameworks and data stores.
• Ability to write quality, testable code and automated tests.
• Experience with CI/CD techniques.
• Interest in AI technologies.

Responsibilities

• Develop data processing software for deployment in Big Data technologies.
• Full software lifecycle: design, code, test and defect resolution.
• Collaborate with Architects and Lead Engineers to meet non-functional needs.
• Maintain code quality and mentor team members; lead by example.
• Coordinate with operations teams for operational readiness.
• Advise customers and managers on effort estimates and technical implications of user stories.
• Coach and mentoring team members.

Skills

Java

Scala

Python

SQL

ETL/ELT

Distributed processing

Testing

CI/CD

AI Technologies

Tools

AWS

Azure

GCP

Databricks

Job description

Kainos in the United Kingdom is seeking a Senior Data Engineer to design and develop data processing software for large-scale systems and to work within agile teams delivering production-ready data solutions. You will collaborate with Architects and Lead Engineers, own components end-to-end, mentor teammates, and help ensure performance, reliability and scalability in demanding environments.

This role offers exposure to cutting-edge data technologies and requires strong coding, testing and CI/CD