Data Streaming Engineer

Madfish; United Kingdom; Remote; GBP 45,000 - 65,000; Full time

Job summary

A dynamic media software group in the United Kingdom is seeking a software developer to maintain and extend back-end services in a Kubernetes environment. The ideal candidate will have a strong background in AWS, Kafka, and Spark, along with experience in CI/CD practices. Responsibilities include supporting operational excellence and resolving infrastructure issues as part of a collaborative team. This position offers a chance to work with cutting-edge digital media products.

Qualifications

• High standards for the quality of work delivered.
• 3+ years of software development life cycle experience.
• Affinity with data analysis.
• AWS certified at Associate level or willing to get certified.

Responsibilities

• Maintain and extend the back-end services.
• Support operational excellence through code review and pair programming.
• Monitor applications and their infrastructure, addressing operational problems.

Skills

AWS

Kafka

Spark

Python (FastAPI)

SQL

Terraform

Education

Degree in Computer Science or Software Engineering

Tools

Kubernetes

Apache Spark

Job description

Client: Media group Belgium.

Skills Required

• AWS
• Kafka
• Spark
• Python (FastAPI)
• SQL
• Terraform

You have

• high standards for the quality of the work you deliver
• a degree in computer science, software engineering, a related field, or relevant prior experience
• 3+ years of software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• affinity with data analysis
• a natural interest in digital media products
• AWS certified on an Associate level or higher, or willing to get certified

you have experience in

• developing applications in a Kubernetes environment
• developing batch jobs in Apache Spark (pyspark or Scala)
• developing streaming applications for Apache Kafka in Python
• working with CI/CD pipelines
• writing Infrastructure as Code with Terraform

Responsibilities

• Maintain and extend our back-end.
• Support operational excellence through practices like code review and pair programming.
• The entire team is responsible for the operations of our services. This includes actively monitoring different applications and their infrastructure as well as intervening to solve operational problems whenever they arise.