Senior Engineer - Data Solutions

Boardroom Appointments; Johannesburg; On-site; ZAR 600,000 - 800,000; Full time

Job summary

A leading recruitment agency is looking for a Senior Engineer - Data Solutions in Johannesburg. The role requires expertise in ElasticSearch and Apache Kafka, focusing on solution design, implementation, and customer engagement. You will work in a highly distributed team while handling complex data challenges. Minimum of 2 years experience in software or DevOps roles is required. This position offers opportunities for certification and growth in open-source technologies.

Qualifications

• Minimum of 2 years experience in relevant roles.
• Hands-on experience with ElasticSearch and/or Apache Kafka.
• Knowledge of containerised environments like Kubernetes.

Responsibilities

• Design and implement Elastic and Kafka solutions.
• Monitor and support Elastic & Kafka deployments.
• Engage with Sales and Pre-Sales for solution scoping.

Skills

ElasticSearch

Apache Kafka

Kubernetes

Big Data

DevOps

Communication Skills

Job description

About the job Senior Engineer - Data Solutions

Responsibilities:

• Prepare for projects, discussing the goals and expectations with the customer and building specifications
• Researching best practices or components required for projects
• Technical delivery of Elastic and Kafka solutions using Kubernetes based deployment models.
• Solution design, development, and integration of Elastic & Kafka products and APIs, platform architecture, and capacity planning in mission-critical environments
• Monitor, upgrade, patch and support Elastic & Kafka deployments.
• Track tickets in support desk and project tasks in project boards.
• Build strong relationships with customers.
• Writing or editing documentation and knowledge bases
• Data modeling, query development and optimization, cluster tuning and scaling
• Solving customers data challenges
• Engineering our solutions for automation using helm
• Engaging with our Sales and Pre-Sales teams to assist with solution scoping and identifying technical risks or concerns
• Honing your skills by completing certifications on our product stacks.
• Comfortable working remotely in a highly distributed team

Requirements:

• Hands-on experience and an understanding of Elasticsearch and/or Lucene OR Apache Kafka. Having both would be a bonus.
• Experience building and operating in-production Big Data, stream processing, observability and/or enterprise data integration solutions
• Minimum of 2 years experience as a Software Engineer, System Administrator, or DevOps Engineer
• Knowledge of information retrieval and/or analytics domain
• An understanding of deploying enterprise systems in a containerised environment, preferably Kubernetes.
• Hands-on experience with large distributed systems from an architecture and engineering perspective
• Good communication skills, with an ability to clearly and concisely explain tricky issues and complex solutions
• Excel at working directly with customers to gather, prioritize, plan and execute solutions to customer business requirements as it relates to our technologies
• Understanding and passion for open-source technology
• Experience helping customers build Apache Kafka solutions alongside relational and NoSQL databases, message queues, and related products