Senior Software Engineer - AI Infrastructure

Placements24; Vereeniging; Hybrid; ZAR 900,000 - 1,500,000; Full time

Benefits offered by this job

Medical, dental, and retirement plans

Generous paid time off

Professional development & training

Attendance at industry conferences

Performance bonuses

Hybrid work arrangement

Job summary

WhatJobs Direct seeks a Senior Software Engineer to focus on AI Infrastructure in a hybrid role based in Vereeniging, Gauteng, ZA. You will design, build, and maintain scalable AI infrastructure powering ML initiatives.

Responsibilities include cloud-based AI infra, data pipelines, CI/CD for ML, and collaboration with data scientists. Strong Python/Go, cloud, Docker/Kubernetes, and MLOps expertise required.

Qualifications

• Bachelor’s or Master’s degree in CS, SE, or related field.
• 5+ years of software engineering experience with a focus on infrastructure/back-end systems.
• Proven experience building and managing AI/ML infrastructure.
• Strong Python or Go programming proficiency.
• Expertise in AWS, Azure, or GCP cloud services.
• Experience with Docker and Kubernetes.
• Knowledge of MLOps tools like MLflow or Kubeflow.
• Experience with distributed data processing frameworks such as Spark.
• Familiarity with IaC tools like Terraform or Ansible.
• Excellent problem-solving and debugging skills.

Responsibilities

• Design, build, and maintain scalable AI infrastructure on cloud platforms.
• Develop data pipelines for large ML datasets.
• Implement tools for distributed training and hyperparameter tuning.
• Create CI/CD pipelines for ML models and infrastructure.
• Ensure security, reliability, and performance of AI infra.
• Collaborate with data scientists and ML engineers on infrastructure needs.
• Automate provisioning, configuration, and management tasks.
• Monitor health, performance, and resource usage.
• Troubleshoot complex infra issues.
• Evaluate and adopt new infrastructure technologies.

Skills

Python

Go

Cloud platforms (AWS/Azure/GCP)

Docker

Kubernetes

MLOps

Distributed systems

Spark

Terraform

Ansible

Education

Bachelor's/Master's in CS/SE or related field

Tools

MLflow

Kubeflow

Job description

About the Role

WhatJobs Direct is seeking a highly experienced Senior Software Engineer to focus on AI Infrastructure, operating under a hybrid work model in Vereeniging, Gauteng, ZA . In this pivotal role, you will be responsible for designing, building, and maintaining the scalable, reliable, and efficient infrastructure that powers our advanced AI and machine learning initiatives. You will work closely with data scientists and ML engineers to ensure they have the tools, platforms, and resources needed to develop and deploy sophisticated AI models. This position requires a strong background in software engineering, cloud computing, and a deep understanding of the challenges specific to AI/ML workloads, such as distributed training, data pipelines, and model deployment. You will play a key role in optimizing performance, enhancing security, and driving innovation in our AI & Emerging Technologies division. The hybrid model allows for collaborative problem-solving and focused individual contribution, based in our Vereeniging, Gauteng, ZA office.

Key Responsibilities

• Design, develop, and maintain robust and scalable AI infrastructure on cloud platforms.
• Build and optimize data pipelines for large-scale machine learning datasets.
• Implement and manage tools for distributed training and hyperparameter optimization.
• Develop and maintain CI/CD pipelines for ML models and infrastructure.
• Ensure the security, reliability, and performance of AI infrastructure components.
• Collaborate with data scientists and ML engineers to understand their infrastructure needs.
• Automate infrastructure provisioning, configuration, and management tasks.
• Monitor infrastructure health, performance, and resource utilization.
• Troubleshoot and resolve complex infrastructure issues.
• Contribute to the selection and evaluation of new infrastructure technologies.

Requirements

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
• 5+ years of experience in software engineering, with a significant focus on infrastructure or backend systems.
• Proven experience building and managing infrastructure for AI/ML workloads.
• Strong proficiency in Python, Go, or similar programming languages.
• Expertise in cloud platforms (AWS, Azure, or GCP) and their infrastructure services.
• Experience with containerization technologies (Docker, Kubernetes) is essential.
• Knowledge of MLOps principles and tools (e.g., MLflow, Kubeflow).
• Experience with distributed systems and data processing frameworks (e.g., Spark).
• Familiarity with infrastructure as code tools (e.g., Terraform, Ansible).
• Excellent problem-solving and debugging skills.

Benefits

Our client offers a competitive salary and a comprehensive benefits package including medical, dental, and retirement plans. Employees enjoy generous paid time off and numerous opportunities for professional development, including training programs, certifications, and attendance at industry conferences. The hybrid work arrangement offers flexibility while fostering team collaboration within our office in Vereeniging, Gauteng, ZA . We are committed to fostering an inclusive and innovative work environment where engineers can grow their careers. Additional perks include performance bonuses and wellness programs.

Join a leading company at the forefront of AI innovation and contribute to building the foundation for cutting-edge AI solutions.