AI Infrastructure Engineer

Placements24; Centurion; Hybrid; ZAR 900,000 - 1,200,000; Full time

Benefits offered by this job

Hybrid work model

Stock options / bonuses

Professional development & certs

Generous PTO

Job summary

Placements24 in Centurion, Gauteng, ZA is seeking an experienced AI Infrastructure Engineer to design, build and maintain scalable infrastructure for AI/ML workloads. You will work with cutting-edge hardware and software to ensure performance, reliability and security across training and inference pipelines.

The role requires strong systems engineering and cloud expertise, plus GPU management and HPC experience.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Minimum 5 years in systems engineering, cloud infra, or DevOps with AI/ML focus.
• Experience with AWS/Azure/GCP and Terraform/Ansible.
• Strong containerization knowledge (Docker/Kubernetes).
• Scripting skills in Python or Bash.

Responsibilities

• Design, deploy, and manage AI/ML infrastructure at scale.
• Manage cloud and on-prem environments (AWS/Azure/GCP).
• Optimize for performance, cost, and security.
• Implement and manage Terraform and Ansible provisioning.
• Operate GPU clusters and HPC environments.
• Collaborate with data scientists and ML engineers.
• Ensure infrastructure security and compliance.

Skills

Cloud infrastructure

DevOps practices

Python

Bash

Networking & security

CI/CD

Team collaboration

Education

Bachelor's degree in Computer Science/Engineering

Tools

Terraform

Ansible

Docker

Kubernetes

AWS

Azure

GCP

Python

Job description

About the Role

Our client is looking for an experienced AI Infrastructure Engineer to join their expanding technology team in Centurion, Gauteng, ZA. This crucial role involves designing, building, and maintaining the robust infrastructure required to support large-scale AI and machine learning workloads. You will work with cutting-edge hardware and software, ensuring optimal performance, scalability, and reliability for our AI development and deployment pipelines. The ideal candidate has a strong background in systems engineering, cloud computing, and a deep understanding of the specific needs of AI infrastructure, including GPU management and distributed computing. You will play a key part in enabling the company's ambitious AI initiatives. The Centurion, Gauteng, ZA location offers a dynamic tech ecosystem.

Key Responsibilities

• Design, deploy, and manage scalable and reliable infrastructure for AI/ML workloads (e.g., training, inference).
• Manage cloud-based environments (AWS, Azure, GCP) and on-premises infrastructure.
• Optimize infrastructure for performance, cost-efficiency, and security.
• Implement and manage containerization technologies (Docker, Kubernetes).
• Configure and maintain GPU clusters and other specialized hardware for deep learning.
• Develop and automate infrastructure provisioning and management using tools like Terraform and Ansible.
• Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability.
• Collaborate with data scientists and ML engineers to understand their infrastructure requirements.
• Implement and enforce best practices for infrastructure security and compliance.
• Stay current with emerging trends in AI infrastructure, cloud computing, and DevOps.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Minimum of 5 years of experience in systems engineering, cloud infrastructure, or DevOps, with a focus on AI/ML infrastructure.
• Proven experience managing cloud platforms (AWS, Azure, GCP) and infrastructure-as-code tools (Terraform, Ansible).
• Strong understanding of containerization technologies (Docker, Kubernetes).
• Experience with high-performance computing (HPC) environments and GPU management is highly desirable.
• Proficiency in scripting languages such as Python, Bash.
• Knowledge of networking concepts and security best practices.
• Experience with CI/CD pipelines and tools.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration abilities.
• Experience working with large-scale data processing frameworks is a plus.

Benefits

• Competitive salary and comprehensive benefits package.
• Opportunity to work at the forefront of AI infrastructure technology.
• Exposure to diverse and challenging AI projects.
• Hybrid work model providing flexibility.
• Professional development opportunities and support for certifications.
• Dynamic and collaborative work environment in Centurion, Gauteng, ZA.
• Generous paid time off and employee perks.
• Potential for stock options or performance bonuses.