Senior AI/ML Infrastructure Engineer

Placements24; Soweto; Hybrid; ZAR 1,200,000 - 1,800,000; Full time

Job summary

Placements24 seeks a Senior AI/ML Infrastructure Engineer to design, build, and maintain scalable AI/ML infrastructure for model development, training, and deployment.

This fully remote role focuses on optimizing cloud environments (AWS/Azure/GCP), implementing IaC with Terraform/Ansible, and collaborating with ML teams to accelerate experimentation and production readiness, with Soweto, Gauteng context in mind.

Qualifications

• Requires 6+ years of infrastructure engineering experience with AI/ML platforms.
• Proven ability to design, build and run scalable cloud infra (AWS, Azure, GCP).
• Strong scripting, IaC, and automation skills; familiarity with MLOps.

Responsibilities

• Design, implement and manage scalable AI/ML infrastructure for compute, storage, and networking.
• Optimize cloud environments for cost, performance, and reliability.
• Develop and maintain CI/CD pipelines for ML models and infra deployments.

Skills

Cloud platforms

Containerization

Scripting

IaC

MLOps

CI/CD

Networking & Security

Education

Bachelor's or Master's in CS/Engineering

Tools

Terraform

Ansible

Docker

Kubernetes

Python

Job description

About the Role

Our client is seeking a highly experienced Senior AI/ML Infrastructure Engineer to design, build, and maintain the robust and scalable infrastructure required to support our advanced artificial intelligence and machine learning initiatives. This role is critical for enabling our data science and engineering teams to develop, train, and deploy complex models efficiently. You will be responsible for optimizing hardware and software resources, managing cloud environments, and ensuring the reliability and performance of our AI/ML platforms. This is a fully remote opportunity, allowing you to contribute to our cutting-edge AI projects from anywhere, while still impacting the broader technological ecosystem relevant to **Soweto, Gauteng, ZA**. Join us to build the foundational systems that power the next generation of AI.

Key Responsibilities

• Design, implement, and manage scalable and reliable AI/ML infrastructure, including compute, storage, and networking.
• Optimize cloud environments (AWS, Azure, GCP) for AI/ML workloads, focusing on cost-efficiency and performance.
• Develop and maintain CI/CD pipelines for ML model deployment and infrastructure management.
• Implement and manage containerization technologies (Docker, Kubernetes) for ML applications.
• Monitor system performance, identify bottlenecks, and implement solutions for optimization.
• Collaborate with data scientists and ML engineers to understand their infrastructure needs.
• Automate infrastructure provisioning, configuration, and management using Infrastructure as Code (IaC) tools.
• Ensure the security and compliance of the AI/ML infrastructure.
• Stay current with the latest trends and best practices in cloud computing and AI/ML infrastructure.
• Provide technical guidance and mentorship to junior team members.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 6+ years of experience in infrastructure engineering, with a strong focus on AI/ML platforms and cloud environments.
• Proven experience designing and managing scalable cloud infrastructure (AWS, Azure, GCP).
• Expertise in containerization (Docker) and orchestration (Kubernetes).
• Strong scripting skills (Python, Bash) and experience with IaC tools (Terraform, Ansible).
• Familiarity with MLOps principles and practices.
• Solid understanding of networking, security, and system administration concepts.
• Experience with performance monitoring and logging tools.
• Excellent problem-solving, analytical, and communication skills.
• Ability to thrive in a fully remote work environment and collaborate effectively across distributed teams, with an understanding of the **Soweto, Gauteng, ZA** context.

Benefits

Our client offers a highly competitive salary, comprehensive health and wellness benefits, retirement savings plans, and numerous opportunities for professional growth and continuous learning. Enjoy the flexibility and autonomy of a fully remote role, working on challenging and impactful AI projects. We provide a supportive and innovative work culture, generous paid time off, and the chance to be at the forefront of AI infrastructure development.