Remote AI Infra Architect for Scalable ML Systems

Placements24; Midrand; Hybrid; ZAR 1,976,000 - 2,964,000; Full time

Benefits offered by this job

Bonuses

Remote work

Health insurance

Stock options

Unlimited PTO

Learning budget

Home office stipend

Retirement plan

Job summary

Placements24 is seeking a Senior AI Infrastructure Engineer for a fully remote role. You will design, build, and maintain scalable AI infrastructure, including GPU clusters, storage, networking, and CI/CD pipelines for ML workloads.

You will collaborate with a global team of engineers, data scientists, and researchers, ensuring secure, compliant, and high-performing systems and continuing improvements in AI platforms.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of infrastructure engineering experience with a focus on AI/ML platforms.
• Experience with cloud platforms (AWS, Azure, GCP) and services (EC2, S3, EKS/AKS/GKE).
• Strong experience with containerization (Docker, Kubernetes).
• Scripting (Python, Bash) and Infrastructure as Code tools.
• Understanding of networking concepts and distributed systems.
• Experience with monitoring/logging (Prometheus, Grafana).
• Familiarity with ML frameworks (TensorFlow, PyTorch) and MLOps is a plus.
• Strong problem-solving and remote collaboration skills.

Responsibilities

• Design, deploy, and manage infrastructure for AI/ML workloads (GPU clusters, distributed storage).
• Optimize performance for large-scale model training and inference.
• Implement and manage CI/CD pipelines for ML models and IaC.
• Develop monitoring, logging, and alerting systems for AI infra.
• Automate provisioning and configuration using Terraform/Ansible.
• Ensure security and compliance of AI infrastructure.
• Collaborate with AI/ML engineers to understand needs and provide support.
• Troubleshoot complex infra issues quickly.
• Stay updated on cloud, containerization, and AI infra trends.
• Contribute to architectural decisions and roadmaps.

Skills

AI/ML infra

Cloud platforms

Terraform/Ansible

Docker & Kubernetes

Python scripting

Networking basics

Monitoring tools

Education

Bachelor's or Master's in CS/Engineering

Tools

Terraform

Ansible

Docker

Kubernetes

Prometheus

Grafana

CI/CD tools

Job description

Placements24 is seeking a Senior AI Infrastructure Engineer for a fully remote role. You will design, build, and maintain scalable AI infrastructure, including GPU clusters, storage, networking, and CI/CD pipelines for ML workloads.

You will collaborate with a global team of engineers, data scientists, and researchers, ensuring secure, compliant, and high-performing systems and continuing improvements in AI platforms.