Senior AI Infrastructure Engineer

Placements24; Midrand; Hybrid; ZAR 1,976,000 - 2,964,000; Full time

Benefits offered by this job

Bonuses

Remote work

Health insurance

Stock options

Unlimited PTO

Learning budget

Home office stipend

Retirement plan

Job summary

Placements24 is seeking a Senior AI Infrastructure Engineer for a fully remote role. You will design, build, and maintain scalable AI infrastructure, including GPU clusters, storage, networking, and CI/CD pipelines for ML workloads.

You will collaborate with a global team of engineers, data scientists, and researchers, ensuring secure, compliant, and high-performing systems and continuing improvements in AI platforms.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of infrastructure engineering experience with a focus on AI/ML platforms.
• Experience with cloud platforms (AWS, Azure, GCP) and services (EC2, S3, EKS/AKS/GKE).
• Strong experience with containerization (Docker, Kubernetes).
• Scripting (Python, Bash) and Infrastructure as Code tools.
• Understanding of networking concepts and distributed systems.
• Experience with monitoring/logging (Prometheus, Grafana).
• Familiarity with ML frameworks (TensorFlow, PyTorch) and MLOps is a plus.
• Strong problem-solving and remote collaboration skills.

Responsibilities

• Design, deploy, and manage infrastructure for AI/ML workloads (GPU clusters, distributed storage).
• Optimize performance for large-scale model training and inference.
• Implement and manage CI/CD pipelines for ML models and IaC.
• Develop monitoring, logging, and alerting systems for AI infra.
• Automate provisioning and configuration using Terraform/Ansible.
• Ensure security and compliance of AI infrastructure.
• Collaborate with AI/ML engineers to understand needs and provide support.
• Troubleshoot complex infra issues quickly.
• Stay updated on cloud, containerization, and AI infra trends.
• Contribute to architectural decisions and roadmaps.

Skills

AI/ML infra

Cloud platforms

Terraform/Ansible

Docker & Kubernetes

Python scripting

Networking basics

Monitoring tools

Education

Bachelor's or Master's in CS/Engineering

Tools

Terraform

Ansible

Docker

Kubernetes

Prometheus

Grafana

CI/CD tools

Job description

About the Role

Our client is scaling its cutting-edge AI capabilities and is looking for a highly experienced Senior AI Infrastructure Engineer for a fully remote role. You will be responsible for designing, building, and maintaining the robust, scalable, and efficient infrastructure that powers our AI and machine learning workloads. This includes managing compute resources, storage, networking, and deployment pipelines essential for AI model training and inference. As a remote-first team member, you will collaborate with a global team of engineers, data scientists, and researchers, ensuring the seamless operation and continuous improvement of our AI platform. Your expertise will be critical in enabling rapid innovation and deployment of AI solutions.

Key Responsibilities

• Design, deploy, and manage scalable and reliable infrastructure for AI/ML workloads (e.g., GPU clusters, distributed storage).
• Optimize infrastructure performance for large-scale model training and inference.
• Implement and manage CI/CD pipelines for ML models and infrastructure as code.
• Develop and maintain monitoring, logging, and alerting systems for AI infrastructure.
• Automate infrastructure provisioning, configuration, and management using tools like Terraform or Ansible.
• Ensure the security and compliance of the AI infrastructure.
• Collaborate with AI/ML engineers and data scientists to understand their infrastructure needs and provide support.
• Troubleshoot and resolve complex infrastructure issues in a timely manner.
• Stay current with the latest trends in cloud computing, containerization (Docker, Kubernetes), and AI infrastructure.
• Contribute to the architectural decisions and technical roadmap for AI infrastructure.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience (5+ years) in infrastructure engineering, with a strong focus on AI/ML platforms.
• Expertise in cloud platforms (AWS, Azure, GCP) and their relevant services (e.g., EC2, S3, EKS/AKS/GKE).
• Strong experience with containerization technologies (Docker, Kubernetes).
• Proficiency in scripting languages (e.g., Python, Bash) and Infrastructure as Code (IaC) tools.
• Understanding of networking concepts and distributed systems.
• Experience with monitoring tools (e.g., Prometheus, Grafana) and logging frameworks.
• Familiarity with ML frameworks (TensorFlow, PyTorch) and MLOps principles is a plus.
• Excellent problem-solving and debugging skills.
• Strong communication and collaboration abilities in a remote environment.

Benefits

• Highly competitive salary and performance bonuses.
• Fully remote work flexibility.
• Comprehensive health, dental, and vision insurance.
• Generous stock options.
• Unlimited paid time off.
• Annual budget for learning and development (conferences, courses, books).
• Home office equipment allowance.
• Retirement savings plan with company contribution.