Senior AI Infrastructure Engineer

Placements24

South Africa

Remote

ZAR 1,200,000 - 1,800,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
Retirement savings plans
Generous paid time off

Job summary

Placements24 is seeking a Senior AI Infrastructure Engineer to join a fully remote team. You will design, build, and maintain scalable AI/ML infrastructure on AWS/Azure/GCP, with CI/CD pipelines for models and infra, plus data storage and security considerations.

The role emphasizes collaboration with data scientists, automation of provisioning, and Kubernetes/Docker management in a remote work environment.

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field (Master's preferred).
  • 5+ years in infrastructure engineering with AI/ML focus.
  • Experience with AWS/Azure/GCP and cloud services.
  • Proficient with Docker and Kubernetes.

Responsibilities

  • Design, build, and maintain scalable AI/ML infra on cloud platforms.
  • Develop and manage CI/CD pipelines for ML models and infra.
  • Optimize data storage, processing, and model training at scale.
  • Monitor performance, identify bottlenecks, and optimize systems.
  • Ensure security and compliance of AI infra and data.
  • Collaborate with data scientists to meet infra needs.
  • Automate provisioning, config, and deployment processes.
  • Manage containerization for ML workloads.
  • Stay updated with AI infra and MLOps trends.

Skills

Cloud platforms (AWS/Azure/GCP)
Docker
Kubernetes
MLflow
Kubeflow
SageMaker
Python
Bash
Terraform
Ansible
Distributed systems
Networking and security
Remote collaboration

Education

Bachelor's degree in CS/Engineering
Master's degree (preferred)

Tools

Docker
Kubernetes
MLflow
Kubeflow
SageMaker
Terraform
Ansible

Job description

About the Role

Our client is looking for a Senior AI Infrastructure Engineer to join their innovative and fully remote team. This role is central to building and maintaining the robust, scalable, and high-performance infrastructure required to support cutting-edge AI and machine learning development and deployment. You will be instrumental in designing, implementing, and optimizing the systems that power our AI initiatives, ensuring reliability, efficiency, and security. This position requires deep expertise in cloud computing, distributed systems, and MLOps practices.

Key Responsibilities
  • Design, build, and maintain scalable and reliable AI/ML infrastructure on cloud platforms (e.g., AWS, Azure, GCP).
  • Develop and manage CI/CD pipelines for machine learning models and infrastructure.
  • Implement and optimize systems for data storage, processing, and model training at scale.
  • Monitor infrastructure performance, identify bottlenecks, and implement solutions for optimization.
  • Ensure the security and compliance of AI infrastructure and data.
  • Collaborate with data scientists and ML engineers to understand their infrastructure needs and provide solutions.
  • Automate infrastructure provisioning, configuration management, and deployment processes.
  • Manage containerization technologies (Docker, Kubernetes) for ML workloads.
  • Stay up-to-date with the latest trends and best practices in AI infrastructure and MLOps.
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree is a plus.
  • 5+ years of experience in infrastructure engineering, with a strong focus on AI/ML environments.
  • Proven experience with cloud computing platforms (AWS, Azure, GCP) and their associated services.
  • Expertise in containerization technologies like Docker and orchestration tools like Kubernetes.
  • Strong understanding of MLOps principles and tools (e.g., MLflow, Kubeflow, Sagemaker).
  • Proficiency in scripting languages (e.g., Python, Bash) and infrastructure as code tools (e.g., Terraform, Ansible).
  • Experience with distributed systems, high-performance computing, and storage solutions.
  • Solid understanding of networking, security, and system administration principles.
  • Excellent problem-solving skills and ability to work independently in a remote setting.
  • Strong communication and collaboration skills.
Benefits

This role offers a highly competitive salary and performance-based bonuses, along with a comprehensive benefits package including health insurance, retirement savings plans, and generous paid time off. As a fully remote position, we prioritize work-life balance and provide resources to support a productive home office environment. Opportunities for professional development and learning are abundant.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Placements24 • Midrand

Hybrid
ZAR 1,976,000 - 2,964,000
Bonuses
Remote work
Health insurance
+5
Ai Platform Engineer - Scalability & Performance
Ai Platform Engineer - Scalability & Performance

Placements24 • Gauteng

Remote
ZAR 900,000 - 1,500,000
Health insurance
Dental insurance
Vision insurance
+4
AI Platform Engineer - Cloud Infrastructure
AI Platform Engineer - Cloud Infrastructure

Placements24 • Paarl

Hybrid
ZAR 900,000 - 1,200,000
Health insurance
Remote work flexibility
Training resources and certifications
+2
Principal AI Engineer - Deep Learning Platforms
Principal AI Engineer - Deep Learning Platforms

Placements24 • Sandton

Hybrid
ZAR 3,048,000 - 4,064,000
Equity compensation
Performance bonuses
Global health coverage
+1
Senior Ai Software Engineer - Deep Learning Infrastructure
Senior Ai Software Engineer - Deep Learning Infrastructure

Placements24 • Upington

Hybrid
ZAR 1,200,000 - 1,800,000
Health insurance
Home office budget
Equipment provided
+5
Remote AI Engineer - MLOps Specialist
Remote AI Engineer - MLOps Specialist

Placements24 • Gqeberha

Hybrid
ZAR 600,000 - 900,000
Health benefits
Annual leave
Paid sick leave
+3
Senior AI Engineer - Deep Learning Infrastructure
Senior AI Engineer - Deep Learning Infrastructure

Placements24 • Mbombela (Nelspruit)

Hybrid
ZAR 1,200,000 - 1,800,000
Remote AI Platform Engineer
Remote AI Platform Engineer

Placements24 • Polokwane

Hybrid
ZAR 900,000 - 1,400,000
Fully remote work arrangement
Competitive salary and bonuses
Health insurance and wellness programs
+1
Remote Principal AI Engineer - Cloud Infrastructure
Remote Principal AI Engineer - Cloud Infrastructure

Placements24 • Pretoria

Hybrid
ZAR 2,953,000 - 4,266,000
Health benefits
Retirement plan
Professional development budget
+2
Senior Machine Learning Engineer (Remote)
Senior Machine Learning Engineer (Remote)

Placements24 • LegKraal Gate

Hybrid
ZAR 2,133,000 - 2,953,000
Salary + bonuses
Stock options
Health, dental, vision insurance
+2