Principal AI Engineer - Deep Learning Platforms

Placements24

Sandton

Hybrid

ZAR 3,048,000 - 4,064,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity compensation
Performance bonuses
Global health coverage
Generous PTO

Job summary

Placements24 is seeking a Principal AI Engineer to lead scalable, deep learning infrastructure in a fully remote setting. You will architect distributed training, optimize models, and manage cloud resources across AWS, GCP, and Azure to support a global AI research team.

You will drive CI/CD pipelines, mentor engineers, and set high standards for performance, reliability, and security of the AI platform. A strong background in HPC and distributed systems is required.

Qualifications

  • Ph.D. or Master’s degree in Computer Science, Engineering, or a related quantitative field.
  • Minimum of 10 years of software engineering experience, with at least 7 years in AI/ML infrastructure, deep learning, or HPC.
  • Proven experience designing and managing large-scale distributed systems.

Responsibilities

  • Lead the design, development, and maintenance of scalable, high-performance deep learning infrastructure.
  • Architect and implement solutions for distributed training, model optimization, and efficient inference.
  • Manage and optimize cloud-based AI infrastructure (AWS, GCP, Azure) for deep learning workloads.
  • Develop and maintain robust CI/CD pipelines for deep learning models and infrastructure.
  • Collaborate with AI/ML researchers and engineers to understand their needs and provide scalable solutions.
  • Ensure the reliability, scalability, and security of the deep learning platform.
  • Evaluate and integrate new technologies to enhance the AI ecosystem.
  • Troubleshoot complex issues across distributed systems and hardware.
  • Mentor junior engineers and contribute to the team’s technical growth.
  • Drive best practices in MLOps and performance tuning.

Skills

Distributed systems
Leadership
Problem solving
Remote work

Education

Ph.D. or Master’s in CS/Engineering

Tools

TensorFlow
PyTorch
Kubernetes
Terraform
CI/CD pipelines
Python
C++
AWS
GCP
Azure

Job description

About the Role

Our client is seeking an exceptional Principal AI Engineer to lead the development and scaling of their deep learning platforms within a fully remote setting. This is a high-impact, senior role focused on building the foundational infrastructure that empowers our AI research and development teams globally. You will be instrumental in designing, implementing, and optimizing high-performance computing environments for deep learning workloads, ensuring our researchers have the tools they need to innovate. The ideal candidate possesses extensive experience in distributed systems, high-performance computing, cloud infrastructure, and a deep understanding of deep learning frameworks and their operational requirements. You will be a key technical leader, driving architectural decisions and setting standards for our AI platform. We are looking for a visionary engineer who thrives in a fast-paced, autonomous remote environment and is passionate about enabling breakthroughs in artificial intelligence through state-of-the-art infrastructure.

Key Responsibilities
  • Lead the design, development, and maintenance of scalable, high-performance deep learning infrastructure.
  • Architect and implement solutions for distributed training, model optimization, and efficient inference.
  • Manage and optimize cloud-based AI infrastructure (e.g., AWS, GCP, Azure) for deep learning workloads.
  • Develop and maintain robust CI/CD pipelines for deep learning models and infrastructure.
  • Collaborate closely with AI/ML researchers and engineers to understand their needs and provide scalable solutions.
  • Ensure the reliability, scalability, and security of the deep learning platform.
  • Evaluate and integrate new technologies and tools to enhance the AI development ecosystem.
  • Troubleshoot complex issues across distributed systems and hardware.
  • Mentor junior engineers and contribute to the technical growth of the team.
  • Drive best practices in MLOps, performance tuning, and infrastructure management for deep learning.
Requirements
  • Ph.D. or Master's degree in Computer Science, Engineering, or a related quantitative field.
  • Minimum of 10 years of experience in software engineering, with at least 7 years focused on AI/ML infrastructure, deep learning, or high-performance computing.
  • Proven experience designing and managing large-scale distributed systems.
  • Deep expertise with deep learning frameworks (e.g., TensorFlow, PyTorch) and their deployment.
  • Strong proficiency in cloud platforms (AWS, GCP, Azure) and their relevant services.
  • Expertise in infrastructure-as-code (e.g., Terraform) and configuration management tools.
  • Experience with container orchestration (e.g., Kubernetes) and CI/CD tools.
  • Excellent programming skills in Python, C++, or similar languages.
  • Strong understanding of hardware accelerators (GPUs, TPUs) and their utilization.
  • Exceptional problem-solving, architectural design, and leadership skills.
  • This role is fully remote, requiring strong self-direction and communication.
Benefits

Our client offers a top-tier compensation package, including a highly competitive base salary, significant performance bonuses, and equity options. Benefits include comprehensive global health coverage, a leading retirement savings plan, and extensive paid time off. This position provides unparalleled opportunities to work on the cutting edge of AI infrastructure, influence technological direction, and contribute to world-changing innovations. Access to leading-edge hardware, software, and resources is guaranteed. The fully remote nature of this role offers exceptional flexibility and work-life balance, connecting you with a world-class team regardless of location.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal AI Engineer - Deep Learning
Principal AI Engineer - Deep Learning

Placements24 • Sandton

Hybrid
ZAR 4,399,000 - 6,430,000
Executive-level compensation
Bonuses/Stock options
Health, dental, vision insurance
+9
Remote Principal AI Engineer - Deep Learning
Remote Principal AI Engineer - Deep Learning

Placements24 • LegKraal Gate

Hybrid
ZAR 1,200,000 - 2,600,000
Stock options
Remote work stipend
Health insurance
+2
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Placements24 • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Health insurance
Retirement savings plans
Generous paid time off
Senior Ai Software Engineer - Deep Learning Infrastructure
Senior Ai Software Engineer - Deep Learning Infrastructure

Placements24 • Upington

Hybrid
ZAR 1,200,000 - 1,800,000
Health insurance
Home office budget
Equipment provided
+5
Principal Ai Architect - Machine Learning Platforms (Remote-First)
Principal Ai Architect - Machine Learning Platforms (Remote-First)

Placements24 • Durban

Hybrid
ZAR 1,800,000 - 3,200,000
Health insurance
Retirement contributions
Stock options
+2
Remote Principal AI Engineer - Cloud Infrastructure
Remote Principal AI Engineer - Cloud Infrastructure

Placements24 • Pretoria

Hybrid
ZAR 2,953,000 - 4,266,000
Health benefits
Retirement plan
Professional development budget
+2
Senior AI Engineer - Deep Learning Infrastructure
Senior AI Engineer - Deep Learning Infrastructure

Placements24 • Mbombela (Nelspruit)

Hybrid
ZAR 1,200,000 - 1,800,000
Principal Machine Learning Engineer
Principal Machine Learning Engineer

Placements24 • Soweto

Hybrid
ZAR 1,200,000 - 2,000,000
Health insurance
Dental insurance
Vision insurance
+4
Principal Ai Scientist (Deep Learning)
Principal Ai Scientist (Deep Learning)

Placements24 • Johannesburg

Hybrid
ZAR 2,000,000 - 3,200,000
Flexible salary & bonus structure
Fully remote position
Health and welfare benefits
+2
Lead Machine Learning Engineer - Cloud AI Platforms
Lead Machine Learning Engineer - Cloud AI Platforms

Placements24 • Cape Town

Hybrid
ZAR 2,326,000 - 3,822,000
Fully remote work setup
Stock option plan
Learning & development opportunities