Senior AI Software Engineer - Deep Learning Infrastructure

Placements24; Upington; Hybrid; ZAR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Health insurance

Home office budget

Equipment provided

Professional development

Flexible hours

Remote work

Stock options

Team events

Job summary

Placements24 is seeking a Senior AI Software Engineer specializing in Deep Learning Infrastructure to join our fully remote team. You will design, build, and optimize scalable ML infrastructure, enabling researchers to train large models efficiently.

The ideal candidate has 5+ years in distributed systems, strong Python and C++, experience with TensorFlow/PyTorch/JAX, containers, Kubernetes, and cloud ML services. You will collaborate across time zones to deliver robust, secure ML platforms.

Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
• 5+ years of software engineering with a focus on distributed systems or ML infrastructure.
• Strong Python and proficiency in C++ programming.
• Experience with DL frameworks such as TensorFlow, PyTorch, or JAX.
• Hands-on experience with Docker and Kubernetes.
• Familiarity with cloud ML services (AWS, GCP, Azure) and MLOps concepts.

Responsibilities

• Design, develop, and maintain scalable deep learning infrastructure.
• Optimize resources for training and inference of large-scale models.
• Implement and manage distributed training frameworks (Horovod, TensorFlow distributed).
• Develop containerization (Docker) and orchestration (Kubernetes) for ML workloads.
• Collaborate with researchers/engineers to understand infrastructure needs.
• Apply MLOps best practices including CI/CD, monitoring, and logging.

Skills

Python

C++

Distributed systems

ML infrastructure

TensorFlow

PyTorch

JAX

Docker

Kubernetes

MLOps

Education

Bachelor's or Master's in CS/SE

Tools

Docker

Kubernetes

Horovod

Job description

About the Role

Our client is at the forefront of AI innovation, building cutting-edge deep learning models and applications that are transforming industries. We are seeking a highly skilled Senior AI Software Engineer specializing in Deep Learning Infrastructure to join our dynamic, fully remote team. This role is pivotal in designing, building, and optimizing the infrastructure that powers our AI development and deployment efforts. You will work with distributed systems, high-performance computing, and state-of-the-art ML frameworks to enable our researchers and engineers to push the boundaries of AI. As a fully remote position, you'll enjoy the flexibility to work from anywhere, collaborating with a world-class team through advanced communication tools.

Key Responsibilities

• Design, develop, and maintain scalable and robust deep learning infrastructure.
• Optimize computational resources for efficient training and inference of large-scale models.
• Implement and manage distributed training frameworks (e.g., Horovod, TensorFlow distributed).
• Develop and maintain containerization solutions (Docker) and orchestration platforms (Kubernetes) for ML workloads.
• Collaborate with AI researchers and engineers to understand their infrastructure needs.
• Implement best practices for MLOps, including CI/CD, monitoring, and logging for ML systems.
• Evaluate and integrate new hardware and software technologies to enhance AI infrastructure capabilities.
• Troubleshoot and resolve complex performance and reliability issues in the ML infrastructure.
• Contribute to the architecture and design of future AI infrastructure components.
• Ensure the security and compliance of the AI development environment.

Requirements

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field.
• 5+ years of experience in software engineering, with a significant focus on building and managing large-scale distributed systems or ML infrastructure.
• Strong programming skills in Python and proficiency in C++.
• Experience with deep learning frameworks such as TensorFlow, PyTorch, or JAX.
• Hands-on experience with containerization (Docker) and orchestration (Kubernetes).
• Familiarity with cloud platforms (AWS, GCP, Azure) and their ML services.
• Knowledge of MLOps principles and tools.
• Experience with performance tuning and optimization of complex systems.
• Excellent problem-solving, debugging, and analytical skills.
• Strong communication and collaboration skills for remote teamwork.
• Proactive and self-motivated individual with a passion for building scalable infrastructure.

Benefits

• Highly competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance plans.
• Generous home office setup budget and equipment provision.
• Unlimited professional development opportunities, including training and conferences.
• Opportunity to work on cutting-edge AI infrastructure with a leading company.
• Flexible work hours and a fully remote working environment.
• Annual bonus and potential for stock options.
• Company-sponsored virtual team events and activities.