Senior Software Engineer - AI Infrastructure

Placements24; Gqeberha; Hybrid; ZAR 900,000 - 1,500,000; Full time

Benefits offered by this job

Competitive salary

Remote work flexibility

Health, dental, and vision coverage

Stipend for home office setup

Professional development opportunities

Annual company retreat

Job summary

Placements24 in Port Elizabeth, South Africa, is seeking a Senior Software Engineer to design, build, and scale AI infrastructure. This is a fully remote role that enables you to collaborate with distributed teams from anywhere.

You will work on cloud AI workloads, ML pipelines, and containerized services using Docker and Kubernetes. Proficiency in Python, Go or Java, and infrastructure as code is required; you will contribute to scalable platform design, observability, security, and rapid

Qualifications

• 5+ years of experience in software engineering, focusing on scalable infrastructure.
• Proven experience with cloud platforms (AWS, Azure, GCP) and related services.
• Strong programming skills in Python, Go, or Java.
• Experience with containerization and orchestration (Docker, Kubernetes).
• Solid understanding of MLOps, CI/CD for ML models, and IaC tools (Terraform, Ansible).
• Familiarity with distributed systems and microservices architecture.
• Ability to work effectively in a remote team environment.
• Experience with monitoring and logging tools (Prometheus, Grafana, ELK).

Responsibilities

• Design, implement, and maintain scalable AI/ML infrastructure.
• Manage cloud-based infrastructure for AI workloads, optimizing cost and performance.
• Build and automate CI/CD pipelines for ML models.
• Implement and manage containerization and orchestration technologies.
• Collaborate with AI/ML researchers to meet infrastructure needs.
• Develop tools to improve AI development lifecycle efficiency.
• Monitor performance and troubleshoot to ensure high availability.
• Contribute to architectural design of the AI platform and roadmap.
• Ensure security best practices across the infrastructure.

Skills

Python

Go

Java

AWS

Azure

GCP

CI/CD

MLOps

Distributed systems

Infrastructure as code

Education

Bachelor's or Master's in Computer Science / Software Engineering

Tools

Docker

Kubernetes

Prometheus

Grafana

ELK stack

Job description

About the Role

Our client, a trailblazer in the AI solutions space, is seeking a Senior Software Engineer to focus on building and scaling AI infrastructure. This position is based in Port Elizabeth, Eastern Cape , and is offered as a fully remote opportunity, allowing you to contribute from anywhere. You will play a critical role in designing, developing, and maintaining the robust, scalable, and efficient infrastructure that powers our advanced AI models and services. This includes working with distributed systems, cloud platforms, and MLOps tools to ensure seamless operation and rapid iteration of our AI development processes. If you have a passion for building foundational systems that enable cutting-edge AI, this is the perfect role for you.

Key Responsibilities

• Design, implement, and maintain scalable and reliable infrastructure for AI/ML model training, deployment, and monitoring.
• Develop and manage cloud-based infrastructure (e.g., AWS, Azure, GCP) for AI workloads, optimizing for cost, performance, and availability.
• Build and automate CI/CD pipelines for machine learning models, ensuring efficient and consistent deployments.
• Implement and manage containerization technologies (e.g., Docker, Kubernetes) for AI applications.
• Collaborate with AI/ML researchers and engineers to understand their infrastructure needs and provide robust solutions.
• Develop tools and services to improve the efficiency and productivity of the AI development lifecycle.
• Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability and reliability.
• Contribute to the architectural design of our AI platform and infrastructure roadmap.
• Ensure security best practices are implemented and maintained across the AI infrastructure.

Requirements

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field.
• 5+ years of experience in software engineering, with a focus on building and managing scalable infrastructure.
• Proven experience with cloud platforms (AWS, Azure, GCP) and their services related to compute, storage, and networking.
• Strong programming skills in languages such as Python, Go, or Java.
• Experience with containerization technologies (Docker, Kubernetes) and orchestration tools.
• Solid understanding of MLOps principles and practices, including CI/CD for ML models.
• Familiarity with distributed systems, microservices architecture, and infrastructure as code (e.g., Terraform, Ansible).
• Excellent problem-solving and debugging skills.
• Ability to work effectively in a remote team environment.
• Experience with monitoring and logging tools (e.g., Prometheus, Grafana, ELK stack).

Benefits

• Competitive salary and performance bonuses.
• Comprehensive health, dental, and vision coverage.
• Generous paid time off and remote work flexibility.
• Opportunities for professional growth and development.
• Retirement savings plan.
• Access to cutting-edge technologies and challenging projects.
• Collaborative and innovative work culture.
• Stipend for home office setup and expenses.
• Annual company retreat.