Software/ML Engineer

AfterQuery

South Africa

Remote

ZAR 900,000 - 1,300,000

Part time

19 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work
Flexible scheduling
Contract role

Job summary

AfterQuery is assembling a group of senior software and ML engineers to tackle open problems in AI, focusing on LLM inference systems, GPU optimization, and scalable model-serving architectures. This is a research-and-evaluation role where you define what counts as correct and excellent in AI model performance.

You will design evaluation scenarios, craft reference solutions, and grade model outputs on complex systems-engineering challenges, collaborating with peers who share deep domain

Qualifications

  • Bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or related field.
  • Hands-on background in GPU inference optimization, CUDA kernel development, and model-serving systems.
  • Experience at a recognized tech or AI company with systems-engineering ownership.
  • Strong written communication—authoring technical explanations and feedback, not just code.

Responsibilities

  • Design realistic technical scenarios and problem sets in LLM inference optimization, GPU kernel design, and systems performance engineering.

Skills

GPU inference optimization
CUDA kernel development
model-serving systems
quantization
optimizer design
strong written communication

Education

Bachelor's degree or higher in CS/CE/EE

Job description

We're assembling a group of senior software and ML engineers to work on one of the hardest open problems in AI today: how well can frontier models reason about LLM inference systems, GPU-level performance optimization, and model-serving architecture? You'll help design evaluation scenarios, write reference solutions, and grade model outputs on real systems-engineering problems - the same class of problems you likely work on day-to-day.

This is a research-and-evaluation role, not a traditional engineering job - you won't be shipping production code for us, you'll be defining what "correct" and "excellent" look like for AI models tackling the problems you already know deeply.

Responsibilities
  • What You'll Do Design realistic technical scenarios and problem sets in LLM inference optimization, GPU kernel design, and systems performance engineering
Required Qualifications
  • Bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or a related field
  • Strong, hands-on background in one or more of: GPU inference optimization, custom CUDA kernel development, model-serving systems (e.g., vLLM, TensorRT-LLM, SGLang), quantization, or optimizer design
  • Experience at a recognized technology or AI company, in a role with real systems-engineering ownership
  • Strong written communication - you'll be authoring technical explanations and feedback, not just code
Preferred Qualifications
  • Direct experience with SGLang, Mamba/Mamba2 architectures, or IBM Granite-family models
  • Open-source contributions to inference/serving frameworks (vLLM, SGLang, TensorRT-LLM, etc.)
  • Experience with distributed inference (tensor/expert parallelism, continuous batching, KV-cache optimization)
Why apply
  • Remote, contract, part-time
  • Flexible - work on your own schedule
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer
AI Engineer

Vaimo • Pretoria

On-site
ZAR 600,000 - 800,000
Remote Research ML & Systems Evaluation Engineer
Remote Research ML & Systems Evaluation Engineer

AfterQuery • South Africa

Remote
ZAR 900,000 - 1,300,000
Remote work
Flexible scheduling
Contract role
Ai/Ml Software Engineer - Deep Learning Applications
Ai/Ml Software Engineer - Deep Learning Applications

Placements24 • Upington

Hybrid
ZAR 900,000 - 1,200,000
Competitive salary
Fully remote
Professional development
+2
Senior Applied AI Engineer Level 1
Senior Applied AI Engineer Level 1

Derivco • Durban

On-site
ZAR 900,000 - 1,500,000
Remote Ai Engineer: Production Llm & Automation
Remote Ai Engineer: Production Llm & Automation

Blacksmith Agency LLC • South Africa

Remote
ZAR 1,524,000 - 2,539,000
Salary package
Remote work flexibility
Home office stipend
+2
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Placements24 • South Africa

Remote
ZAR 1,200,000 - 1,800,000
Health insurance
Retirement savings plans
Generous paid time off
Senior Software Engineer, Applied AI
Senior Software Engineer, Applied AI

AiR • George

On-site
ZAR 900,000 - 1,300,000
Lead AI/ML Operations (MLOps) Engineer
Lead AI/ML Operations (MLOps) Engineer

Placements24 • East London

Hybrid
ZAR 1,000,000 - 1,800,000
Competitive salary
Bonus potential
Medical, dental, retirement plans
+2
AI Software Engineer (Remote, Springs)
AI Software Engineer (Remote, Springs)

Blacksmith Agency LLC • South Africa

Remote
ZAR 1,524,000 - 2,539,000
Remote work with regional scope
Principal AI Engineer - Deep Learning Platforms
Principal AI Engineer - Deep Learning Platforms

Placements24 • Sandton

Hybrid
ZAR 3,048,000 - 4,064,000
Equity compensation
Performance bonuses
Global health coverage
+1