Autonomous AI Scientist — RL, LLMs, Production Systems

NinjaTech AI; Sydney; On-site; AUD 180,000 - 280,000; Full time

Job summary

NinjaTech AI is building autonomous AI employees and deploys agents that plan, reason, use tools, and execute tasks at scale. As a Senior Applied Scientist, you’ll lead applied research in reinforcement learning, LLM training, model optimization, and multimodal AI, owning models and systems powering Ninja's products.

Focus areas include RL, PPO, RLHF, transformer models, data generation, and production-grade ML pipelines.

Qualifications

• Master’s degree or PhD in CS, ML, applied math, statistics or related field.
• Significant experience building end-to-end ML systems from data to production.
• Deep understanding of ML, DL, statistics, optimization and algorithms.
• Hands-on experience with RL methods such as PPO and RLHF.
• Experience training, fine-tuning, evaluating and deploying transformer-based language models.
• Strong Python; Rust is highly valued.
• Deep experience with PyTorch and ML tooling.
• Experience with distributed and multi-GPU training, mixed precision, quantization, ONNX.
• Proficiency in NLP/IR tasks and knowledge extraction or speech processing is a plus.
• Ability to bridge research and engineering with strong analytical instincts.

Responsibilities

• Research, prototype, train, evaluate, and deploy advanced ML and LLM systems.
• Develop state-of-the-art RL techniques like RLHF to improve reasoning and task performance.
• Design large-scale training datasets and data-mining techniques.
• Train, fine-tune, distill, quantize, and optimize LLMs for production.
• Build high-performance multi-GPU training and inference pipelines.
• Develop rigorous evaluation frameworks and experimentation systems.
• Design experiments including A/B tests to validate improvements.
• Write high-quality Python and Rust code for production systems.
• Optimize algorithms for latency, throughput, and memory efficiency.
• Advance NLP, speech capabilities, and ship capabilities to customers.

Skills

Reinforcement learning

RLHF

PPO

Transformer models

Language models

Production deployment

Experimentation and evaluation

Python

Rust

PyTorch

ML tooling

Distributed training

Education

Master’s degree or PhD in Computer Science, ML, Applied Mathematics, Statistics, Engineering, or related field

Tools

PyTorch

Python

Rust

ONNX

Job description

NinjaTech AI is building autonomous AI employees and deploys agents that plan, reason, use tools, and execute tasks at scale. As a Senior Applied Scientist, you’ll lead applied research in reinforcement learning, LLM training, model optimization, and multimodal AI, owning models and systems powering Ninja's products.

Focus areas include RL, PPO, RLHF, transformer models, data generation, and production-grade ML pipelines.