Machine Learning Engineer Training Optimization

Jobgether; Brasil; In loco; BRL 120.000 - 210.000; Tempo pieno

Vantaggi offerti da questo lavoro

Equity opportunities

Cutting-edge projects

Ownership role

Small team

Fast feedback

Impact at scale

Continuous learning

Descrizione del lavoro

Jobgether in Brazil is seeking a Machine Learning Engineer focused on Training Optimization to join a partner-driven project. You will operate at the intersection of ML research, systems engineering, and production optimization.

This role aims to make model training faster, more stable, and cost-efficient through advanced engineering techniques, with significant ownership in training infrastructure, experimentation workflows, and AI systems.

Competenze

• Experience training large-scale neural networks and language models.
• Experience with distributed ML training systems.
• Proficiency with PyTorch and ML development workflows.
• Ability to optimize hardware-constrained training workloads.
• Experience with DeepSpeed, FSDP, Megatron is a plus.
• Open-source ML infra contributions are valued.

Mansioni

• Optimize large-scale training pipelines for throughput, convergence, stability, and efficiency.
• Improve distributed training approaches (data/model/pipeline parallelism).
• Tune optimizers, schedulers, batch sizes, and precision (bf16/fp16/fp8).
• Identify bottlenecks via profiling and system analysis.
• Collaborate with research teams on architecture-aware training strategies.
• Build and maintain reliable training infrastructure and workflows.
• Evaluate techniques like gradient checkpointing, ZeRO, FSDP, custom solutions.
• Monitor training performance metrics and improve efficiency.
• Translate research concepts into production-ready systems.

Conoscenze

Large-scale NN training

Distributed training

Production-ready code

GPU performance awareness

Strumenti

PyTorch

DeepSpeed

FSDP

Megatron

NVIDIA GPUs

Descrizione del lavoro

Machine Learning Engineer Training Optimization

Empresa : Jobgether Tipo de Emprego : Periodo Integral Brazil JobCopilot will tailor your resume and auto-fill the application

Descrição do Emprego - Machine Learning Engineer Training Optimization

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Machine Learning Engineer — Training Optimization based in Brazil.

This role offers the opportunity to improve the foundations behind large-scale AI model development and deployment.
You will work at the intersection of machine learning research, systems engineering, and production optimization.
The position focuses on making model training faster, more stable, and more cost-efficient through advanced engineering techniques.
You will optimize training pipelines, improve distributed systems, and collaborate with researchers to push model capabilities forward.
This is a high-impact opportunity for an engineer who enjoys solving complex performance challenges at scale.
You will have significant ownership in shaping training infrastructure, experimentation workflows, and the future of AI systems.

Accountabilities

As a Machine Learning Engineer focused on Training Optimization, you will improve the efficiency, scalability, and reliability of large-scale model training systems. You will combine deep technical expertise with practical engineering execution to optimize how advanced AI models are developed.

• Optimize large-scale model training pipelines to improve throughput, convergence, stability, and overall computational efficiency.
• Improve distributed training approaches, including data parallelism, model parallelism, and pipeline parallelism strategies.
• Tune key training components such as optimizers, learning rate schedulers, batch sizes, and numerical precision methods including bf16, fp16, and fp8.
• Identify and resolve performance bottlenecks through profiling, system analysis, and infrastructure-level improvements.
• Collaborate closely with research teams to develop architecture-aware training strategies and improve model performance.
• Build and maintain reliable training infrastructure, including checkpointing systems, fault tolerance mechanisms, and reproducible workflows.
• Evaluate and integrate advanced training techniques such as gradient checkpointing, ZeRO, FSDP, and custom optimization solutions.
• Define, monitor, and improve training performance metrics to continuously enhance efficiency.
• Translate research concepts into production-ready systems and scalable engineering solutions.

Requirements

The ideal candidate is a machine learning engineer with strong experience in training large neural networks and optimizing complex AI systems. You should be comfortable working across research and engineering environments while solving challenging scalability and performance problems.

• Strong experience training large-scale neural networks, including large language models or similarly complex architectures.
• Hands-on experience with machine learning training optimization, beyond simply using existing models.
• Strong understanding of backpropagation, optimization algorithms, training dynamics, and model convergence behavior.
• Experience with distributed machine learning training systems and large-scale computing environments.
• Proficiency with PyTorch and modern machine learning development workflows.
• Ability to work close to hardware constraints, including GPU performance, memory limitations, and networking considerations.
• Strong programming skills with the ability to transform research ideas into reliable production code.
• Experience with multi-node and multi-GPU training environments is highly preferred.
• Familiarity with frameworks and technologies such as DeepSpeed, FSDP, Megatron, or custom training stacks is a plus.
• Experience optimizing workloads on NVIDIA or AMD GPU platforms is beneficial.
• Contributions to open-source machine learning infrastructure or research projects are valued.
• Exposure to alternative neural network architectures beyond Transformers is a plus.

Benefits

• Competitive compensation package with meaningful equity opportunities.
• Opportunity to work on cutting-edge AI models and large-scale training systems.
• High ownership role where your contributions directly influence technical direction and company growth.
• Collaboration with a small, highly technical team focused on engineering excellence and research innovation.
• Fast feedback loops and an environment that encourages experimentation and impact.
• Opportunity to solve complex machine-learning infrastructure challenges at significant scale.
• Strong emphasis on technical quality, continuous learning, and advanced AI development.
• Ability to contribute to foundational systems shaping future AI capabilities.