LLM Finetuning Expert

LenDenClub

Mumbai

On-site

INR 3,000,000 - 5,000,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

VARTIS Platforms in Mumbai is seeking a seasoned deep learning engineer to ship production-ready models and lead multi-GPU training for 1B+ parameter architectures, with a focus on Indian languages and code-mixed text.

You will curate training data, run SFT, RLHF and fine-tuning, and build scalable inference pipelines using vLLM and Triton, collaborating with product teams to define model specs and success metrics.

Qualifications

  • 3+ years in deep learning with models shipped to production.
  • Experience training 1B+ parameter models on multi-GPU setups.
  • Experience with Transformers and PEFT/TRL or equivalents.

Responsibilities

  • Select base models (Qwen, Llama, Gemma, Mistral, Indic models) and adapt tokenizers for Indic and code-mixed text.
  • Curate training data from conversations, emails and financial documents, including synthetic data from larger teacher models.
  • Run continued pretraining, SFT and LoRA/QLoRA or full fine-tuning for text and multimodal models.
  • Align models with RLHF, reward modelling, DPO or GRPO, including verifiable rewards for numeric finance tasks.
  • Train at scale on multi-GPU, multi-node setups using FSDP, DeepSpeed or Megatron with BF16/FP8.
  • Design evaluations covering accuracy, numeric hallucination, bias and robustness; find weaknesses and fix them.
  • Build scalable inference pipelines on vLLM, Triton Inference Server, SGLang or TensorRT-LLM, with quantisation for low-latency voice use.
  • Work with product, data and business teams to turn their problems into model specs and success metrics.

Skills

Deep learning
Communication
Production ML experience

Tools

Hugging Face Transformers
PEFT
TRL
Unsloth
Axolotl
torchtune
vLLM
Triton Inference Server

Job description

About VARTIS Platforms (Formerly known as LenDenClub Techserve Pvt. Ltd.)

At VARTIS Platforms, we are a corporate group on a mission to democratize credit access and empower millions of people through cutting-edge technology. We focus on building trust and convenience, leveraging AI to drive the information revolution for smarter risk management and operational efficiency. VARTIS Platforms is profitable, rapidly scaling, and industry-recognised. Our impact has been acknowledged with top honours, including being awarded as the Best Fintech Provider by Financial Express, a testament to our product excellence, customer experience, and leadership in regulated financial technology.

LenDenClub: An RBI-licensed P2P marketplace that connects borrowers with lenders in a seamless digital ecosystem.

InstaMoney: Instant digital loans that enable quick, secure, and accessible financial support.

NiveshGold: India's next-gen digital vault for wealth preservation, starting with 100% pure, insured 24K digital gold.

UdharSaathi: A structured working capital platform built exclusively for QR active kirana stores, pharmacies, and small retailers.

Key Responsibilities
  • Select base models (Qwen, Llama, Gemma, Mistral, Indic models) and adapt tokenizers for Indic and code-mixed text.
  • Curate training data from conversations, emails and financial documents, including synthetic data from larger teacher models.
  • Run continued pretraining, SFT and LoRA/QLoRA or full fine-tuning for text and multimodal models.
  • Align models with RLHF, reward modelling, DPO or GRPO, including verifiable rewards for numeric finance tasks.
  • Train at scale on multi-GPU, multi-node setups using FSDP, DeepSpeed or Megatron with BF16/FP8.
  • Design evaluations covering accuracy, numeric hallucination, bias and robustness; find weaknesses and fix them.
  • Build scalable inference pipelines on vLLM, Triton Inference Server, SGLang or TensorRT-LLM, with quantisation for low-latency voice use.
  • Work with product, data and business teams to turn their problems into model specs and success metrics.
Mandatory Skills
  • 3+ years in deep learning with models shipped to production, including at least one model of 1B+ parameters you trained end to end on multiple GPUs.
  • Hands-on with Hugging Face Transformers, PEFT and TRL, or equivalents such as Unsloth, Axolotl or torchtune.
  • Post-training beyond SFT (RLHF, reward modelling, DPO, GRPO or similar), with measured gains on held-out data.
  • Production inference experience on vLLM, Triton Inference Server or a similar engine.
  • Clear written and verbal communication: you can turn training results into a one-page recommendation a business leader can act on.
Preferred Skills
  • Debugging distributed training: divergence, NaN loss, OOM, low GPU utilisation, failed resume.
  • Building evaluation sets and analysing model weaknesses such as bias and robustness.
  • Hindi, Hinglish or other Indic language modelling.
  • Financial data: bank statements, bureau reports, credit or collections conversations.
  • Knowledge distillation, quantisation and inference optimisation.
  • Speech or speech-to-speech models.
  • Open-source contributions or published checkpoints.
  • Experience working with business or customer-facing teams.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Fine Tuning Expert
LLM Fine Tuning Expert

VARTIS Platforms • Mumbai

On-site
INR 4,000,000 - 9,000,000
Senior AI/ML Data Scientist or Engineer - LLM Fine-Tuning, Evaluation & Inference
Senior AI/ML Data Scientist or Engineer - LLM Fine-Tuning, Evaluation & Inference

Vamstar • India

On-site
INR 600,000 - 1,200,000
AI/ML Engineer
AI/ML Engineer

National e-Governance Division • New Delhi

On-site
INR 1,500,000 - 2,100,000
Data Scientist (AI & ML)
Data Scientist (AI & ML)

National e-Governance Division • New Delhi

On-site
INR 1,500,000 - 2,100,000
Full stack Developer (AI)
Full stack Developer (AI)

Digital India Corporation • Delhi

On-site
INR 1,800,000 - 3,200,000
LLM Engineer (Large Language Models)
LLM Engineer (Large Language Models)

Fospe UK Ltd • Bengaluru

Hybrid
INR 2,500,000 - 5,200,000
Competitive compensation with bonuses
Hybrid work at Bangalore Innovation Cn
Health, dental, wellness insurance
+3
AI Developer
AI Developer

Salvo Software • Bengaluru

On-site
INR 1,800,000 - 3,000,000
Senior AI & ML Engineer
Senior AI & ML Engineer

dCortex • Chennai

Hybrid
INR 400,000 - 700,000
Ai Ml Engineer
Ai Ml Engineer

Rodic Consultants Pvt Ltd • New Delhi

On-site
INR 1,500,000 - 3,000,000
R Systems - Lead Engineer - LLM/RAG
R Systems - Lead Engineer - LLM/RAG

R Systems • Bengaluru

On-site
INR 2,400,000 - 4,000,000