Machine Learning Engineer / Researcher (IR-556)

Intellectsoft; Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Benefits offered by this job

Comprehensive insurance

Paid PTO (vacation)

Tech equipment provided

Udemy courses & trainings

Flexible hours & setup

Job summary

Intellectsoft in Bengaluru is seeking an experienced ML Engineer to lead the adaptation of small language models to specialized domains. You will work with Python, PyTorch, and the Hugging Face ecosystem to fine-tune models for real-world applications, handling data curation and evaluation.

The role covers end-to-end experimentation, from CPT and SFT to RL-based tuning, model serving, and deployment across GPU, CPU, and edge targets using vLLM, llama.cpp, and TensorRT-LLM.

Qualifications

• Experience: 3+ years in Machine Learning Engineering or Applied ML, with hands-on experience fine-tuning transformer-based language models.
• Core Tech Stack: Advanced Python and PyTorch proficiency.
• Frameworks & Ecosystem: Deep fluency in the Hugging Face ecosystem, including Transformers, PEFT, Datasets, Accelerate, and TRL.
• Fine-Tuning Expertise: Practical command of SFT with LoRA/QLoRA, alongside the judgment to reason about CPT and RL/preference methods.
• Model Selection: Strong understanding of base model architectures, tokenizer design, pre-training data distributions, licensing, and context window requirements.
• Data Engineering for ML: Proven experience building training pipelines (curation, cleaning, synthetic data generation, and formatting).
• Evaluation & Serving: Ability to design executable correctness evaluations, paired with hands-on experience serving and quantizing models using at least one modern inference framework.
• Research Fluency: Comfort reading recent ML research papers and translating state-of-the-art methods into working code.

Responsibilities

• Own the Model Adaptation Lifecycle for domain tasks, selecting base models and training strategies.
• Apply Efficient Fine-Tuning with PEFT methods, understanding LoRA/QLoRA and related trade-offs.
• Choose and sequence adaptation strategies: CPT, SFT, RL/preference tuning.
• Curate & synthesize data: clean, format, generate high-quality datasets, including synthetic data.
• Design functional evaluations: build benchmarks based on executable correctness.
• Leverage knowledge transfer: distillation, pruning, and quantization from larger models.
• Deploy & optimize serving: configure inference across GPU/CPU/edge with vLLM, llama.cpp, TensorRT-LLM.
• Ensure reproducible experiments with versioning and checkpoints.

Skills

Python

PyTorch

Hugging Face

PEFT LoRA/QLoRA

Transformers

RLHF / RL tuning

Data pipelines

Model evaluation

Research literacy

Tools

vLLM

TGI

Ollama

llama.cpp

TensorRT-LLM

DeepSpeed

FSDP

Distillation

Job description

Intellectsoft is a software development company delivering innovative solutions since 2007. We operate across North America, Latin America, the Nordic region, the UK, and Europe. We specialize in industries like Fintech, Healthcare, EdTech, Construction, Hospitality, and more, partnering with startups, mid‑sized businesses, and Fortune 500 companies to drive innovation and scalability. Our clients include Jaguar Motors, Universal Pictures, Harley‑Davidson, and many more where our teams are making daily impactTogether,our team delivers solutions that make a difference.Learn more at www.intellectsoft.net

Our client is a management consulting and technology firm focused on transforming global healthcare and diverse industries through data‑driven strategies, cutting‑edge analytics, and advanced AI solutions. This role sits within a focused research initiative dedicated to adapting small language models (SLMs) to specialized, high‑value domain applications.

• Experience: 3+ years in Machine Learning Engineering or Applied ML, with hands‑on experience fine‑tuning transformer‑based language models.
• Core Tech Stack: Advanced Python and PyTorch proficiency.
• Frameworks & Ecosystem: Deep fluency in the Hugging Face ecosystem, including Transformers, PEFT, Datasets, Accelerate, and TRL.
• Fine‑Tuning Expertise: Practical command of SFT with LoRA/QLoRA, alongside the judgment to reason about CPT and RL/preference methods.
• Model Selection: Strong understanding of base model architectures, tokenizer design, pre‑training data distributions, licensing, and context window requirements.
• Data Engineering for ML: Proven experience building training pipelines (curation, cleaning, synthetic data generation, and formatting).
• Evaluation & Serving: Ability to design executable correctness evaluations, paired with hands‑on experience serving and quantizing models using at least one modern inference framework.
• Research Fluency: Comfort reading recent ML research papers and translating state‑of‑the‑art methods into working code.

Nice to have

• Hands‑on experience with Continued Pre‑Training (CPT) on large domain corpora.
• Experience with Reinforcement Learning / preference optimization for LLMs (reward modeling, DPO, GRPO, or verifiable‑reward setups).
• Experience with structured‑output generation, code generation (e.g., SQL/DDL), or domain classification fine‑tuning.
• Familiarity with distributed training frameworks (DeepSpeed, FSDP).
• Knowledge distillation experience transferring capabilities from large teacher models to small student models.
• Experience with on‑device or edge deployment.
• Active open‑source contributions to machine learning tooling, libraries, or published models.

Responsibilities

• Own the Model Adaptation Lifecycle: Drive end‑to‑end adaptation of SLMs to specialized domain tasks, choosing the right base models, training strategies, and architectures.
• Apply Efficient Fine‑Tuning: Implement parameter‑efficient fine‑tuning (PEFT) methods with a mathematically grounded understanding of low‑rank adaptation (LoRA, QLoRA, rank selection, parameterization, scaling, and accuracy‑efficiency trade‑offs).
• Select Strategy per Task: Determine and sequence optimal adaptation strategies - including Continued Pre‑Training (CPT), Supervised Fine‑Tuning (SFT), and RL/preference tuning (DPO, GRPO, RLHF).
• Curate & Synthesize Data: Clean, curate, format, and generate high‑quality datasets, including synthetic data generation when domain data is scarce.
• Design Functional Evaluations: Build task‑specific benchmarks grounded in functional, executable correctness rather than loss curves or perplexity alone, maintaining regression tracking across versions.
• Leverage Knowledge Transfer: Use larger models as teachers to transfer capabilities to SLMs via distillation, structured pruning, and quantization.
• Deploy & Optimize Serving: Stand up and optimize inference infrastructure across GPU, CPU, and edge targets using frameworks such as vLLM, TGI, Ollama, llama.cpp, or TensorRT‑LLM.
• Pipeline Reproducibility & Research Execution: Break target tasks into milestones with clear criteria, maintaining reproducible pipelines with data/config versioning, checkpointing, and experiment tracking.
• Translate recent literature into reproducible experiments.

• Employment‑based cooperation
• Comprehensive insurance for you and your family (health, life, and accident)
• Paid PTO policy (vacation, sick leaves, and public holidays)
• Tech equipment provided
• Udemy courses, workshops, trainings & expert knowledge‑sharing
• Flexible hours & work setup