Data Scientist

SWITS DIGITAL Private Limited; Bengaluru Urban; Sur place; INR 900 000 - 1 800 000; Plein temps

Résumé du poste

SWITS DIGITAL Private Limited in Bengaluru is seeking an experienced Data Scientist to lead AI/ML initiatives, from problem framing to evaluation and deployment. You will work on classical ML, LLM evaluation, and RAG-enabled solutions, with strong focus on metrics, experiment design, and responsible AI practices.

The role requires hands-on data science work, collaboration with engineers and product teams, and clear documentation of model cards and risks.

Qualifications

• We expect strong problem framing and analytical thinking.
• Hands-on experience with classical ML and model development.
• Proficiency in AI/ML evaluation metrics and model validation.
• Experience with LLM development and evaluation.
• Basic knowledge of prompt engineering and RAG.
• Ability to design experiments, hypothesis testing, and statistics.

Responsabilités

• Translate business needs into data science problems with measurable success criteria.
• Develop, train, evaluate, and optimize classical ML models.
• Define and track AI/ML performance metrics (accuracy, precision, recall, F1, KPIs).
• Contribute to LLM development/evaluation, including grounding and hallucination assessment.
• Apply prompt engineering techniques; understand RAG architectures/workflows.
• Design/execute experiments: A/B tests, model comparisons, hypothesis testing.
• Perform feature engineering, preprocessing, validation, and error analysis.
• Document model assumptions, limitations, evaluation results, risks, and use via model cards.
• Collaborate with data/ML engineers, product teams, and stakeholders to deliver scalable AI solutions.

Connaissances

Classical ML

LLM evaluation

Prompt engineering

RAG basics

Experiment design

Python

SQL

Pandas/NumPy

Scikit-learn

Model evaluation metrics

Model cards

Responsible AI

Data preprocessing

Statistical analysis

Problem framing

Analytical thinking

LLM frameworks

LangChain

LlamaIndex

Formation

Outils

LangChain

LlamaIndex

Experiment tracking tools

Description du poste

Job Summary
We are looking for an experienced Data Scientist with strong expertise in classical Machine Learning, AI/ML evaluation, and Large Language Models (LLMs). The ideal candidate should be skilled in problem framing, defining evaluation metrics, conducting experiments, and developing AI/ML solutions, with foundational knowledge of prompt engineering and Retrieval-Augmented Generation (RAG).

Job Description: Data Scientist
Job Title: Data Scientist
Locations: Bangalore / Pune
Experience: 5-12 Years
Employment Type: Full-Time
Job Summary
We are looking for an experienced Data Scientist with strong expertise in classical Machine Learning, AI/ML evaluation, and Large Language Models (LLMs). The ideal candidate should be skilled in problem framing, defining evaluation metrics, conducting experiments, and developing AI/ML solutions, with foundational knowledge of prompt engineering and Retrieval-Augmented Generation (RAG).
Key Responsibilities

• Translate business requirements into data science problems and define measurable success criteria.
• Develop, train, evaluate, and optimize classical machine learning models.
• Define and track AI/ML performance metrics, including accuracy, precision, recall, F1-score, and business-specific KPIs.
• Contribute to LLM development and evaluation, including response quality, relevance, groundedness, and hallucination assessment.
• Apply prompt engineering techniques and understand basic RAG architectures and workflows.
• Design and execute experiments, including hypothesis testing, A/B testing, and model comparisons.
• Perform feature engineering, data preprocessing, model validation, and error analysis.
• Document model assumptions, limitations, evaluation results, risks, and intended use through model cards.
• Collaborate with data engineers, ML engineers, product teams, and business stakeholders to deliver scalable AI solutions.

Required Skills

• Strong understanding of problem framing and analytical thinking.
• Hands-on experience with classical ML algorithms and model development.
• Knowledge of AI/ML evaluation metrics and model validation techniques.
• Experience with LLM development and evaluation.
• Basic understanding of prompt engineering and RAG.
• Experience in experiment design, hypothesis testing, and statistical analysis.
• Familiarity with model documentation, model cards, and responsible AI principles.
• Strong Python and SQL programming skills.
• Experience with libraries such as Pandas, NumPy, Scikit-learn, and relevant ML/LLM frameworks.

Preferred Qualifications

• Experience evaluating generative AI applications and LLM outputs.
• Familiarity with frameworks such as LangChain or LlamaIndex.
• Exposure to ML experiment tracking and model lifecycle tools.
• Understanding of bias, explainability, reproducibility, and responsible AI practices.