Senior Data Scientist – AI & GenAI

D4 Insight; Hyderabad; On-site; INR 4,000,000 - 6,500,000; Full time

Job summary

D4 Insight in Hyderabad, India is seeking a Senior Data Scientist to design, build, and deploy advanced AI solutions spanning ML, GenAI, and agentic workflows.

You will tackle regulatory and business challenges with scalable, secure, and production-ready AI applications, collaborating with data teams and platform engineers to deliver measurable impact.

Qualifications

• 9–12 years of data science and applied AI experience.
• Strong Python, SQL, statistics, and ML skills.
• Experience with PyTorch or TensorFlow.
• End-to-end ML lifecycle, evaluation, deployment and monitoring.
• NLP, Generative AI, embeddings, RAG, hybrid search and prompt engineering.
• Knowledge of document processing, OCR, metadata management, and PII detection/redaction.
• Experience with cloud AI platforms such as Google Vertex AI, AWS SageMaker/Bedrock, or Azure AI Services.
• Understanding of enterprise AI governance, privacy, compliance and responsible AI."
• Strong communication skills and ability to translate technical outcomes into business impact.

Responsibilities

• Develop machine learning, GenAI, and agentic AI solutions, including RAG pipelines and assistants.
• Build AI solutions for regulatory filing support and searchable knowledge bases.
• Develop domain knowledge bases for regulatory intelligence and customer sentiment.
• Manage end-to-end AI lifecycle: data prep, modeling, evaluation, deployment, monitoring, CI/CD.
• Implement document processing, retrieval strategies, prompt engineering, safe tool-use.
• Define evaluation metrics, test datasets, A/B testing, and model drift monitoring.
• Apply responsible AI, including privacy, fairness, security and governance.
• Collaborate with stakeholders to deliver measurable business value.

Skills

Python

SQL

Statistical modelling

Machine learning

NLP

GenAI

RAG

Prompt engineering

Embeddings

Hybrid search

Cloud platforms

Tools

PyTorch

TensorFlow

Job description

Role Overview

We are looking for Senior Data Scientist to design, build, and deploy advanced AI solutions across machine learning, Generative AI, and agentic workflows. The role involves solving complex business and regulatory challenges through scalable, secure, and production-ready AI applications.

Location

Hyderabad, India

Experience

9–12 Years

Key Responsibilities

• Develop machine learning, GenAI, and agentic AI solutions, including RAG pipelines, assistants, classification, forecasting, and recommendation systems.
• Build AI solutions for regulatory filing support and searchable knowledge bases.
• Develop domain-specific knowledge bases for regulatory intelligence, competitive insights, and customer sentiment.
• Manage the end-to-end AI lifecycle, including data preparation, modeling, evaluation, deployment, monitoring, and CI/CD.
• Implement document processing, retrieval strategies, prompt engineering, and safe tool-use mechanisms.
• Define evaluation metrics, test datasets, A/B testing, and model drift monitoring.
• Apply responsible AI practices, including privacy, fairness, bias mitigation, security, and governance.
• Collaborate with business stakeholders, architects, data teams, and platform engineers to deliver measurable business value.

Required Skills & Experience

• 9–12 years of relevant experience in data science and applied AI.
• Strong Python, SQL, statistical modeling, and machine learning skills.
• Experience with deep learning frameworks such as PyTorch or TensorFlow preferred.
• Strong understanding of the end-to-end ML lifecycle, model evaluation, deployment, and monitoring.
• Experience with NLP, Generative AI, embeddings, RAG, hybrid search, and prompt engineering.
• Knowledge of document processing, OCR, metadata management, and PII detection or redaction.
• Experience with cloud AI platforms such as Google Vertex AI, AWS SageMaker/Bedrock, or Azure AI Services.
• Understanding of enterprise AI governance, privacy, compliance, and responsible AI practices.
• Strong communication skills and the ability to translate technical outcomes into business impact.

Good to Have

Vector databases, LangChain, LangGraph, LlamaIndex, RAG evaluation frameworks, MLflow, PEFT/LoRA, synthetic data generation, and AI agent development.