Staff AI Engineer

PW (PhysicsWallah); Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

PhysicsWallah is hiring an AI Staff Data Scientist to lead Generative AI initiatives at scale. You will design, deploy, and optimize production-grade LLM applications and Retrieval-Augmented Generation pipelines across the organization.

You will fine-tune models with LoRA/QLoRA/PEFT, improve latency, and drive cost efficiency while mentoring engineers and collaborating with product, data, and AI teams to solve complex problems in education technology.

Qualifications

• Proven design and deployment of production-grade LLM applications.
• Hands-on with vLLM, TGI, or SGLang for inference and deployment.
• Experience building Retrieval-Augmented Generation systems and RLHF.
• Strong knowledge of model optimization and cost efficiency.
• Experience mentoring engineers and leading AI initiatives.

Responsibilities

• Lead design, development, and deployment of GenAI and LLM-powered apps.
• Architect scalable RAG pipelines for knowledge-intensive tasks.
• Fine-tune foundation models using LoRA/QLoRA/PEFT; optimize latency and cost.
• Build Agentic AI and multi-agent systems with autonomous execution.
• Develop evaluation pipelines, including LLM-as-a-Judge methodologies.
• Drive AI best practices and mentor engineers across teams.

Skills

LLM applications

RAG pipelines

LoRA/QLoRA

PEFT

RLHF

Quantization

Distillation

LLM evaluation

vLLM

TGI/SGLang

Education

Master's or PhD in CS/AI

Bachelor's degree

Tools

Pinecone

Weaviate

Hugging Face Transformers

PyTorch

Flash Attention

Job description

PhysicsWallah (PW) is one of India's leading education technology companies, empowering millions of learners through innovative digital learning solutions. We are building next-generation AI platforms to transform education through personalized learning, intelligent tutoring, content generation, and AI-powered learning experiences.

As an AI Staff Data Scientist, you will play a key technical leadership role in shaping our Generative AI and Large Language Model (LLM) initiatives. You will work closely with Product, Engineering, and AI teams to build scalable, production-grade AI systems that power experiences for millions of students.

If you're passionate about solving complex AI challenges and building state-of-the-art LLM applications at scale, we'd love to hear from you.

• Design, develop, and deploy production-grade Generative AI and LLM-powered applications.
• Architect and implement scalable Retrieval-Augmented Generation (RAG) pipelines for knowledge-intensive AI systems.
• Fine-tune foundation models using techniques such as LoRA, QLoRA, PEFT, and RLHF.
• Optimize LLM inference for latency, throughput, scalability, and infrastructure cost.
• Build intelligent Agentic AI and multi-agent systems capable of autonomous reasoning and task execution.
• Design scalable vector search architectures using modern vector databases.
• Develop robust evaluation pipelines, including LLM-as-a-Judge methodologies for automated quality assessment.
• Build and maintain end-to-end ML workflows, experimentation pipelines, and model observability.
• Collaborate with Product Managers, Engineering teams, and Data Scientists to translate business problems into AI-powered solutions.
• Drive architectural decisions, establish AI best practices, and mentor engineers across teams.
• Stay up to date with the latest advancements in Generative AI, LLM optimization, and model serving technologies.

Skills & Qualifications:

Required Skills:

• Strong experience designing and deploying production-grade LLM applications.
• Hands-on expertise with:
• vLLM or Text Generation Inference (TGI) or SGLang
• Retrieval-Augmented Generation (RAG)
• LoRA, QLoRA, or PEFT
• Reinforcement Learning from Human Feedback (RLHF)
• Quantization and/or Distillation
• LLM-as-a-Judge evaluation frameworks

AI Frameworks

Experience with one or more of the following:

• LangChain
• LangGraph

Vector Databases

Hands-on experience with one or more:

• Pinecone
• Weaviate
• Hugging Face Transformers
• PyTorch
• Flash Attention

Agentic AI

Experience building:

• AI Agents
• Multi-Agent Systems

Experience with:

• MLflow
• Langfuse
• Weights & Biases (W&B)

Performance Optimization

Strong understanding of:

• LLM latency optimization
• LLM inference optimization
• Cost optimization for production AI systems

Qualifications

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
• 7–12+ years of experience in Machine Learning, Data Science, AI Engineering, or related domains.
• Proven experience building and deploying AI solutions in production environments.
• Strong understanding of distributed systems, scalable architectures, and cloud platforms (AWS, Azure, or GCP).
• Excellent problem-solving, communication, and stakeholder management skills.
• Experience mentoring engineers and driving technical initiatives is highly preferred.

Why Join PhysicsWallah?

• Build AI products that impact millions of learners across India.
• Work on cutting-edge technologies in Generative AI, LLMs, Agentic AI, and RAG.
• Solve challenging real-world problems with large-scale AI systems.
• Collaborate with high-performing Product, Engineering, and AI teams.
• Enjoy a fast-paced, ownership-driven culture where innovation is encouraged.
• Lead strategic AI initiatives and influence the future of AI-powered education.
• Accelerate your career by working on some of the most impactful AI use cases in the EdTech ecosystem.