GenAI Engineer

Soul Ai; Bengaluru; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Soul AI is hiring a Generative AI Engineer to build intelligent systems powered by large language models and other GenAI architectures. You will develop and deploy LLM-based features, integrate vector search, fine-tune models, and collaborate with product and engineering teams to ship robust GenAI applications.

You'll work across the GenAI stack—from prompt design to inference optimization—to shape how generative models are used in real-world products.

Qualifications

• Bachelor's or Master's degree in CS/AI/ML/Data Science or related field.
• Strong programming in Python and ML tooling experience.
• Experience with LLM frameworks and vector databases.
• Understanding of transformer models and prompt engineering.
• Hands-on with APIs and model serving (FastAPI/Flask).
• Experience deploying ML models using Docker/Kubernetes and cloud services.
• Experience building or deploying RAG pipelines and embedding handling.
• Familiarity with privacy, safety, and responsible AI practices.

Responsibilities

• Fine-tune and deploy LLMs using frameworks like Hugging Face Transformers or LangChain.
• Build and optimize Retrieval-Augmented Generation pipelines with vector databases.
• Engineer prompts for reliable outputs across use cases (chatbots, summarization, copilots).
• Implement scalable inference and optimize latency, throughput and cost.
• Collaborate with product and frontend teams to integrate GenAI features.
• Monitor and improve model performance, safety, and accuracy in production.
• Ensure compliance with privacy and responsible AI practices.

Skills

Python

LLM frameworks

LangChain

Hugging Face Transformers

Vector search

RAG pipelines

Prompt engineering

Docker

Kubernetes

API integration

FastAPI/Flask

Cloud services

Education

Bachelor's/Master's in CS/AI/ML/Data Science

Tools

LangChain

Hugging Face Transformers

LlamaIndex

Pinecone

FAISS

Docker

Kubernetes

FastAPI

Flask

AWS

GCP

Azure

Job description

Soul AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS.

We specialize in delivering high-quality human-curated data and AI-first scaled operations services.

Based in San Francisco and Hyderabad, we are a fast-moving team on a mission to build AI for Good, driving innovation and societal impact.

Role Overview

Were looking for a Generative AI Engineer to join our clients team and build intelligent systems powered by large language models and other generative AI architectures.

This role involves developing and deploying LLM-based features, integrating vector search, fine-tuning models, and collaborating with product and engineering teams to ship robust, scalable GenAI applications.

Youll work across the GenAI stack "” from prompt design to inference optimization "” and shape how generative models are used in real-world products.

Responsibilities

• Fine-tune and deploy LLMs (e.g., GPT, LLaMA, Mistral) using frameworks like Hugging Face Transformers or LangChain.
• Build and optimize Retrieval-Augmented Generation (RAG) pipelines using vector databases (e.g., Pinecone, FAISS).
• Engineer prompts for structured, reliable outputs across use cases (chatbots, summarization, coding copilots, etc.).
• Implement scalable inference pipelines and optimize latency, throughput, and cost using techniques like quantization or model distillation.
• Collaborate with product, design, and frontend teams to integrate GenAI into user-facing features.
• Monitor, evaluate, and continuously improve model performance, safety, and accuracy in production.
• Ensure compliance with privacy, safety, and responsible AI practices (e.g., content filtering, output sanitization).

Required Skills

• Strong programming skills in Python, with familiarity in modern ML tooling.
• Practical experience with LLM frameworks (e.g., Hugging Face Transformers, LangChain, LlamaIndex).
• Experience building or deploying RAG pipelines, including handling embeddings and vector search.
• Understanding of transformer models, prompt engineering, and tokenization strategies.
• Hands-on with APIs (OpenAI, Anthropic, Cohere, etc.) and model serving (FastAPI, Flask, etc.).
• Experience deploying ML models using Docker, Kubernetes, and/or cloud services (AWS/GCP/Azure).
• Comfortable with model evaluation, monitoring, and troubleshooting inference pipelines.

Nice to Have

• Experience with multimodal models (e.g., diffusion models, TTS, image/video generation).
• Knowledge of RLHF, safety alignment, or model fine-tuning best practices.
• Familiarity with open-source LLMs (e.g., Mistral, LLaMA, Falcon, Mixtral) and optimization (LoRA, quantization).
• Experience with LangChain agents, tool usage, and memory management.
• Contributions to open-source GenAI projects or published demos/blogs on generative AI.
• Exposure to frontend technologies (React/Next.js) for prototyping GenAI tools.

Educational Qualifications

Bachelor's or Masters degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related technical field.

Candidates with relevant project experience or open-source contributions may be considered regardless of formal degree.