AI Engineer

Roche; Pune District; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Roche Information Solutions seeks an experienced AI Engineer to design, build, and optimize production-ready AI and multi-agent systems. You will architect secure, scalable workflows using state-of-the-art frameworks and enterprise data.

Responsibilities include RAG pipelines, prompt engineering,CI/CD, and robust observability. The role demands collaboration across product, engineering, and privacy teams in a healthcare tech setting.

Qualifications

• 5–8 years in ML/NLP or related fields with 2–3 years in Generative AI.
• Experience with NLP, transformers, and LLM development using PyTorch, TensorFlow, or Hugging Face.
• Hands-on with LangChain, LangGraph, LlamaIndex, or CrewAI.
• Experience with vector databases like Pinecone, Chroma, or pgvector.
• Strong Python and SQL skills for data prep and production workflows.

Responsibilities

• Design, build, and optimize production AI/ML systems and multi-agent workflows.
• Architect production AI systems with scalable deployment patterns.
• Build RAG pipelines with source ingestion and grounded responses.
• Develop prompts and grounding strategies for safety and quality.
• Implement CI/CD pipelines for AI applications and tooling.

Skills

ML/NLP

Generative AI

Python

SQL

NLP frameworks

Cloud platforms

Education

Bachelor's or Master's in CS/AI/DS

Tools

LangChain

LlamaIndex

Pinecone

Docker

Git

AWS

Job description

At Roche you can show up as yourself, embraced for the unique qualities you bring. Our culture encourages personal expression, open dialogue, and genuine connections, where you are valued, accepted and respected for who you are, allowing you to thrive both personally and professionally. This is how we aim to prevent, stop and cure diseases and ensure everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters.

The Position

We are seeking an experienced AI Engineer to join Roche Information Solutions (RIS), bringing strong expertise in designing, building, and optimizing production-ready AI, Generative AI and multi-agent ecosystems. This role combines hands-on model development and orchestration with responsibilities for system architecture, prompt engineering, and ensuring highly scalable, secure solutions.

You will work closely with business stakeholders to understand requirements and deliver reliable AI solutions/workflows that leverage proprietary enterprise datasets. The role requires ensuring that all AI systems are built securely and remain fully compliant with global data privacy and governance regulations, handling sensitive healthcare data in alignment with industry standards such as HIPAA and GDPR.

Success in this role requires proven experience with machine learning, cloud platforms, and modern AI frameworks. You will be expected to build robust agentic systems, implement retrieval-augmented generation (RAG) pipelines, ML algorithms, and champion secure, explainable AI engineering best practices within a healthcare technology environment.

Required Experience, Skills & Qualifications

• 5-8 years of experience in ML/NLP, applied AI, data engineering, or a related technical field, including at least 2-3 years of hands-on experience developing Generative AI or LLM-based solutions
• Practical experience with NLP, transformer-based models, and LLM application development using PyTorch, TensorFlow, or Hugging Face Transformers
• Hands-on experience with Generative AI application and agent-orchestration frameworks such as LangChain, LangGraph, LlamaIndex, or CrewAI
• Experience with vector databases and vector search technologies such as Pinecone, Chroma, or PostgreSQL with pgvector
• Strong proficiency in Python and SQL, with experience preparing and transforming data for model development, evaluation, and production AI workflows
• Experience building retrieval pipelines involving document chunking, embedding generation, vector indexing, metadata filtering, similarity search, and result reranking
• Strong prompt and context engineering skills, including structured-output design, tool calling, and grounding responses in approved data sources
• Experience implementing input and output guardrails, fallback mechanisms, automated evaluations, and regression tests for LLM applications
• Expertise in deploying and operating production AI/ML and Generative AI solutions on AWS or another major cloud platform, including monitoring, scaling, security, reliability, and cost optimization
• Proficiency in Git, Docker, automated CI/CD pipelines, unit and integration testing, REST API development, and microservices architecture
• Experience with LLM observability platforms such as Langfuse or LangSmith to trace and monitor model calls, agent workflows, tool usage, retrieval steps, errors, latency, and cost
• Experience working in SAFe/scaled Agile environments
• Demonstrated ability to collaborate across product, engineering, data, cybersecurity, privacy, quality, regulatory, and domain teams while identifying risks and dependencies early
• Strong analytical, written, and verbal communication skills, with the ability to explain technical trade-offs clearly to technical and non-technical stakeholders
• Experience applying security-by-design and privacy-by-design principles to AI systems handling sensitive data, including least-privilege access controls, encryption in transit and at rest, secrets management, audit logging, data minimization, and secure access to model endpoints

Key Responsibilities

• Design, build, and optimize production AI/ML systems, including NLP applications and single and multi-agent workflows. Implement routing, intent classification, planning, tool use, state and memory management, error handling, and human-in-the-loop(HITL) escalation where required
• Architect and implement production AI systems using appropriate service architectures, scalable deployment patterns, and reliable model integration
• Build RAG pipelines for source ingestion, document processing and chunking, embedding generation, indexing, metadata enrichment and filtering, retrieval, reranking, and grounded response generation with source attribution and authorization-aware retrieval
• Design, test, and refine prompt and context strategies to improve output quality, relevance, and adherence to safety requirements
• Fine-tune and adapt foundation models using approved enterprise data to meet defined business requirements
• Implement LLM observability and tracing using platforms such as Langfuse or LangSmith to monitor prompts, retrieved context, tool calls, model outputs, errors, latency, token usage, and model costs
• Design, implement, and maintain automated CI/CD pipelines for AI applications. Build workflows using tools such as MLflow, Amazon SageMaker, Airflow, Argo Workflows, etc
• Design and operate secure, scalable AI systems that meet applicable privacy, security, governance, quality, and regulatory requirements. Collaborate with relevant teams to implement and document required controls
• Define and promote reusable patterns, reference implementations, and engineering standards for enterprise AI delivery across RIS
• Stay current with relevant AI engineering advances and assess them pragmatically for Roche use cases

Good To Have Skills

• Experience working within the Healthcare Laboratory (IVD) domain is a strong plus
• Demonstrated ability to collaborate effectively with cross-functional teams in a fast-paced and dynamic environment
• Proven track record of conducting root cause analyses on systems and processes to address specific business inquiries and identify areas for enhancement

Education Qualifications

Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related discipline.

Who we are

A healthier future drives us to innovate. Together, more than 100'000 employees across the globe are dedicated to advance science, ensuring everyone has access to healthcare today and for generations to come. Our efforts result in more than 26 million people treated with our medicines and over 30 billion tests conducted using our Diagnostics products. We empower each other to explore new possibilities, foster creativity, and keep our ambitions high, so we can deliver life-changing healthcare solutions that make a global impact.

Let's build a healthier future, together.

Roche is an Equal Opportunity Employer.