AI Engineer

Roche Holding AG; Pune District; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Roche Information Solutions (RIS) seeks an experienced AI Engineer to design, build, and optimize production-ready AI and multi-agent ecosystems. You will work on secure, compliant AI solutions leveraging enterprise datasets and modern frameworks, delivering scalable workflows and robust governance.

Responsibilities include RAG pipelines, prompt engineering, and CI/CD for AI applications on AWS or other cloud platforms.

Qualifications

• 5–8 years in ML/NLP or related field.
• 2–3 years building Generative AI/LLM solutions.
• Experience with NLP models and transformer tech.
• Proficient in Python and SQL for data prep and modeling.
• Experience deploying AI systems on cloud platforms.

Responsibilities

• Design, build, and optimize production AI/ML systems and multi‑agent workflows.
• Architect scalable service patterns and model integrations.
• Build RAG pipelines with document ingestion and source attribution.
• Develop prompts and grounding strategies with safety requirements.
• Fine‑tune models on enterprise data and ensure governance.

Skills

ML/NLP experience

Generative AI

Python

SQL

Prompt engineering

LLM orchestration

AWS/cloud platforms

Git & CI/CD

Education

Bachelor's or Master's in CS/AI/Data Science

Tools

LangChain

LangGraph

LlamaIndex

CrewAI

Pinecone

Chroma

PostgreSQL with pgvector

PyTorch / TensorFlow / HuggingFace

Langfuse

LangSmith

Docker

REST API

Job description

Chez Roche, vous pouvez être vous‑même et être apprécié pour les qualités uniques que vous apportez. Notre culture encourage l'expression personnelle, le dialogue ouvert et les connexions authentiques, où vous êtes valorisé, accepté et respecté pour ce que vous êtes, vous permettant de prospérer tant personnellement que professionnellement. Voici comment nous visons à prévenir, arrêter et guérir les maladies et à garantir à chacun l'accès aux soins de santé aujourd'hui et pour les générations à venir. Rejoignez Roche, où chaque voix compte.

La position

We are seeking an experienced AI Engineer to join Roche Information Solutions (RIS), bringing strong expertise in designing, building, and optimizing production-ready AI, Generative AI and multi-agent ecosystems. This role combines hands‑on model development and orchestration with responsibilities for system architecture, prompt engineering, and ensuring highly scalable, secure solutions.

You will work closely with business stakeholders to understand requirements and deliver reliable AI solutions/workflows that leverage proprietary enterprise datasets. The role requires ensuring that all AI systems are built securely and remain fully compliant with global data privacy and governance regulations, handling sensitive healthcare data in alignment with industry standards such as HIPAA and GDPR.

Success in this role requires proven experience with machine learning, cloud platforms, and modern AI frameworks. You will be expected to build robust agentic systems, implement retrieval‑augmented generation (RAG) pipelines, ML algorithms, and champion secure, explainable AI engineering best practices within a healthcare technology environment.

REQUIRED EXPERIENCE, SKILLS & QUALIFICATIONS

• 5-8 years of experience in ML/NLP, applied AI, data engineering, or a related technical field, including at least 2-3 years of hands‑on experience developing Generative AI or LLM-based solutions.
• Practical experience with NLP, transformer-based models, and LLM application development using PyTorch, TensorFlow, or Hugging Face Transformers.
• Hands‑on experience with Generative AI application and agent‑orchestration frameworks such as LangChain, LangGraph, LlamaIndex, or CrewAI.
• Experience with vector databases and vector search technologies such as Pinecone, Chroma, or PostgreSQL with pgvector.
• Strong proficiency in Python and SQL, with experience preparing and transforming data for model development, evaluation, and production AI workflows.
• Experience building retrieval pipelines involving document chunking, embedding generation, vector indexing, metadata filtering, similarity search, and result reranking.
• Strong prompt and context engineering skills, including structured‑output design, tool calling, and grounding responses in approved data sources.
• Experience implementing input and output guardrails, fallback mechanisms, automated evaluations, and regression tests for LLM applications.
• Expertise in deploying and operating production AI/ML and Generative AI solutions on AWS or another major cloud platform, including monitoring, scaling, security, reliability, and cost optimization.
• Proficiency in Git, Docker, automated CI/CD pipelines, unit and integration testing, REST API development, and microservices architecture.
• Experience with LLM observability platforms such as Langfuse or LangSmith to trace and monitor model calls, agent workflows, tool usage, retrieval steps, errors, latency, and cost.
• Experience working in SAFe/scaled Agile environments.
• Demonstrated ability to collaborate across product, engineering, data, cybersecurity, privacy, quality, regulatory, and domain teams while identifying risks and dependencies early.
• Strong analytical, written, and verbal communication skills, with the ability to explain technical trade‑offs clearly to technical and non‑technical stakeholders.
• Experience applying security‑by‑design and privacy‑by‑design principles to AI systems handling sensitive data, including least‑privilege access controls, encryption in transit and at rest, secrets management, audit logging, data minimization, and secure access to model endpoints.

KEY RESPONSIBILITIES

• Design, build, and optimize production AI/ML systems, including NLP applications and single and multi‑agent workflows. Implement routing, intent classification, planning, tool use, state and memory management, error handling, and human‑in‑the‑loop(HITL) escalation where required.
• Architect and implement production AI systems using appropriate service architectures, scalable deployment patterns, and reliable model integration.
• Build RAG pipelines for source ingestion, document processing and chunking, embedding generation, indexing, metadata enrichment and filtering, retrieval, reranking, and grounded response generation with source attribution and authorization‑aware retrieval.
• Design, test, and refine prompt and context strategies to improve output quality, relevance, and adherence to safety requirements.
• Fine‑tune and adapt foundation models using approved enterprise data to meet defined business requirements.
• Implement LLM observability and tracing using platforms such as Langfuse or LangSmith to monitor prompts, retrieved context, tool calls, model outputs, errors, latency, token usage, and model costs.
• Design, implement, and maintain automated CI/CD pipelines for AI applications. Build workflows using tools such as MLflow, Amazon SageMaker, Airflow, Argo Workflows, etc.
• Design and operate secure, scalable AI systems that meet applicable privacy, security, governance, quality, and regulatory requirements. Collaborate with relevant teams to implement and document required controls.
• Define and promote reusable patterns, reference implementations, and engineering standards for enterprise AI delivery across RIS.
• Stay current with relevant AI engineering advances and assess them pragmatically for Roche use cases.

GOOD TO HAVE SKILLS

• Experience working within the Healthcare Laboratory (IVD) domain is a strong plus.
• Demonstrated ability to collaborate effectively with cross‑functional teams in a fast‑paced and dynamic environment.
• Proven track record of conducting root cause analyses on systems and processes to address specific business inquiries and identify areas for enhancement.

EDUCATION QUALIFICATIONS

Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related discipline.

Qui nous sommes

Un avenir plus sain nous pousse à innover. Ensemble, plus de 100 000 employés à travers le monde sont dédiés à faire progresser la science et à garantir à chacun l'accès aux soins de santé aujourd'hui et pour les générations à venir. Nos efforts aboutissent à plus de 26 millions de personnes traitées avec nos médicaments et plus de 30 milliards de tests réalisés avec nos produits de Diagnostique. Nous nous encourageons mutuellement à explorer de nouvelles possibilités, à favoriser la créativité et à conserver nos grandes ambitions, afin de fournir des solutions de santé qui changent des vies et ont un impact mondial.

Construisons ensemble un avenir plus sain.

Roche est un employeur offrant l'équité en matière d'emploi.