Product Architect - AI/ML

ThinkWise Consulting LLP; Pune District; Hybrid; INR 4,000,000 - 6,500,000; Full time

Job summary

A leading consulting firm is seeking a mid-senior level technical product architect with extensive experience in AI/ML to drive the vision for enterprise platforms in healthcare. Responsibilities include defining scalable architectures, leading engineering teams, and fine-tuning large language models. Candidates should have strong Python skills and experience in regulated environments. This role requires flexibility to work with US teams and mentor junior engineers, with a full-time commitment in Pune or Hyderabad.

Qualifications

• 12-15 years of experience with a minimum of 6-7 years in AI/ML Product Architecture.
• Expertise in Python and fine-tuning LLMs for deployment.
• Proven ability to lead engineering teams and mentor junior staff.
• Core Software Engineering skills with AI/ML expertise and DevOps.
• Flexibility to work with US hours overlap.

Responsibilities

• Define technical product vision for enterprise AI/ML platforms.
• Architect solutions for processing clinical records and claims.
• Lead execution of proof-of-concept projects to production.
• Establish architecture principles, patterns, and technology stacks.
• Own non-functional requirements: performance, security, and HIPAA compliance.
• Mentor and lead engineering teams across time zones.

Skills

Expert Python development with PyTorch

Fine-tuning LLMs in regulated environments

Track record of shipping production AI products

AI/ML expertise

Core Software Engineering skills

Flexibility to work with US hours overlap

Tools

Azure Kubernetes Service

Azure DevOps

Cosmos DB

Azure SQL

Job description

Get AI‑powered advice on this job and more exclusive features.

Experience: 12-15 years (Minimum 6-7 years in AI/ML Product Architecture)

Location: Pune preferred / Hyderabad (4 Days WFO)

Role Overview

Define and drive the technical product vision for enterprise AI/ML platforms in healthcare, translating business requirements into scalable architectures while ensuring delivery excellence and long‑term product sustainability. This role requires hands‑on leadership, flexible collaboration across time zones, and the ability to mentor engineering teams.

Product & Technical Strategy

• Architect end-to-end product solutions for processing clinical records, claims, and
• Design hybrid Azure/on‑premises architectures supporting multi‑tenant SaaS and
• Establish product architecture principles, design patterns, and technology stack decisions
• Evaluate build‑vs‑buy decisions for AI capabilities, drive technical feasibility assessments and rapid prototyping for new product features
• Own non‑functional requirements: performance, security, compliance (HIPAA),
• Present architectural proposals and technical roadmaps to leadership through clear presentations and documentation AI/ML Product Engineering
• Design and implement fine‑tuning pipelines for domain‑specific LLMs (e.g. Llama, Mistral, Phi‑3) on medical datasets
• Build “built‑in‑intelligence‑products” using advanced AI models.
• Implement distributed training infrastructure on Azure ML with GPU optimization
• Create model evaluation frameworks with domain‑specific metrics and quality
• Develop synthetic data generation capabilities for model training and testing
• Establish model versioning, A/B testing, and rollback strategies for production deployments

Platform & Infrastructure

• Design microservices architectures with Azure Kubernetes Service, Service Bus, Event high‑volume processing
• Implement CI/CD automation through Azure DevOps with comprehensive testing and
• Architect observability solutions: monitoring, logging, alerting, performance analytics
• Design hybrid cloud integration patterns connecting Azure services with on‑premises systems
• Manage data architecture: Azure SQL, Cosmos DB, blob storage, data lakes with lifecycle policies

Delivery Excellence & Hands‑On Leadership

• Lead proof‑of‑concept execution from inception to production‑ready solutions within defined timelines
• Conduct rigorous code reviews ensuring adherence to standards, performance optimization, and maintainability
• Roll up sleeves for critical implementation work: debugging production issues, optimizing
• Deliver technical demos to internal stakeholders and customers showcasing product capabilities
• Create comprehensive technical documentation: architecture decision records, API
• Identify and systematically address technical debt across AI models, infrastructure, and
• Mentor and develop junior engineers and fresh graduates through pair programming, and technical guidance
• Review and provide constructive feedback on designs, code, and technical approaches from team members
• Foster engineering culture emphasizing quality, innovation, and continuous learning
• Collaborate with US‑based teams requiring flexibility for meetings during early morning or late evening IST hours
• Bridge communication between offshore development teams and US‑based product/business stakeholders
• Translate business requirements from US teams into actionable technical tasks for India‑based engineers
• Participate in cross‑timezone planning, sprint reviews, and architecture discussions

Required Qualifications

• [Non Negotiable] Expert Python development with PyTorch, NVIDIA/CUDA variants and their inner workings.
• [Non Negotiable] Proven experience fine‑tuning LLMs and deploying custom models in regulated environments
• [Non Negotiable] Track record of shipping production AI products with measurable business impact
• [Non Negotiable] Core Software Engineering skills. AI/ ML expertise, DevOps.
• [Non Negotiable] Flexibility to work with US hours overlap

Key Competencies

• Hands‑on technical leadership and a user‑centric approach to technical architecture
• Ownership mindset with accountability for outcomes and the ability to balance innovation with pragmatic engineering
• Effective communicator capable of engaging both technical and non‑technical audiences
• Comfortable operating at multiple levels: strategy, architecture, and implementation

Seniority Level

Mid‑Senior level

Employment Type

Full‑time

Job Function

Information Technology

Industries

Software Development