AI Platform Engineer – Cloud & Healthcare

Neolytix; Gurugram District; Hybrid; INR 3,500,000 - 6,000,000; Full time

Job summary

Neolytix is hiring an AI Platform Engineer to own the infrastructure for safe, compliant AI across internal and client-facing products. The role emphasizes infrastructure and integration, not application development, with collaboration across IT Operations, Compliance, and product teams.

Hybrid work in Gurugram aligns with a healthcare tech scale-up. You will implement a self-hosted AI gateway, PHI/PII redaction, cross‑cloud IAM, observability, and product integration, enabling secure AI

Qualifications

• 3+ years of cloud infrastructure experience across Azure and AWS.
• Hands-on Azure App Services, Container Apps, and Entra ID / SSO configuration.
• AWS IAM, OIDC federation, API access management and audit logging.
• Python proficiency for configuration and pipelines.
• Experience deploying or configuring open-source AI gateway or proxy tooling.
• NLP-based PHI/PII detection frameworks and self-hosted observability platforms.
• HIPAA data handling awareness and secure data practices.

Responsibilities

• Own AI gateway infrastructure, deploy and maintain on Azure App Services.
• Implement routing, per-team/user rate limits, and budget controls.
• Integrate model providers via a single gateway layer.
• Build and maintain NLP-based PHI detection and redaction pipeline.
• Configure IAM federation and least-privilege access across clouds.
• Deploy self-hosted observability platform and dashboards.
• Integrate gateway with internal clinical and SaaS product workflows.

Skills

Azure

AWS

Python

NLP

PHI/PII redaction

LLM gateway

Observability

IAM & SSO

Container Apps

Terraform / IaC

Tools

LiteLLM

LangFuse

Langsmith

Azure App Services

Azure Container Apps

Entra ID

Terraform

Azure Bicep

OIDC federation

Job description

Job Title

AI Platform Engineer – Cloud & Healthcare

Location

Gurugram, India (Hybrid)

Employment Type

Full-Time

Company

Neolytix is a US‑based healthcare technology and services company with 220+ employees across Chicago, Gurugram, and Manila. We serve 270+ provider organizations across revenue cycle management, credentialing, medical coding, and AI‑enabled services. We are in an active phase of building proprietary technology platforms that sit at the intersection of healthcare operations and artificial intelligence.

About the Role

This role sits at the center of that build — owning the infrastructure that makes AI safe, compliant, and usable across our internal teams and client‑facing products. It focuses on infrastructure and integration, not application development. Architecture decisions are made by the team; the engineer executes with precision, documents rigorously, and maintains the platform as AI usage grows. The engineer will work directly with IT Operations and Compliance leads and integrate with product engineering teams as AI capabilities are embedded into our clinical and revenue cycle products.

What You Will Own

AI Gateway Infrastructure

• Deploy, configure, and maintain a self‑hosted AI gateway running on Azure App Services
• Implement routing logic, per‑team and per‑user rate limits, and budget kill‑switch controls
• Manage model provider integrations across multiple AI APIs from a single gateway layer

PHI/PII Redaction Pipeline

• Build and maintain an NLP‑based PHI detection and redaction layer that intercepts all prompts before routing to any external model provider
• Configure entity recognizers for healthcare‑specific PHI patterns (names, MRNs, DOBs, diagnoses)
• Ensure fail‑closed behavior — if redaction fails, the request does not proceed

Identity & Access

• Implement SSO federation via Azure Entra ID — all AI gateway access tied to existing corporate identity
• Configure cross‑cloud IAM federation between Azure and AWS so model API access uses no long‑lived static credentials
• Maintain IAM groups, access policies, and least‑privilege controls across both cloud environments

Observability & Cost Management

• Deploy and maintain a self‑hosted LLM observability platform on Azure Container Apps
• Build dashboards tracking usage by team, user, and cost center
• Configure tiered budget alerting with automated notifications and hard stops
• Maintain audit‑grade API logs forwarded to our SIEM environment for compliance evidence

Product Integration

• Connect our AI gateway to workflows within our proprietary clinical platform (InCredibly) as AI features are developed
• Support the internal Intelligent Automation team in connecting their workflows to the AI infrastructure layer
• Serve as the internal expert on what is safe, compliant, and feasible when product teams propose AI features

What We Are Looking For

Must‑Have

• 3+ years of cloud infrastructure experience spanning Azure and AWS
• Hands‑on Azure experience: App Services, Container Apps, Entra ID / SSO configuration
• AWS experience: IAM, OIDC federation, API access management, CloudTrail or equivalent audit logging
• Python proficiency — configuration, pipeline scripting, environment management
• Experience deploying or configuring open‑source AI gateway or proxy tooling (LiteLLM or equivalent)
• Experience with NLP‑based PII/PHI detection frameworks (Microsoft Presidio or equivalent)
• Experience self‑hosting observability platforms (LangFuse, Langsmith, or similar)
• Comfort with HIPAA data handling requirements — you understand why data must not leave the environment unredacted

Strong Advantage

• Experience in a healthcare or regulated data environment
• Infrastructure‑as‑code experience (Terraform or Azure Bicep)
• Secrets management via Azure Key Vault or equivalent
• Prior exposure to HITRUST, SOC 2, or similar compliance frameworks from a technical evidence perspective
• Experience integrating AI capabilities into enterprise SaaS products

Who You Are

• You prefer precise, well‑documented infrastructure over clever engineering
• You treat compliance constraints as design inputs, not afterthoughts
• You can explain what you built to a non‑technical compliance officer and to a senior engineer — clearly, differently
• You have built things that ran in production without requiring constant hand‑holding

About This Opportunity

Neolytix is at an inflection point — moving from a services company to a technology‑enabled services company with proprietary platforms. The person in this role will be one of a small number of engineers who determine what that technology layer looks like. The work is real, the mandate is clear, and the infrastructure you build will be used in production by a healthcare company serving millions of patients.