Tech S And T - AI Integration Engineer Senior - GDSN02

EY; Chennai District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

EY is seeking an AI Integration Engineer in Chennai to build end-to-end AI/ML pipelines, develop Python models, and implement LLM/RAG systems with vector databases. You will tune and optimize models, serve at scale with KServe/Seldon, and integrate with secure CI/CD and IaC workflows.

The role requires 4–7 years of hands-on experience, strong cloud fundamentals, and a collaborative mindset to work with Data, AI/ML, DevOps, and Security teams.

Qualifications

• 4-7 years hands-on AI/ML engineering experience.
• Strong expertise in Terraform, Kubernetes, Helm, Docker and modern CI/CD pipelines using GitHub Actions, GitLab CI, Jenkins or Azure DevOps.
• Proficient in Python with FastAPI and ML libraries (PyTorch/TensorFlow); scripting for automation.
• Solid experience in DevSecOps: SAST/DAST, secret scanning, SBOM, policy-as-code.
• Hands-on exposure to MLOps platforms and AI integration tools (MLflow, Kubeflow, Weights & Biases).
• Experience building RAG/LLM pipelines with LangChain, LlamaIndex and vector DBs (Pinecone/FAISS/Weaviate).
• Cloud fundamentals across AWS/Azure/GCP; IaC and GitOps (Argo CD/Flux) for secure infra.
• Monitoring/observability stacks: Prometheus, Grafana, OpenTelemetry, ELK/Loki.

Responsibilities

• Build end-to-end AI/ML pipelines (training → evaluation → deployment) with experiment tracking and model registries.
• Develop models in Python and package as reproducible services.
• Implement LLM/RAG systems with LangChain, LlamaIndex, and vector databases for semantic retrieval.
• Fine-tune and optimize models using PEFT/LoRA/QLoRA; export via ONNX/TorchScript/TensorRT.
• Engineer scalable model serving with KServe, Seldon Core, BentoML, or Ray Serve.
• Build evaluation harnesses and CI/CD gates for offline/online evaluation.
• Construct feature stores and data contracts; enforce data quality with Great Expectations/Deequ.
• Orchestrate event-driven pipelines with Airflow/Prefect/Dagster; streaming with Kafka/RabbitMQ/NATS.
• Design Python microservices with FastAPI/gRPC; integrate with REST/GraphQL; automate with Python/Bash/PowerShell
• Use notebooks and packaging tools (Jupyter, Poetry) with virtualenvs and artifacts for promotion across stages.
• Apply testing & quality: pytest, unit/integration/e2e tests, linting, type checks, pre-commit.

Skills

Terraform

Kubernetes

Helm

Docker

CI/CD pipelines

Python

FastAPI

PyTorch/TensorFlow

RAG/LLM integration

MLflow/Kubeflow/W&B

Education

B.Tech./BS in Computer Science

Tools

MLflow

Kubeflow

Weights & Biases

LangChain

LlamaIndex

Pinecone

FAISS

Weaviate

Chroma

KServe

Seldon Core

BentoML

Ray Serve

Kafka

RabbitMQ

NATS

Prometheus

Grafana

OpenTelemetry

Jaeger

Argo CD

Flux

Job description

Job Description:

Designation AI Integration Engineer

Job Description

• Build end-to-end AI/ML pipelines (training → evaluation → deployment) using MLflow/Kubeflow/Databricks/Weights & Biases with experiment tracking and model registries.
• Develop models with Python using PyTorch, TensorFlow, JAX, scikit-learn, and Hugging Face Transformers, package as reproducible services.
• Implement LLM/RAG systems with LangChain, LlamaIndex, Semantic Kernel and vector DBs (Pinecone, Weaviate, Milvus, FAISS, Chroma) for semantic retrieval and grounding.
• Fine-tune and optimize models using PEFT/LoRA/QLoRA, DeepSpeed/Accelerate, distillation, and quantization; export/optimize via ONNX Runtime/TorchScript/TensorRT.
• Engineer scalable model serving with KServe, Seldon Core, BentoML, Ray Serve, NVIDIA Triton, supporting A/B, canary, shadow deployments.
• Build evaluation harnesses (offline/online) with Ragas, TruLens, Promptfoo, golden datasets, and regression gates integrated into CI/CD.
• Construct feature stores (e.g., Feast) and data contracts (Protobuf/Avro/Pydantic); enforce data quality with Great Expectations/Deequ.
• Orchestrate event-driven pipelines with Airflow/Prefect/Dagster; streaming/messaging via Kafka/RabbitMQ/NATS and schema registries.
• Design Python microservices using FastAPI/gRPC; integrate with downstream systems via REST/GraphQL; write robust automation in Python/Bash/PowerShell and SQL for data ops.
• Use notebooks (Jupyter) and packaging (Poetry/pip/conda) with virtualenvs, environment locking, and artifacts suitable for promotion across stages.
• Apply testing & quality: pytest, unit/integration/e2e tests, property-based (hypothesis), linters/formatters (ruff/flake8, black), type checks (mypy/pyright), pre-commit.
• Deliver IaC with Terraform/Pulumi; manage config via Helm/Kustomize; implement GitOps with Argo CD/Flux on managed/self-hosted Kubernetes.
• Build secure CI/CD (GitHub Actions/GitLab CI/Jenkins/Azure DevOps) for app/data/ML artifacts, artifact promotion, provenance, and automated rollbacks.
• Embed DevSecOps: SAST/DAST/IAST (Snyk/Checkmarx/SonarQube), container & IaC scanning (Trivy), dependency hygiene (Dependabot/Renovate), SBOM (Syft/CycloneDX).
• Enforce policy-as-code (OPA/Gatekeeper, Kyverno), image signing/verification (Sigstore/cosign), supply-chain standards (SLSA, in-toto).
• Manage secrets/KMS with Vault and native managers; adopt short-lived workload identities, mTLS, and least-privilege RBAC/ABAC in clusters and pipelines.
• Implement AI safety & governance: prompt-injection defenses, output filtering, PII redaction, guardrails (Guardrails.ai/NeMo Guardrails/Presidio), policy checks.
• Monitor model/data drift, bias, and performance with Evidently/WhyLabs/Arize/Fiddler; unify telemetry via OpenTelemetry, Prometheus, Grafana, ELK/Loki, Jaeger.
• Optimize compute/GPU: CUDA/cuDNN/NCCL, HPA/VPA/KEDA, efficient batching, caching, concurrency control; track cost and latency SLOs.
• Implement progressive delivery for services/models (blue/green, canary, shadow) using Argo Rollouts/Flagger with instant rollback and health checks.
• Operate API gateways and service mesh (Kong/NGINX/Envoy, Istio/Linkerd) for rate limiting, mTLS, authN/Z, and zero-trust patterns.
• Ensure privacy/compliance (GDPR/CCPA/DPDP/ISO 27001): data minimization, masking/tokenization, DLP, lineage (OpenLineage/Marquez), model cards/data sheets.
• Collaborate with security, data, and platform teams to publish golden paths, templates, and reference implementations for repeatable AI delivery.
• Contribute to code/design reviews and SRE practices (SLIs/SLOs/error budgets), on-call readiness, incident response, and blameless post-mortems.

Desired Profile

• Looking for a DevSecOps & AI Engineer with 4-7 years of hands-on experience in cloud platforms, automation, and AI/ML engineering workflows.
• Strong expertise in Terraform, Kubernetes, Helm, Docker, and modern CI/CD pipelines using GitHub Actions, GitLab CI, Jenkins, or Azure DevOps.
• Proficient in Python with experience in FastAPI, ML libraries (PyTorch/TensorFlow), and scripting using Bash or PowerShell for automation.
• Solid experience in DevSecOps practices including SAST/DAST, container/IaC scanning, secrets scanning, SBOM, and policy-as-code frameworks.
• Hands-on exposure to MLOps and AI integration using tools like MLflow, Kubeflow, Weights & Biases, KServe, Seldon Core, or BentoML.
• Experience building or integrating RAG/LLM pipelines using LangChain, LlamaIndex, or vector databases (Pinecone/FAISS/Weaviate).
• Strong cloud fundamentals across AWS/Azure/GCP with ability to architect secure, automated infrastructure via IaC and GitOps (Argo CD/Flux).
• Familiarity with monitoring and observability stacks (Prometheus, Grafana, OpenTelemetry, ELK/Loki) for application and model performance.
• Strong troubleshooting, problem-solving, and system debugging skills with a collaborative, engineering-first mindset.
• Excellent communication skills with ability to work cross-functionally with Data, AI/ML, DevOps, Security, and Platform Engineering teams.

Experience 4 To 7 Years

Education B.Tech. / BS in Computer Science

Technical Skills & Certifications

• Terraform, Pulumi, and IaC for automated cloud and platform provisioning.
• Kubernetes, Docker/Podman, Helm, and Kustomize for container orchestration and packaging.
• CI/CD pipelines using GitHub Actions, GitLab CI, Jenkins, and Azure DevOps.
• Proficient in Python (FastAPI, ML/LLM libraries) and scripting with Bash/PowerShell.
• DevSecOps tooling: Snyk, SonarQube, Trivy, Checkmarx, GitLeaks, and secret scanning.
• MLOps platforms: MLflow, Kubeflow, W&B, Azure ML, Vertex AI for model lifecycle management.
• Model serving frameworks: KServe, Seldon Core, BentoML, Ray Serve for scalable inference.
• RAG/LLM integration: LangChain, LlamaIndex, vector DBs (Pinecone, Weaviate, FAISS, Chroma).
• Monitoring & observability: Prometheus, Grafana, ELK/Loki, OpenTelemetry, Jaeger.
• GitOps tools (Argo CD, Flux), configuration management (Ansible/Puppet), and serverless functions.

EY | Building a better working world

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets. Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate. Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.

Requirements