Senior GenAI Platform Engineer (MLOps & Cloud)

Tata Consultancy Services Limited; Oaks (PA); On-site; USD 110,000 - 130,000; Full time

Benefits offered by this job

Discretionary annual incentive

Comprehensive medical coverage

Parental leaves

Auto & home insurance

Certification & training reimbursement

Time off & holidays

Job summary

Tata Consultancy Services Limited in Oaks, PA, is seeking an experienced AI/ML platform engineer to design and operate enterprise-grade GenAI and LLM infrastructure. You will build scalable cloud-native and on-prem solutions, deploy model endpoints, and enable robust MLOps practices.

The role demands deep Kubernetes experience, Python programming, and hands-on work with cloud providers (AWS/Azure). Collaboration with security and data teams is essential.

Qualifications

• Strong cloud engineering and AI/ML platform experience.
• Kubernetes, containers, IaC, CI/CD, and API technologies.
• Proficiency in Python; Go/C++/Rust a plus.
• Experience with ML/LLM deployment and GenAI frameworks.
• Knowledge of vector databases, embeddings, model APIs, and AI orchestration.
• Experience with monitoring, telemetry, security, and production support.
• Hands-on Kubernetes, Docker, and cloud platforms (AWS/Azure).
• Familiarity with LangChain, LangGraph, Ray, Kubeflow; IaC tools Terraform/Ansible.

Responsibilities

• Build and maintain enterprise AI/ML and GenAI platform capabilities.
• Implement model endpoints, gateways, orchestration layers, and AI services.
• Develop infrastructure for LLMs/SLMs/RAG/embeddings and AI agents.
• Create automated deployment and CI/CD pipelines for AI apps and models.
• Enable MLOps/LLMOps: deployment, monitoring, versioning, observability.
• Support model routing, inference management, and cost optimization.
• Integrate AI platforms with enterprise security, logging, and networking.
• Automate infrastructure provisioning and platform configuration.
• Collaborate with AI architects, data engineers, and security teams.

Skills

Cloud engineering

AI/ML platform engineering

Python

Go/C++/Rust (optional)

Kubernetes

CI/CD

API technologies

ML/LLM deployment

AI orchestration

Education

Bachelor of Computer Science

Tools

Kubernetes

OpenShift

AWS

Azure

Terraform

Ansible

LangChain / Kubeflow

Job description

Tata Consultancy Services Limited in Oaks, PA, is seeking an experienced AI/ML platform engineer to design and operate enterprise-grade GenAI and LLM infrastructure. You will build scalable cloud-native and on-prem solutions, deploy model endpoints, and enable robust MLOps practices.

The role demands deep Kubernetes experience, Python programming, and hands-on work with cloud providers (AWS/Azure). Collaboration with security and data teams is essential.