Senior Ai Platform Engineer

Tata Consultancy Services; Oaks (PA); On-site; USD 110,000 - 130,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage: Health

Family Support: Parental Leaves

Insurance Options: Auto & Home

Certification & Training Reimbursement

Vacation, Time Off, Holidays

401K Plan

Performance Bonus

College Fund

Student Loan Refinancing

Job summary

Tata Consultancy Services Limited in Oaks, PA, is seeking a Senior Engineer to advance enterprise AI/ML and GenAI platform capabilities. You will design and implement model endpoints, gateways, and orchestration layers to support large language models and AI workloads.

Ideal candidates have deep cloud engineering experience, Python expertise, and hands-on work with Kubernetes, IaC, and ML deployment pipelines. Collaboration with AI architects and security teams is essential.

Qualifications

• Extensive cloud and AI/ML platform engineering experience.
• Hands-on with Kubernetes, containers, IaC, CI/CD, and APIs.
• Strong Python software engineering background.
• Experience with ML/LLM deployment and GenAI frameworks.
• Familiar with vector databases, embeddings, model APIs, and AI orchestration.
• Experience with monitoring, telemetry, security and production support.
• Proficiency in Python; Go/C++/Rust preferred.
• Hands-on with cloud platforms like AWS/Azure and AI services.
• Familiarity with LangChain, LangGraph, Ray, Kubeflow.
• IaC tools like Terraform and Ansible.

Responsibilities

• Build and maintain enterprise AI/ML and GenAI platform capabilities.
• Implement model endpoints, gateways, orchestration layers, and AI services.
• Build infrastructure supporting LLMs, embedding stores, and AI agents.
• Develop automated deployment and CI/CD pipelines for AI applications and models.
• Implement LLMOps/MLOps capabilities covering deployment, monitoring, evaluation, versioning, and observability.
• Implement model-routing and inference-management capabilities.
• Support token, compute, latency, and inference-cost optimization.
• Integrate AI platforms with enterprise identity, security, logging, monitoring, networking, and API-management services.
• Automate infrastructure provisioning and platform configuration.
• Establish production reliability, scalability, resilience, and operational standards.
• Partner with AI architects, application engineers, data engineers, and security teams.

Skills

Cloud engineering

Kubernetes

Containers

IaC

CI/CD

APIs

Python

Go/C++/Rust

AI/ML platform engineering

LLM/GenAI deployment

LangChain/LangGraph/Ray/Kubeflow

Terraform

Ansible

AWS SageMaker/Bedrock

Azure AI Foundry/OpenAI

LangChain

MLOps

Security/Monitoring

Education

Bachelor's degree in Computer Science

Tools

AWS SageMaker

AWS Bedrock

Azure AI Foundry

OpenShift

Terraform

Ansible

LangChain

Job description

Must Have Technical/Functional Skills

• Strong cloud engineering and AI/ML platform engineering experience.
• Kubernetes, containers, Infrastructure as Code, CI/CD, and API technologies.
• Python and software engineering experience.
• Experience with ML/LLM deployment and GenAI frameworks.
• Knowledge of vector databases, embedding models, model APIs, and AI orchestration.
• Experience with monitoring, telemetry, security, and production support.
• Programming: Advanced proficiency in Python; additional experience in Go, C++, or Rust is often preferred.
• Infrastructure & Cloud: Hands‑on expertise with Kubernetes, Docker, and cloud platforms like AWS (SageMaker, Bedrock) or Azure (AI Foundry, OpenAI).
• AI Frameworks: Familiarity with orchestration and LLM tooling such as LangChain, LangGraph, Ray, or Kubeflow.
• Infrastructure-as-Code (IaC): Knowledge of automation tools like Terraform and Ansible.

Roles & Responsibilities

• Build and maintain enterprise AI/ML and GenAI platform capabilities.
• Implement model endpoints, gateways, orchestration layers, and AI services.
• Build infrastructure supporting LLMs, SLMs, RAG, embeddings, vector stores, and AI agents.
• Develop automated deployment and CI/CD pipelines for AI applications and models.
• Implement LLMOps/MLOps capabilities covering deployment, monitoring, evaluation, versioning, and observability.
• Implement model-routing and inference‑management capabilities.
• Support token, compute, latency, and inference‑cost optimization.
• Integrate AI platforms with enterprise identity, security, logging, monitoring, networking, and API‑management services.
• Automate infrastructure provisioning and platform configuration.
• Establish production reliability, scalability, resilience, and operational standards.
• Partner with AI architects, application engineers, data engineers, and security teams.
• Platform Architecture: Design and deploy scalable, cloud‑native or bare‑metal infrastructure (using Kubernetes, OpenShift, or AWS/Azure) to support large language models (LLMs) and machine learning workloads.
• Model Operations (MLOps/LLMOps): Optimize model serving, inference performance, GPU utilization, and automated pipelines for fine‑tuning and deploying AI models.
• Agentic & GenAI Integration: Build and maintain shared services like AI gateways, Retrieval‑Augmented Generation (RAG) frameworks, and autonomous agent orchestration platforms.
• Governance & Security: Enforce enterprise data protection, compliance, auditability, and cybersecurity standards across all AI tooling.
• Developer Enablement: Create self‑service platforms, APIs, and monitoring/observability tools so internal software and data science teams can safely adopt AI capabilities.

TCS Employee Benefits Summary:

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimburseme nt.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
• Salary Range $110,000 - $130,000 a year

Location

Oaks, PA

Function

TECHNOLOGY

Role

Senior Engineer

ID

434465

Skills

Artificial Intelligence

Salary Range

$110,000 - $130,000

Desired Candidate Profile

Qualifications

BACHELOR OF COMPUTER SCIENCE