Senior AI Platform Engineer - GenAI & MLOps

Tata Consultancy Services Limited; Oaks (PA); On-site; USD 110,000 - 130,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage: Health

Family Support: Parental Leaves

Insurance Options: Auto & Home

Certification & Training Reimbursement

Vacation, Time Off, Holidays

401K Plan

Performance Bonus

College Fund

Student Loan Refinancing

Job summary

Tata Consultancy Services Limited in Oaks, PA, is seeking a Senior Engineer to advance enterprise AI/ML and GenAI platform capabilities. You will design and implement model endpoints, gateways, and orchestration layers to support large language models and AI workloads.

Ideal candidates have deep cloud engineering experience, Python expertise, and hands-on work with Kubernetes, IaC, and ML deployment pipelines. Collaboration with AI architects and security teams is essential.

Qualifications

• Extensive cloud and AI/ML platform engineering experience.
• Hands-on with Kubernetes, containers, IaC, CI/CD, and APIs.
• Strong Python software engineering background.
• Experience with ML/LLM deployment and GenAI frameworks.
• Familiar with vector databases, embeddings, model APIs, and AI orchestration.
• Experience with monitoring, telemetry, security and production support.
• Proficiency in Python; Go/C++/Rust preferred.
• Hands-on with cloud platforms like AWS/Azure and AI services.
• Familiarity with LangChain, LangGraph, Ray, Kubeflow.
• IaC tools like Terraform and Ansible.

Responsibilities

• Build and maintain enterprise AI/ML and GenAI platform capabilities.
• Implement model endpoints, gateways, orchestration layers, and AI services.
• Build infrastructure supporting LLMs, embedding stores, and AI agents.
• Develop automated deployment and CI/CD pipelines for AI applications and models.
• Implement LLMOps/MLOps capabilities covering deployment, monitoring, evaluation, versioning, and observability.
• Implement model-routing and inference-management capabilities.
• Support token, compute, latency, and inference-cost optimization.
• Integrate AI platforms with enterprise identity, security, logging, monitoring, networking, and API-management services.
• Automate infrastructure provisioning and platform configuration.
• Establish production reliability, scalability, resilience, and operational standards.
• Partner with AI architects, application engineers, data engineers, and security teams.

Skills

Cloud engineering

Kubernetes

Containers

IaC

CI/CD

APIs

Python

Go/C++/Rust

AI/ML platform engineering

LLM/GenAI deployment

LangChain/LangGraph/Ray/Kubeflow

Terraform

Ansible

AWS SageMaker/Bedrock

Azure AI Foundry/OpenAI

LangChain

MLOps

Security/Monitoring

Education

Bachelor's degree in Computer Science

Tools

AWS SageMaker

AWS Bedrock

Azure AI Foundry

OpenShift

Terraform

Ansible

LangChain

Job description

Tata Consultancy Services Limited in Oaks, PA, is seeking a Senior Engineer to advance enterprise AI/ML and GenAI platform capabilities. You will design and implement model endpoints, gateways, and orchestration layers to support large language models and AI workloads.

Ideal candidates have deep cloud engineering experience, Python expertise, and hands-on work with Kubernetes, IaC, and ML deployment pipelines. Collaboration with AI architects and security teams is essential.