GEN AI Engineer

Tata Consultancy Services; Charlotte (NC); On-site; USD 100,000 - 125,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage

Paid Time Off

401K Plan

Job summary

A leading IT services firm is seeking a Mid-Senior level candidate to design and operationalize GenAI capabilities, focusing on LLMs and RAG solutions in Charlotte, NC. Candidates should have 10+ years of experience, a relevant degree, and proficiency in tools like LangChain and OpenShift. The role offers a salary range of $100,000-$125,000, along with comprehensive employee benefits including medical coverage, paid time off, and financial assistance programs.

Qualifications

• 10+ years of experience designing and developing AI solution architecture to scale.
• Proven hands-on experience in GenAI Ops – operationalizing LLM and RAG applications in production.
• Experience measuring and optimizing inference latency.

Responsibilities

• Implement Guardrails and observability across RAG and LLM applications.
• Setup GenAI Ops workflows to continuously monitor key metrics.
• Build observability dashboards and alerts for AI reliability.

Skills

LangChain

Python

Data Science Libraries (NumPy, Pandas, scikit-learn, PyTorch/TensorFlow)

OpenShift/Kubernetes

AI Solution Architecture

Guardrails and Observability

GenAI Ops

Education

Bachelor’s or Master’s degree in Data Science, Computer Science, MIS, or related field

Tools

OpenAI API

Job description

Get AI-powered advice on this job and more exclusive features.

Overview

Role involves designing and operationalizing GenAI capabilities, including LLMs and RAG, with emphasis on guardrails, observability, and scalable AI solution architecture.

Responsibilities

• Implement Guardrails and observability across RAG and LLM applications
• Setup GenAI Ops workflows to continuously monitor inference latency, throughput, quality and safety metrics
• Define, track, and analyze RAG guardrail metrics using LLMs as Judges and SMLs (e.g., attribution, grounding, prompt injection, tone, PII leakage)
• Implement annotation, structured feedback loops, fine-tuning, and alignment methods to calibrate judge models
• Use LangChain to orchestrate guardrail checks, manage prompt versioning and integrate judge model scoring workflows
• Work with OpenShift to deploy, scale and monitor containerized GenAI services
• Build observability dashboards and alerts (Grafana or equivalent) for AI reliability
• Contribute to emerging evaluation and guardrails as autonomous AI workflows expand

Qualifications

• Bachelor’s or Master’s degree in Data Science, Computer Science, MIS, related field, or equivalent experience
• 10+ years of experience designing and developing AI solution architecture to scale
• Proven hands-on experience in GenAI Ops – operationalizing LLM and RAG applications in production
• Strong hands-on experience with the LangChain framework
• Experience specifically with the OpenAI API, chat completions, embeddings, etc.
• Solid awareness of TensorRT and VLLM implementation
• Strong proficiency in Python and data science libraries (NumPy, Pandas, scikit-learn, PyTorch/TensorFlow)
• Proven experience applying guardrails and observability to LLM or RAG-powered applications
• Experience with LLMs as Judges and SMLs for evaluation (attribution, adherence, bias, PII, etc.)
• Hands-on experience with OpenShift (or Kubernetes) for containerized AI workloads
• Experience measuring and optimizing inference latency

Salary

100,000-125,000 per annum

Benefits

TCS Employee Benefits Summary includes: Discretionary Annual Incentive; Comprehensive Medical Coverage (Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans); Family Support (Maternal & Parental Leaves); Insurance Options (Auto & Home Insurance, Identity Theft Protection); Convenience & Professional Growth (Commuter Benefits & Certification & Training Reimbursement); Time Off (Vacation, Time Off, Sick Leave & Holidays); Legal & Financial Assistance (Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing).

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Engineering and Information Technology

Industries

• IT Services and IT Consulting

Charlotte, NC