GenAI Solutions Architect: LLM/RAG & Guardrails

Tata Consultancy Services; Charlotte (NC); On-site; USD 100,000 - 125,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage

Paid Time Off

401K Plan

Job summary

A leading IT services firm is seeking a Mid-Senior level candidate to design and operationalize GenAI capabilities, focusing on LLMs and RAG solutions in Charlotte, NC. Candidates should have 10+ years of experience, a relevant degree, and proficiency in tools like LangChain and OpenShift. The role offers a salary range of $100,000-$125,000, along with comprehensive employee benefits including medical coverage, paid time off, and financial assistance programs.

Qualifications

• 10+ years of experience designing and developing AI solution architecture to scale.
• Proven hands-on experience in GenAI Ops – operationalizing LLM and RAG applications in production.
• Experience measuring and optimizing inference latency.

Responsibilities

• Implement Guardrails and observability across RAG and LLM applications.
• Setup GenAI Ops workflows to continuously monitor key metrics.
• Build observability dashboards and alerts for AI reliability.

Skills

LangChain

Python

Data Science Libraries (NumPy, Pandas, scikit-learn, PyTorch/TensorFlow)

OpenShift/Kubernetes

AI Solution Architecture

Guardrails and Observability

GenAI Ops

Education

Bachelor’s or Master’s degree in Data Science, Computer Science, MIS, or related field

Tools

OpenAI API

Job description

A leading IT services firm is seeking a Mid-Senior level candidate to design and operationalize GenAI capabilities, focusing on LLMs and RAG solutions in Charlotte, NC. Candidates should have 10+ years of experience, a relevant degree, and proficiency in tools like LangChain and OpenShift. The role offers a salary range of $100,000-$125,000, along with comprehensive employee benefits including medical coverage, paid time off, and financial assistance programs.