LLM Engineer

University of North Carolina - Chapel Hill; Elkins Hills (NC); On-site; USD 90,000 - 130,000; Part time

Job summary

University of North Carolina at Chapel Hill seeks an LLM Engineer to design, build, and operate large language model–powered tools and applications across the institution. The engineer will work with the CAIO office and University Library on two flagship initiatives: PromptLab and Carolina Source.

Minimum education includes a Master’s or Bachelor’s with 0–2 years’ experience (or equivalent). Proficiency in Python, LangChain, LlamaIndex, and transformers is required, along with cloud,

Qualifications

• Bachelor's degree in CS/DS/InfoSci or related field.
• Experience building and deploying production-grade LLM-powered applications.
• Proficiency in Python and frameworks including LangChain, LlamaIndex, Transformers, or equivalent.
• Familiarity with RAG architectures, vector databases and embedding models.
• Experience with major LLM APIs (OpenAI, Anthropic, Google) and open-source options.
• Cloud platforms and containerization (Azure, AWS, GCP; Docker, Kubernetes).
• Web app development using JavaScript/TypeScript/Node.js/React.

Responsibilities

• Design, build, and operate large language model-powered tools across the institution.
• Collaborate with the CAIO office and University Library on flagship AI initiatives (PromptLab and Carolina Source).
• Contribute to architecture, deployment, monitoring, and recovery of AI systems.

Education

Bachelor's in Computer Science, Data Science, Information Science, or related field

Master's degree preferred

Tools

Python

LangChain

LlamaIndex

Hugging Face Transformers

OpenAI APIs

Azure

AWS

GCP

Docker

Kubernetes

JavaScript/TypeScript/Node.js/React

Job description

Posting Information

• Department: OEVCP - Provost - 501001
• Career Area: Information Technology
• Application Deadline: 09/28/2026
• Position Type: Temporary Staff (EHRA NF)
• Position Title: LLM Engineer
• Position Number: 20078673
• Vacancy ID: N000892
• Full-time/Part-time:
• FTE: 1
• Hours Per Week: 40
• Position Location: North Carolina, US
• Proposed Start Date: 10/12/2026
• Estimated Duration of Appointment: 8 months

Position Information

Be a Tar Heel!

A global higher education leader in innovative teaching, research and public service, the University of North Carolina at Chapel Hill consistently ranks as one of the nation's top public universities. Known for its beautiful campus, world-class medical care, commitment to the arts and top athletic programs, Carolina is an ideal place to teach, work and learn.

One of the best college towns and best places to live in the United States, Chapel Hill has diverse social, cultural, recreation and professional opportunities that span the campus and community.

University employees can choose from a wide range of professional training opportunities for career growth, skill development and lifelong learning and enjoy exclusive perks that include numerous retail and restaurant discounts, savings on local child care centers and special rates for performing arts events.

Primary Purpose of Organizational Unit

As the University's Chief Academic Officer, the Provost has broad responsibilities for advancing the education and research missions of the University. The Office of the Executive Vice Chancellor and Provost (OEVCP) provides the leadership for UNC's strategic planning for academic programs. The Provost's organization ensures the development and enhancement of high quality baccalaureate, masters and doctoral-level programs through ongoing program review and assessment, the raising of academic standards, and the expansion of research and other scholarship/creative activity.

Position Summary

The LLM Engineer will design, build, and operate large language model-powered tools and applications across the institution. Working within the CAIO office and in close collaboration with the University Library, the engineer will contribute to two flagship initiatives: PromptLab, UNC's shared generative AI service built on LibreChat, and Carolina Source, a proposed institutional knowledge platform with a governed retrieval layer and federated applications.

Minimum Education and Experience Requirements

Master's or Bachelor's and 0-2 years' experience; or will accept a combination of related education and experience in substitution.

Required Qualifications, Competencies, and Experience

• Bachelor's degree in Computer Science, Data Science, Information Science, or a related field
• Demonstrated experience building and deploying production-grade LLM-powered applications
• Proficiency in Python and relevant frameworks including LangChain, LlamaIndex, Hugging Face Transformers, or equivalent
• Experience with RAG architectures, vector databases, and embedding models
• Familiarity with major LLM APIs including OpenAI, Anthropic, Google, and open-source alternatives
• Working knowledge of cloud platforms (Azure, AWS, or GCP) and containerization (Docker, Kubernetes)
• Experience with web application development using JavaScript, TypeScript, Node.js, or React
• Experience with platform operations including monitoring, incident investigation, upgrades, and recovery

Preferred Qualifications, Competencies, and Experience

• Master's degree in Computer Science, Artificial Intelligence, Computational Linguistics, Information Science, or a related field
• Experience with LibreChat, LiteLLM, or similar open-source generative AI platforms
• Experience designing or implementing enterprise search and knowledge retrieval platforms (Azure AI Search, Elasticsearch, OpenSearch, or equivalent)
• Familiarity with data governance frameworks, access control design, and permission-based retrieval architectures
• Experience building federated application architectures on top of shared knowledge or data platforms

Campus Security Authority Responsibilities

Not Applicable.

Special Instructions

H-1B sponsorship is not available for this position.

Contact Information

If you experience any problems accessing the system or have questions about the application process, please contact the Office of Human Resources at [phone] or send an email to [e-mail]. Please note: The Office of Human Resources will not be able to provide specific updates regarding position or application status.

Equal Opportunity Employer Statement

The University is an equal opportunity employer and welcomes all to apply without regard to age, color, gender, gender expression, gender identity, genetic information, national origin, race, religion, sex, or sexual orientation. We encourage all qualified applicants to apply, including protected veterans and individuals with disabilities.