LLM Engineer (Remote)

Cognizant; Trenton (NJ); Remote; USD 81,000 - 142,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays plus Paid Time Off

401(k) plan and contributions

Long-term/Short-term Disability

Paid Parental Leave

Employee Stock Purchase Plan

Job summary

Cognizant is seeking an experienced LLM Engineer to design, build, and optimize enterprise-grade generative AI solutions. You will collaborate with data scientists, platform engineers, product teams, and business stakeholders to deliver scalable, production-ready LLM/SLM capabilities.

In this role you will implement fine-tuning, model adaptation, and evaluation pipelines, apply optimization techniques, and assess models for quality, cost, and scalability in a dynamic enterprise environment.

Qualifications

• 7+ years of experience in Software/AI Engineering or related fields.
• 2+ years hands-on experience developing and deploying Generative AI, LLM, SLM in production.
• Experience building enterprise-grade AI applications utilizing LLMs, Retrieval-Augmented Generation (RAG), prompt engineering, APIs, and cloud or on-premises platforms.
• Strong understanding of model fine-tuning, adaptation, evaluation frameworks, and AI quality measurement methodologies.
• Proficiency in machine learning development, model deployment, and MLOps best practices.
• Experience working with Python and modern AI/ML frameworks and tools.

Responsibilities

• Design, build, fine-tune, deploy, and optimize LLM and SLM solutions for enterprise-scale use cases.
• Develop and maintain supervised fine-tuning, model adaptation, and evaluation pipelines.
• Apply advanced model optimization techniques including LoRA, QLoRA, distillation, quantization, and model compression.
• Assess commercial, open-source, and internally hosted foundation models based on quality, cost, scalability, and operational requirements.
• Collaborate with cross-functional teams to support domain-specific AI solutions using approved enterprise datasets and best practices for responsible AI.

Skills

LLM/SLM development

Python

MLOps

Model fine-tuning

RAG

APIs

Cloud platforms

Tools

PyTorch

TensorFlow

JAX

LoRA

QLoRA

Job description

LLM Engineer

About the role

As LLM Engineer , you will make an impact by designing, building, optimizing, and deploying Large Language Model (LLM) and Small Language Model (SLM) solutions that power the enterprise Agent Factory. You will be a valued member of the AI Engineering team and work collaboratively with data scientists, platform engineers, product teams, and business stakeholders to deliver scalable, production-ready generative AI capabilities.

In this role, you will:

• Design, build, fine-tune, deploy, and optimize LLM and SLM solutions for enterprise-scale use cases.
• Develop and maintain supervised fine-tuning, model adaptation, and evaluation pipelines.
• Apply advanced model optimization techniques including LoRA, QLoRA, distillation, quantization, and model compression to improve performance and efficiency.
• Assess commercial, open-source, and internally hosted foundation models based on quality, cost, scalability, and operational requirements.
• Collaborate with cross-functional teams to support domain‑specific AI solutions using approved enterprise datasets and best practices for responsible AI.

Work model:

We strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a remote position open to qualified applicants in Louisville, KY. Regardless of your working arrangement, we are here to support a healthy work‑life balance through our various wellbeing programs.

Please note that this position is not eligible for visa transfer or sponsorship now or at any time in the future

What you need to have to be considered

• 7+ years of experience in Software Engineering, AI Engineering, Machine Learning Engineering, Platform Engineering, or a related technical discipline.
• 2+ years of hands‑on experience developing and deploying Generative AI, LLM, SLM, or Agentic AI solutions in production environments.
• Experience building enterprise‑grade AI applications utilizing LLMs, Retrieval‑Augmented Generation (RAG), prompt engineering, APIs, and cloud or on‑premises platforms.
• Strong understanding of model fine‑tuning, adaptation, evaluation frameworks, and AI quality measurement methodologies.
• Proficiency in machine learning development, model deployment, and MLOps best practices.
• Experience working with Python and modern AI/ML frameworks and tools.

These will help you stand out

• Knowledge of AI infrastructure, GPU optimization, and large‑scale model serving.
• Experience implementing model governance, responsible AI, and evaluation frameworks.
• Familiarity with vector databases, embedding models, and advanced RAG architectures.
• Experience building enterprise AI platforms, multi‑agent systems, or agent orchestration frameworks.

Salary and Other Compensation:

Applications will be accepted until September 17th, 2026.

The annual salary for this position is between $ 81,337 to $141,500 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long‑term/Short‑term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.