Senior Generative AI Developer (LLM / RAG / Python) – Hybrid | Raleigh, NC

Connectdotssolution

Raleigh (NC)

Hybrid

USD 80,000 - 113,000

Full time

17 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

ConnectDotsSolution LLC seeks aSenior Generative AI Developer to design, develop, and deploy production-grade AI solutions for NC DHHS. You will work on LLM-powered apps, RAG pipelines, model fine-tuning, and enterprise data integration in a secure cloud-native environment.

The role requires strong Python, cloud-native development, and experience delivering scalable AI applications with a focus on security, governance, and Responsible AI practices. Hybrid onsite in Raleigh, NC.

Qualifications

  • Hands-on experience building production-grade Generative AI or ML apps.
  • Advanced Python programming skills.
  • Experience with LLMs, prompt engineering, RAG, and AI agents.

Responsibilities

  • Design, develop, and deploy LLM-powered apps, prompts, and agent workflows.
  • Build RAG pipelines integrating vector databases, SQL/NoSQL, and enterprise data sources.
  • Fine-tune models and use adapter-based techniques.
  • Develop secure data ingestion pipelines with metadata and PII protection.
  • Design scalable microservices and APIs for enterprise AI integration.
  • Apply encryption, access controls, and security best practices for data.
  • Implement Responsible AI practices, bias mitigation, and privacy protections.
  • Build and maintain CI/CD pipelines for AI models and services.
  • Monitor model performance, cost, reliability, and drift.
  • Collaborate with engineering, security, data, product, and governance teams.

Skills

Python
LLMs
Prompt engineering
RAG architectures
Fine-tuning
Vector databases
Cloud-native
APIs/microservices
Data security
CI/CD

Tools

Vector databases
APIs

Job description

Client: North Carolina Department of Health and Human Services (NC DHHS)

Requisition ID: 814296

Employment Type: Contract – W-2

Pay: $70+per hour W-2

Contract Duration: November 16, 2026 – November 15, 2027

Candidate Submission Deadline: November 25, 2026

About the Opportunity

ConnectDotsSolution is seeking a highly skilled Senior Generative AI Developer to support NC DHHS.

The selected candidate will design, develop, and deploy production-grade AI solutions using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), model fine-tuning, and secure enterprise data systems.

This position requires strong Python development skills, cloud-native engineering, enterprise data integration, and experience delivering secure, scalable AI applications.

Key Responsibilities
  • Design, develop, and deploy LLM-powered applications, prompts, and intelligent agent workflows.
  • Build RAG pipelines integrating vector databases, SQL, NoSQL, and enterprise data sources.
  • Customize AI models using fine-tuning and adapter-based techniques.
  • Develop secure data ingestion pipelines for structured and unstructured content, including metadata management and PII protection.
  • Design and implement scalable microservices and APIs for enterprise AI integration.
  • Apply encryption, access controls, AI safety measures, and secure data-handling practices.
  • Implement Responsible AI principles, including bias mitigation, fairness, and privacy protection.
  • Build and maintain CI/CD pipelines for AI models and services.
  • Monitor model performance, reliability, cost, and drift.
  • Collaborate with engineering, security, data, product, and governance teams.
Required Qualifications
  • Hands-on experience developing and deploying production-grade Generative AI or machine learning applications.
  • Advanced Python programming skills.
  • Experience with LLMs, prompt engineering, RAG architectures, and AI agent workflows.
  • Experience with model fine-tuning and adapter techniques.
  • Experience integrating relational, NoSQL, and vector databases.
  • Strong understanding of cloud-native development, APIs, microservices, and data engineering.
  • Knowledge of AI security, encryption, access controls, data privacy, and PII protection.
  • Experience with CI/CD pipelines, application monitoring, and production support.
  • Understanding of Responsible AI practices and enterprise governance.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Qualifications
  • Experience implementing AI solutions in healthcare, government, or regulated environments.
  • Familiarity with enterprise AI governance and compliance frameworks.
  • Experience optimizing LLM performance, inference costs, and production reliability.
  • Experience integrating AI solutions into existing enterprise applications.
Work Arrangement

This is a hybrid contract position based in Raleigh, North Carolina 27607.

Candidates must be available to work onsite as required.

ConnectDotsSolution LLC is an equal opportunity employer. Employment eligibility and engagement arrangements are subject to applicable contract requirements.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Generative AI Developer
Senior Generative AI Developer

DataStaff, Inc. • Raleigh (NC)

Hybrid
USD 140,000 - 180,000
Medical, dental, and vision coverage
401k after 6 months
Paid vacation and holidays
Senior Generative AI Developer - Contract (Raleigh, NC - Hybrid)
Senior Generative AI Developer - Contract (Raleigh, NC - Hybrid)

Mfinite Consulting LLC • Raleigh (NC)

Hybrid
USD 96,000 - 165,000
Hybrid work arrangement
Equal Opportunity Employer
Senior Generative AI Engineer: LLMs, RAG, Python
Senior Generative AI Engineer: LLMs, RAG, Python

Connectdotssolution • Raleigh (NC)

Hybrid
USD 80,000 - 113,000
Senior Generative AI Developer
Senior Generative AI Developer

Infinitek Limited • Raleigh (NC)

On-site
USD 140,000 - 190,000
Senior Generative AI Developer - Contract
Senior Generative AI Developer - Contract

Mfinite Consulting LLC • Raleigh (NC)

Hybrid
USD 83,000 - 165,000
Senior Generative AI Developer
Senior Generative AI Developer

HonorVet Technologies • Raleigh (NC)

Hybrid
USD 110,000 - 160,000
Senior Generative AI Developer
Senior Generative AI Developer

Equiliem • Raleigh (NC)

Hybrid
USD 96,000 - 103,000
Senior Gen AI Developer
Senior Gen AI Developer

Ventures Unlimited Inc • Raleigh (NC)

Hybrid
USD 120,000 - 190,000
Senior Generative AI Engineer — Secure LLM & RAG Architect
Senior Generative AI Engineer — Secure LLM & RAG Architect

Infinitek Limited • Raleigh (NC)

On-site
USD 140,000 - 190,000
Senior Generative AI Engineer - LLMs, RAG & Secure AI
Senior Generative AI Engineer - LLMs, RAG & Secure AI

DataStaff, Inc. • Raleigh (NC)

Hybrid
USD 140,000 - 180,000
Medical, dental, and vision coverage
401k after 6 months
Paid vacation and holidays