Senior Generative AI Engineer - LLMs, RAG & Secure AI

DataStaff, Inc.

Raleigh (NC)

Hybrid

USD 140,000 - 180,000

Full time

5 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, dental, and vision coverage
401k after 6 months
Paid vacation and holidays

Job summary

DataStaff, Inc. is seeking a Senior Generative AI Developer in Raleigh, NC for a long-term contract. The role requires building and deploying AI solutions with LLMs, RAG, and secure data handling. Hybrid work arrangement includes two onsite days weekly.

The ideal candidate will have extensive Python experience, cloud platform expertise (Azure/AWS/GCP), and a track record in implementing Responsible AI practices, security controls, and scalable microservices.

Qualifications

  • 3+ years hands-on experience in applied ML or Generative AI.
  • 3+ years experience with a major cloud platform (Azure, AWS, or GCP).
  • 3+ years Python development with LLM frameworks (LangChain, Semantic Kernel, LangGraph).
  • 2+ years experience building RAG pipelines or LLM-driven applications.
  • 2+ years experience with vector databases (Pinecone, Weaviate, Milvus, FAISS).
  • 5+ years SQL experience, including data modeling, transformations, and performance tuning.
  • 2+ years NoSQL/document databases (MongoDB, Cosmos DB, DynamoDB).
  • 2+ years implementing AI security controls such as encryption, RBAC, API security, and secret management.
  • 2+ years applying Responsible AI principles, including bias testing, hallucination mitigation, and privacy safeguards.
  • 5+ years building and integrating microservices using FastAPI, Node.js, or Azure Functions.
  • 3+ years Agile (Scrum, Kanban, or SAFe) development.
  • 3+ years organizing, prioritizing, and following complex technical procedures.

Responsibilities

  • Build and deploy LLM-driven features, prompts, and agent workflows.
  • Customize models using fine-tuning and adapter techniques.
  • Develop RAG pipelines using vector, SQL, and NoSQL databases.
  • Manage secure ingestion of enterprise content with proper metadata and PII protection.
  • Use relational, NoSQL, and vector databases to support AI workloads.
  • Apply performance tuning, access control, encryption, and compliant data handling.
  • Implement AI safety controls and secure model access.
  • Ensure Responsible AI practices include bias, fairness, and privacy reviews.
  • Build secure, scalable microservices to integrate AI features into applications.
  • Implement best practices for reliability, error handling, and observability.
  • Maintain CI/CD pipelines for models and AI services.
  • Monitor performance, cost, and drift.
  • Support documentation and audit readiness.

Skills

Applied ML
Generative AI
Cloud platforms
Python
LangChain
RAG pipelines
Vector databases
SQL
NoSQL databases
Security controls
Responsible AI
Microservices
CI/CD
Observability
Agile
Project management

Tools

LangChain
Semantic Kernel
LangGraph

Job description

DataStaff, Inc. is seeking a Senior Generative AI Developer in Raleigh, NC for a long-term contract. The role requires building and deploying AI solutions with LLMs, RAG, and secure data handling. Hybrid work arrangement includes two onsite days weekly.

The ideal candidate will have extensive Python experience, cloud platform expertise (Azure/AWS/GCP), and a track record in implementing Responsible AI practices, security controls, and scalable microservices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Generative AI Engineer: LLMs, RAG & Secure Cloud AI
Senior Generative AI Engineer: LLMs, RAG & Secure Cloud AI

IDR, Inc. • Raleigh (NC)

Hybrid
USD 130,000 - 170,000
Competitive compensation
Full benefits
Senior Generative AI Engineer: LLMs, RAG, Python
Senior Generative AI Engineer: LLMs, RAG, Python

Connectdotssolution • Raleigh (NC)

Hybrid
USD 80,000 - 113,000
Senior Generative AI Developer
Senior Generative AI Developer

DataStaff, Inc. • Raleigh (NC)

Hybrid
USD 140,000 - 180,000
Medical, dental, and vision coverage
401k after 6 months
Paid vacation and holidays
Senior Generative AI Engineer - Secure, Scalable LLM Solutions
Senior Generative AI Engineer - Secure, Scalable LLM Solutions

Globalpoint • Raleigh (NC)

On-site
USD 150,000 - 210,000
Senior Gen AI Architect (Hybrid, Raleigh)
Senior Gen AI Architect (Hybrid, Raleigh)

Ventures Unlimited Inc • Raleigh (NC)

Hybrid
USD 120,000 - 190,000
Senior Generative AI Engineer — Secure LLM & RAG Architect
Senior Generative AI Engineer — Secure LLM & RAG Architect

Infinitek Limited • Raleigh (NC)

On-site
USD 140,000 - 190,000
Senior Generative AI Engineer – Enterprise LLM/RAG (Hybrid)
Senior Generative AI Engineer – Enterprise LLM/RAG (Hybrid)

Equiliem • Raleigh (NC)

Hybrid
USD 96,000 - 103,000
Senior Generative AI Architect - Enterprise LLMs & RAG
Senior Generative AI Architect - Enterprise LLMs & RAG

HonorVet Technologies • Raleigh (NC)

Hybrid
USD 110,000 - 160,000
Senior Generative AI Engineer: LLMs, RAG & Secure Apps
Senior Generative AI Engineer: LLMs, RAG & Secure Apps

InstantServe LLC • Raleigh (NC)

On-site
USD 180,000 - 240,000
Senior Generative AI Engineer — LLM, RAG, Security
Senior Generative AI Engineer — LLM, RAG, Security

Infinite Tek Inc. • Raleigh (NC)

On-site
USD 150,000 - 190,000