AI-Powered Backend Engineer (RAG & LLMs)

aegworldwide

Charlotte (NC)

On-site

USD 92,000 - 115,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical insurance
Dental insurance
Vision insurance
Paid holidays
Vacation and sick time
Life insurance (basic)
Voluntary life insurance
Parental leave
401k with matching 3%
FSA/HSA options
Wellness program

Job summary

AXS in Charlotte, NC is seeking a Software Engineer to join the carbonhouse team, focusing on applying AI to build scalable backend systems and data pipelines. You will bridge traditional engineering with ML and LLM workflows, delivering AI-powered features through APIs and services.

You will work with product and design to implement RAG, embeddings, and AI tools, while ensuring performance, reliability, and cost efficiency in production systems.

Qualifications

  • Strong programming experience in one or more languages (Python, JS/TS, PHP, Go).
  • Experience building and maintaining backend systems and APIs.
  • Familiarity with cloud platforms (AWS, GCP, Azure).
  • Experience with databases (SQL/NoSQL).
  • Understanding of software design principles and system architecture.
  • Familiarity with integrating AI APIs (OpenAI, Anthropic).
  • Prompt engineering basics.
  • Embeddings and vector search.
  • Model evaluation and performance tuning.
  • Docker and Kubernetes experience.

Responsibilities

  • Design, build, and maintain scalable backend systems and APIs.
  • Integrate AI/ML capabilities into applications (LLMs, embeddings, etc.).
  • Develop and optimize data pipelines for AI workflows.
  • Implement retrieval-augmented generation (RAG) and context-aware systems.
  • Evaluate and integrate third-party AI tools and services.
  • Improve system performance, reliability, and cost efficiency.
  • Write clean, maintainable, and well-tested code.
  • Collaborate with cross-functional teams to ship AI-powered features.
  • Contribute to architecture decisions and technical direction.

Skills

Python
JavaScript/TypeScript
PHP
Go
Backend systems
APIs
Cloud platforms
Databases
AI APIs integration
Prompt engineering
Embeddings
Vector search
Model evaluation
Docker
Kubernetes
LangChain
LlamaIndex

Tools

AWS
GCP
Azure

Job description

AXS in Charlotte, NC is seeking a Software Engineer to join the carbonhouse team, focusing on applying AI to build scalable backend systems and data pipelines. You will bridge traditional engineering with ML and LLM workflows, delivering AI-powered features through APIs and services.

You will work with product and design to implement RAG, embeddings, and AI tools, while ensuring performance, reliability, and cost efficiency in production systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Backend Engineer: AI & RAG Pipelines
Backend Engineer: AI & RAG Pipelines

AXS • Charlotte (NC)

On-site
USD 92,000 - 115,000
Medical, dental and vision insurance
401k plan with company match
Paid holidays, vacation and sick time
+4
Backend AI Engineer - Scalable APIs & LLM Workflows
Backend AI Engineer - Scalable APIs & LLM Workflows

AEG Worldwide • Charlotte (NC)

On-site
USD 92,000 - 115,000
Bonus eligibility
Comprehensive benefits package
401(k) with company match
+2
AI-Driven Backend Engineer for Scalable APIs
AI-Driven Backend Engineer for Scalable APIs

AXS • Charlotte (NC)

On-site
USD 92,000 - 115,000
AI Engineer
AI Engineer

Elios, Inc. • Charlotte (NC)

Hybrid
USD 120,000 - 170,000
Production AI Engineer – LLM Apps & RAG Pipelines
Production AI Engineer – LLM Apps & RAG Pipelines

INFOSYS NOVA HOLDINGS LLC • Charlotte (NC)

On-site
USD 100,000 - 115,000
Lead AI Engineer: RAG & LLM Solutions (Hybrid)
Lead AI Engineer: RAG & LLM Solutions (Hybrid)

Experis Technology Group • Charlotte (NC)

Hybrid
USD 103,000 - 117,000
Medical plan
Dental plan
Vision plan
+9
AI Engineer: LLM/RAG Pipelines, Java Spring & React
AI Engineer: LLM/RAG Pipelines, Java Spring & React

LTM • Atlanta (GA)

On-site
USD 120,000 - 160,000
Comprehensive Medical Plan
401(k) Match
Paid Holidays
Senior AI Backend Architect
Senior AI Backend Architect

Aimlroles • United States

Remote
USD 140,000 - 200,000
Senior AI Engineer: LLM Architecture & RAG Pipelines
Senior AI Engineer: LLM Architecture & RAG Pipelines

EPAM Systems • United States

Remote
USD 140,000 - 210,000
Senior AI Engineer - LLM Orchestration & RAG
Senior AI Engineer - LLM Orchestration & RAG

BigBear • Maryland

On-site
USD 170,000 - 210,000