RAG & LLM Engineer for AI-Powered Systems

CareerCircle; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

CareerCircle seeks an experienced AI Engineer with a strong software background to design, develop, and enhance AI-powered applications and services. You will build RAG pipelines, integrate LLMs and vector databases, and craft scalable backend systems that power real-world AI solutions.

You will work across document ingestion, embeddings, retrieval, and context management, while optimizing prompts, metrics, and evaluation frameworks to improve accuracy and relevance.

Qualifications

• 5+ years of professional software engineering or application development experience.
• Hands-on experience building and implementing Retrieval-Augmented Generation (RAG) solutions.
• Hands-on experience working with Large Language Models (LLMs) and generative AI applications.
• Strong software engineering fundamentals, including object-oriented programming, data structures, algorithms, APIs, and system design.
• Strong experience with at least one modern programming language such as Python, Java, JavaScript/TypeScript, C#, Go, or similar.
• Experience developing production-quality applications, services, or APIs.
• Experience working with databases and/or data retrieval systems.
• Experience with cloud platforms and modern software development practices.
• Strong debugging, problem-solving, and analytical skills.

Responsibilities

• Design, develop, and maintain AI-powered applications and services using LLMs and generative AI technologies.
• Build and enhance Retrieval-Augmented Generation (RAG) pipelines, including document ingestion, chunking, embeddings, retrieval, reranking, context management, and response generation.
• Integrate LLMs, vector databases, APIs, and other AI services into scalable software applications.
• Develop and optimize prompts, retrieval strategies, evaluation approaches, and AI workflows to improve accuracy and relevance.
• Build production-quality software with a focus on scalability, reliability, performance, security, and maintainability.
• Design and develop REST APIs, microservices, and other backend services supporting AI applications.
• Work with structured and unstructured data and integrate data sources into AI/ML applications.
• Evaluate LLM and RAG performance using appropriate metrics, testing strategies, and evaluation frameworks.
• Troubleshoot and optimize AI applications across development, testing, and production environments.
• Collaborate with software engineers, data scientists, product teams, and other stakeholders to deliver AI solutions.
• Stay current with emerging LLM, RAG, agentic AI, and generative AI technologies and identify opportunities to apply them to business problems.

Skills

RAG

LLMs

OOP

Data structures

APIs

System design

Python

Java

JavaScript/TypeScript

C#

Go

Production systems

Databases

Cloud platforms

Debugging

Tools

Vector databases

Job description

CareerCircle seeks an experienced AI Engineer with a strong software background to design, develop, and enhance AI-powered applications and services. You will build RAG pipelines, integrate LLMs and vector databases, and craft scalable backend systems that power real-world AI solutions.

You will work across document ingestion, embeddings, retrieval, and context management, while optimizing prompts, metrics, and evaluation frameworks to improve accuracy and relevance.