AI Software Engineer — Enterprise LLM & RAG Systems

Talentify; Virginia (MN); On-site; USD 130,000 - 195,000; Full time

Job summary

Oteemo seeks an exceptional AI Software Engineer to build and scale enterprise AI applications end to end, from database to UI. You will work with cutting‑edge LLM tech, RAG systems, and production ML infrastructure, delivering reliable, high‑performance AI features for enterprise clients.

You will design end‑to‑end AI pipelines, integrate with leading LLMs, and develop robust back-end and front-end solutions using Python, FastAPI, React, and Kubernetes.

Qualifications

• Expert-level proficiency in Python with modern frameworks (FastAPI, Flask).
• Strong TypeScript/JavaScript skills with deep React and Next.js experience; proven track record designing and building RESTful and GraphQL APIs.
• Solid understanding of relational (PostgreSQL, MySQL) and NoSQL (MongoDB) databases.
• Experience with authentication systems (OAuth2, JWT, SSO) and security best practices.
• Proven track record of shipping high‑quality, scalable software to production.
• Hands‑on experience building and deploying AI/ML applications in production.
• Deep understanding of LLM integration, prompt engineering, and context management.
• Proven expertise with RAG systems, including document processing, chunking, embedding, retrieval, and generation.
• Experience working with vector databases (Pinecone, Weaviate, Chroma, FAISS, or Qdrant).
• Strong grasp of semantic search, similarity algorithms, and hybrid search techniques.
• Knowledge of evaluation frameworks for assessing AI system quality and performance.
• Production experience with Docker containerization and Kubernetes orchestration.
• Strong knowledge of at least one major cloud platform (AWS, Azure, or GCP) and its AI services.
• Experience building CI/CD pipelines for ML/AI application.
• Proficiency with infrastructure as code tools (Terraform, CloudFormation, Pulumi).
• Understanding of monitoring, logging, and alerting best practices; cost optimization experience for cloud and AI workloads.
• Strong computer science fundamentals and algorithmic thinking.
• Proficiency with Git workflows, code review practices, and collaborative development.
• Excellent debugging and problem-solving skills.
• Clear technical communication and documentation abilities.

Responsibilities

• Design and implement end-to-end RAG pipelines for intelligent document search and question‑answering across enterprise knowledge bases.
• Build production‑ready integrations with leading LLMs for accurate, contextual responses to user queries.
• Develop prompt engineering strategies and evaluation frameworks to ensure high‑quality AI outputs.
• Create agent systems with tool integration capabilities that can autonomously complete complex tasks.
• Implement vector search solutions for semantic similarity and knowledge retrieval.
• Build scalable backend services using Python/FastAPI with type‑safe APIs, authentication, and robust error handling.
• Develop responsive frontend applications using React/Next.js with real‑time streaming for LLM responses.
• Design and optimize database schemas across PostgreSQL, MongoDB, and Redis for high‑throughput AI workloads.
• Implement WebSocket servers and event‑driven architectures for real‑time experiences.
• Create comprehensive testing strategies including unit, integration, and end‑to‑end tests.
• Deploy and manage ML/AI services using Docker and Kubernetes.
• Build and maintain CI/CD pipelines for rapid, safe deployment of AI features.
• Implement infrastructure as code using Terraform to manage cloud resources (AWS/Azure/GCP).
• Set up monitoring and observability using Datadog, Prometheus/Grafana, and LangSmith/Weights & Biases.
• Optimize costs via caching, batching, and model selection strategies.

Skills

Python

FastAPI

Flask

TypeScript

JavaScript

React

Next.js

REST APIs

GraphQL

PostgreSQL

MySQL

MongoDB

OAuth2

JWT

SSO

Docker

Kubernetes

Terraform

AWS

Azure

GCP

CI/CD

LangSmith

Weights & Biases

Tools

Pinecone

Weaviate

Chroma

FAISS

Qdrant

Job description

Oteemo seeks an exceptional AI Software Engineer to build and scale enterprise AI applications end to end, from database to UI. You will work with cutting‑edge LLM tech, RAG systems, and production ML infrastructure, delivering reliable, high‑performance AI features for enterprise clients.

You will design end‑to‑end AI pipelines, integrate with leading LLMs, and develop robust back-end and front-end solutions using Python, FastAPI, React, and Kubernetes.