Lead GenAI Engineer - LLM & RAG Backend Architect

ITSMF; Bloomington (IL); Hybrid; USD 85,000 - 142,000; Full time

Benefits offered by this job

Health insurance

401(k) with company contributions

Educational benefits

Job summary

State Farm in Bloomington, IL seeks a Lead Software Engineer to design, build, and maintain the LARRY FastAPI backend and LLM-powered knowledge systems. You will collaborate with architects, product owners, and SMEs to deliver enterprise-scale knowledge processing across interviews, documents, and mainframe artifacts.

You’ll drive backend architecture, mentor junior engineers, and contribute to secure, scalable CI/CD pipelines while leveraging cloud environments and Entra ID authentication.

Qualifications

• Strong Python or React experience, including FastAPI or similar async web frameworks.
• Experience with LLM integration and RAG architecture patterns.
• Experience designing, developing, and maintaining RESTful APIs.
• Hands-on experience with CI/CD pipelines and containerized deployment.
• Solid understanding of Git and version control workflows.
• Experience with AWS or other cloud environments.

Responsibilities

• Design, develop, and maintain the LARRY FastAPI backend, including REST API endpoints for conversation, ingestion, and knowledge retrieval
• Build and support LLM-powered RAG pipelines that query the kcd-repository knowledge base and surface relevant answers
• Lead backend architecture decisions and mentor junior engineers on the team
• Collaborate with business stakeholders, product owners, and architects to ensure accurate knowledge processing and retrieval
• Implement and maintain CI/CD pipelines via GitLab CI/CD for deployment to ROSA (OpenShift)
• Participate in code reviews, unit testing, and integration testing to maintain high-quality, secure code
• Integrate with Entra ID (Azure AD) for authentication and manage secure API access patterns
• Research and adopt emerging LLM and RAG patterns to improve knowledge quality and retrieval accuracy

Skills

Python

React

FastAPI

LLM integration

RESTful APIs

CI/CD

Git

AWS

Tools

FastAPI

GitLab CI/CD

OpenShift

Azure AD / Entra ID

Knowledge graphs

JSON schema

RAG pipelines

Job description

State Farm in Bloomington, IL seeks a Lead Software Engineer to design, build, and maintain the LARRY FastAPI backend and LLM-powered knowledge systems. You will collaborate with architects, product owners, and SMEs to deliver enterprise-scale knowledge processing across interviews, documents, and mainframe artifacts.

You’ll drive backend architecture, mentor junior engineers, and contribute to secure, scalable CI/CD pipelines while leveraging cloud environments and Entra ID authentication.