Hybrid GenAI Engineer — LLM & RAG Backend Lead

State-Farm-319b4913; Bloomington (IL); Hybrid; USD 85,000 - 142,000; Full time

Benefits offered by this job

Competitive compensation package

Annual raise and bonus

Health insurance

Job summary

State Farm is seeking a Lead Software Engineer to design, build, and maintain the LARRY FastAPI backend with LLM-enabled features. You will work on retrieval pipelines, knowledge ingestion, and secure API access within a hybrid work model at our Bloomington, IL location.

You’ll collaborate with architects, product owners, and SMEs to shape enterprise‑scale knowledge management, focusing on Python, LLMs, and cloud‑native architecture.

Qualifications

• Experience with Python backend development and AI/LLM integration.
• Design, develop, and maintain RESTful APIs.
• Hands-on experience with CI/CD pipelines and containerized deployment.
• Experience with AWS or other cloud environments.

Responsibilities

• Design, develop, and maintain the LARRY FastAPI backend, including REST API endpoints for conversation, ingestion, and knowledge retrieval.
• Build and support LLM-powered RAG pipelines that query the knowledge base and surface relevant answers.
• Lead backend architecture decisions and mentor junior engineers on the team.
• Collaborate with business stakeholders, product owners, and architects to ensure accurate knowledge processing and retrieval.
• Implement and maintain CI/CD pipelines via GitLab CI/CD for deployment to ROSA (OpenShift).
• Participate in code reviews, unit testing, and integration testing to maintain high‑quality, secure code.
• Integrate with Entra ID for authentication and manage secure API access patterns.
• Research and adopt emerging LLM and RAG patterns to improve knowledge quality and retrieval accuracy.

Skills

Python

React

FastAPI

Tools

GitLab CI/CD

Cloud (AWS)

Entra ID / Azure AD

Job description

State Farm is seeking a Lead Software Engineer to design, build, and maintain the LARRY FastAPI backend with LLM-enabled features. You will work on retrieval pipelines, knowledge ingestion, and secure API access within a hybrid work model at our Bloomington, IL location.

You’ll collaborate with architects, product owners, and SMEs to shape enterprise‑scale knowledge management, focusing on Python, LLMs, and cloud‑native architecture.