Lead GenAI Engineer — LLM & RAG Backend (Python)

Lewis & Clark; Bloomington, Dunwoody, Richardson, Tempe (IL, GA, TX, AZ); Hybrid; USD 85,000 - 142,000; Full time

Benefits offered by this job

Annual raise

Bonus eligibility

Healthcare coverage

Tuition assistance

401(k) plan

Job summary

State Farm is seeking a Lead Software Engineer with strong Python backend development and AI/LLM integration to design, build, and maintain the LARRY FastAPI backend and its knowledge ingestion components.

You will lead backend architecture, mentor junior engineers, and collaborate with architects and product owners to ensure accurate knowledge processing and retrieval, while implementing secure API access and CI/CD for ROSA deployments.

Qualifications

• Experience with Python backend development and AI/LLM integration.
• Experience designing, developing, and maintaining RESTful APIs.
• Hands-on experience with CI/CD pipelines and containerized deployment.
• Experience with AWS or other cloud environments.

Responsibilities

• Design, develop, and maintain the LARRY FastAPI backend, including REST API endpoints for conversation, ingestion, and knowledge retrieval.
• Build and support LLM-powered RAG pipelines that query the kcd-repository knowledge base and surface relevant answers.
• Lead backend architecture decisions and mentor junior engineers on the team.
• Collaborate with business stakeholders, product owners, and architects to ensure accurate knowledge processing and retrieval.
• Implement and maintain CI/CD pipelines via GitLab CI/CD for deployment to ROSA (OpenShift).
• Participate in code reviews, unit testing, and integration testing to maintain high-quality, secure code.
• Integrate with Entra ID (Azure AD) for authentication and manage secure API access patterns.
• Research and adopt emerging LLM and RAG patterns to improve knowledge quality and retrieval accuracy.

Skills

Python

React

FastAPI

RESTful APIs

Git

Tools

GitLab CI/CD

OpenShift ROSA

Azure AD / Entra ID

AWS

Job description

State Farm is seeking a Lead Software Engineer with strong Python backend development and AI/LLM integration to design, build, and maintain the LARRY FastAPI backend and its knowledge ingestion components.

You will lead backend architecture, mentor junior engineers, and collaborate with architects and product owners to ensure accurate knowledge processing and retrieval, while implementing secure API access and CI/CD for ROSA deployments.