Lead GenAI Engineer: LLM & RAG Pipelines

State Farm; Atlanta (GA); Hybrid; USD 85,000 - 142,000; Full time

Benefits offered by this job

Annual raise and bonus

401(k) plan with company contributions

Healthcare coverage and wellbeing

Educational benefits

Matching Gift Program

Job summary

State Farm is seeking a Lead Software Engineer with strong Python backend skills and AI/LLM integration to design and maintain the LARRY FastAPI backend. You will build RESTful APIs, orchestrate RAG pipelines, and collaborate with architects and product owners to deliver enterprise-grade knowledge workflows.

The role involves hybrid work with in-office collaboration in Dunwoody, GA or其他 designated hub locations, and requires experience with cloud platforms and CI/CD.

Qualifications

• Strong Python or React experience with backend/API design.
• Experience with LLM integration and RAG patterns.
• Experience designing, developing, and maintaining RESTful APIs.
• Hands-on experience with CI/CD pipelines and containerized deployment.
• Familiarity with cloud environments such as AWS.

Responsibilities

• Design, develop, and maintain the LARRY FastAPI backend, including endpoints for conversation, ingestion, and knowledge retrieval.
• Build and support LLM-powered RAG pipelines that query the knowledge base and surface relevant answers.
• Lead backend architecture decisions and mentor junior engineers.
• Collaborate with stakeholders to ensure accurate knowledge processing and retrieval.
• Implement and maintain CI/CD pipelines via GitLab CI/CD for ROSA/ROSA OpenShift deployments.
• Work on code reviews, tests, and secure coding practices.

Skills

Python

React

FastAPI

LLM integration

REST APIs

CI/CD

AWS

OpenShift

Tools

GitLab CI/CD

Azure AD / Entra ID

OpenShift

Job description

State Farm is seeking a Lead Software Engineer with strong Python backend skills and AI/LLM integration to design and maintain the LARRY FastAPI backend. You will build RESTful APIs, orchestrate RAG pipelines, and collaborate with architects and product owners to deliver enterprise-grade knowledge workflows.

The role involves hybrid work with in-office collaboration in Dunwoody, GA or其他 designated hub locations, and requires experience with cloud platforms and CI/CD.