Lead GenAI & LLM Engineer — Python Backend, Hybrid

State Farm; Dunwoody (GA); Hybrid; USD 85,000 - 142,000; Full time

Benefits offered by this job

Annual raise and bonus

Health insurance coverage

401(k) with company contributions

Tuition assistance

Paid holidays and parental leave

Job summary

State Farm is seeking a Lead Software Engineer to design, build, and maintain the LARRY FastAPI backend, enabling AI-powered interviews, document processing, and knowledge ingestion. You will integrate LLM workflows, ensure secure API access, and guide a team of engineers in a hybrid role with substantial cloud work.

The role emphasizes greenfield AI work in an enterprise setting, with mentorship of juniors and collaboration with product owners and architects.

Qualifications

• Strong Python backend development experience.
• Experience with LLM integration and RAG architecture patterns.
• Experience designing, developing, and maintaining RESTful APIs.
• Hands-on experience with CI/CD pipelines and containerized deployment.
• Solid understanding of Git and version control workflows.
• Experience with AWS or other cloud environments.

Responsibilities

• Design, develop, and maintain the LARRY FastAPI backend, including REST API endpoints for conversation, ingestion, and knowledge retrieval.
• Build and support LLM-powered RAG pipelines that query the kcd-repository knowledge base and surface relevant answers.
• Lead backend architecture decisions and mentor junior engineers on the team.
• Collaborate with business stakeholders, product owners, and architects to ensure accurate knowledge processing and retrieval.
• Implement and maintain CI/CD pipelines via GitLab CI/CD for deployment to ROSA (OpenShift).
• Participate in code reviews, unit testing, and integration testing to maintain high-quality, secure code.

Skills

Python

FastAPI

LLM integration

REST APIs

CI/CD

GitLab CI/CD

Cloud (AWS)

Azure AD / Entra ID

Tools

GitLab CI/CD

OpenShift ROSA

Azure AD/Entra ID

Job description

State Farm is seeking a Lead Software Engineer to design, build, and maintain the LARRY FastAPI backend, enabling AI-powered interviews, document processing, and knowledge ingestion. You will integrate LLM workflows, ensure secure API access, and guide a team of engineers in a hybrid role with substantial cloud work.

The role emphasizes greenfield AI work in an enterprise setting, with mentorship of juniors and collaboration with product owners and architects.