Senior AI Software Engineer — LLMs, RAG & Azure

Allstate Insurance Co.; Minnesota; On-site; USD 91,000 - 154,000; Full time

Job summary

Allstate Insurance Co. seeks an AI Software Engineer to design, develop, and operate secure AI‑powered enterprise applications and automation solutions.

You will work across backend services, frontend experiences, cloud‑native architectures, and AI engineering, delivering scalable and reliable AI‑driven products while ensuring governance, privacy, and security compliance. The role emphasizes ownership of technical solutions, collaboration with product, legal, and technology teams, and hands‑on

Qualifications

• 3+ years of software development experience using Python and/or Java Spring Boot.
• Experience with Generative AI APIs and/or open‑source models.
• Experience with LangChain, LLM orchestration, or RAG (pipelines).
• Familiarity with prompt engineering, embedding models, or vector databases.
• Strong understanding of RESTful APIs, microservices architecture, and asynchronous processing.
• Knowledge of web and API security frameworks.
• Experience with relational databases (SQL Server) or NoSQL (MongoDB/DocumentDB), vector databases, Kafka, caching, and Kubernetes.
• Strong communication, collaboration, and problem‑solving skills.
• Ability to manage multiple priorities and contribute effectively within a cross‑functional team.

Responsibilities

• Design, develop, and maintain backend services and APIs using modern frameworks (e.g., Java Spring Boot, Node.js, Python FastAPI).
• Integrate and deploy Generative AI models (e.g., OpenAI, Hugging Face, LangChain) into production environments.
• Design and implement solutions leveraging LLMs, Generative AI, Agentic AI, and Retrieval-Augmented Generation (RAG) architectures.
• Fine‑tune and optimize LLMs for specific use cases.
• Collaborate with product managers, architects, and cross‑functional teams to define technical solutions and deliver business outcomes.
• Integrate AI/ML services and APIs into enterprise applications while following engineering and security best practices.
• Develop intelligent automation solutions that improve productivity, user experience, and operational efficiency.
• Troubleshoot, optimize, and enhance application performance, scalability, and reliability.
• Contribute to technical documentation, architecture discussions, and continuous improvement initiatives.
• Deploy and manage applications on cloud platforms, preferably Microsoft Azure.
• Participate in Agile ceremonies, including daily standups, sprint planning, backlog refinement, and retrospectives.
• Write, review, and maintain high‑quality, scalable, and secure code.

Skills

Python

Java Spring Boot

Generative AI APIs

LangChain

LLM orchestration

RAG

RESTful APIs

Kubernetes

Docker

CI/CD

Azure OpenAI

Security best practices

Tools

Docker

Kubernetes

CI/CD pipelines

Azure OpenAI Service

Job description

Allstate Insurance Co. seeks an AI Software Engineer to design, develop, and operate secure AI‑powered enterprise applications and automation solutions.

You will work across backend services, frontend experiences, cloud‑native architectures, and AI engineering, delivering scalable and reliable AI‑driven products while ensuring governance, privacy, and security compliance. The role emphasizes ownership of technical solutions, collaboration with product, legal, and technology teams, and hands‑on