Senior AI & LLM Engineer for Production Systems

The Travelers Indemnity Company; Hartford (CT); On-site; USD 143,000 - 236,000; Full time

Job summary

The Travelers Indemnity Company is hiring for a senior engineering role at Team Breeze in Hartford, CT. You will design, configure and scale AI applications focusing on LLM agents and retrieval pipelines, ensuring production reliability and cost efficiency.

You will own the RAG pipeline end-to-end, including ingestion, embedding, and vector-store-backed APIs, and guide the team with best practices in testing and observability.

Qualifications

• Bachelor’s degree in computer science, related STEM field, or its equivalent in education and/or work experience.
• 6 additional years of software engineering experience.

Responsibilities

• Lead design and development of complex AI applications on Team Breeze with a focus on LLM agents and retrieval pipelines.
• Own end-to-end retrieval-augmented generation (RAG) pipeline from document ingestion to vector-store-backed APIs.
• Architect AWS services and Kubernetes-based containers and implement CI/CD pipelines for production reliability.
• Provide technical guidance and mentorship to teammates and drive strong engineering practices.

Education

Bachelor’s degree in computer science

6 additional years of software engineering experience

Job description

The Travelers Indemnity Company is hiring for a senior engineering role at Team Breeze in Hartford, CT. You will design, configure and scale AI applications focusing on LLM agents and retrieval pipelines, ensuring production reliability and cost efficiency.

You will own the RAG pipeline end-to-end, including ingestion, embedding, and vector-store-backed APIs, and guide the team with best practices in testing and observability.