Senior GenAI Engineer – LLM & ML Ops Lead

Guidewire Software; United States; Remote; USD 162,000 - 258,000; Full time

Benefits offered by this job

Flexible work environment

Health and wellness benefits

Paid time off

Market-competitive pay

Career growth opportunities

Job summary

Guidewire’s Generative AI (GenAI) team sits within Product Strategy and shapes the future of our cloud and AI-powered platform for P&C insurers worldwide. We partner with Product, Engineering, and Go-to-Market teams to embed AI, cloud, and data capabilities across the portfolio, delivering secure, scalable solutions.

As a Senior ML Engineer, Generative AI, you’ll lead design, development, and operation of GenAI and LLM capabilities.

Qualifications

• 5+ years of professional experience in Machine Learning or Data Science, including end-to-end delivery of production ML systems.
• Deep expertise in Python and experience building scalable ML/LLM services and pipelines, ideally on AWS using services such as S3, EC2, RDS, and SageMaker.
• Strong understanding of ML Ops practices for model development, deployment, monitoring, and lifecycle management (including CI/CD for ML, experiment tracking, model registries, and drift detection).
• Hands-on experience with classical and gradient-boosting models (such as GLM, Random Forest, and XGBoost) and their application to real-world business problems.
• Deep understanding of neural networks and transformer-based architectures for LLMs and chat models, including familiarity with open-source foundation models and their fine-tuning and inference.
• Experience with prompt engineering, RAG and related LLM architecture patterns, and vector databases for semantic search and retrieval.
• Solid knowledge of evaluating and monitoring LLM performance using NLP and LLM-assisted metrics, with a focus on safety, robustness, and user experience.
• Demonstrated technical leadership: driving design decisions, leading complex engineering efforts, mentoring peers, and conducting thoughtful code and architecture reviews.
• *****MUST HAVE GUIDEWIRE EXPERIENCE*****

Responsibilities

• Lead the design, implementation, and evolution of Guidewire’s GenAI and LLM products, including data ingestion, feature pipelines, model training, fine-tuning, deployment, and monitoring on AWS (e.g., S3, EC2, RDS, SageMaker).
• Architect and build robust ML/LLM pipelines that power high-impact use cases across our product portfolio.
• Develop and optimize LLM solutions using prompt engineering, retrieval-augmented generation (RAG), vector databases, and fine-tuning.
• Collaborate with Product Strategy, PDO, and Professional Services teams to align GenAI capabilities with roadmaps and goals.
• Establish and apply ML Ops best practices for CI/CD, experimentation, evaluation, observability, and responsible AI.
• Mentor engineers and data scientists, conduct code/design reviews, and champion technical excellence.
• Partner with cross-functional teams to ensure AI solutions adhere to data governance and security controls.
• Foster a culture of curiosity, innovation, and responsible AI use.

Skills

Python

AWS SageMaker

ML Ops

LLMs

Prompt engineering

RAG

Vector databases

Deployment & Monitoring

Leadership

Guidewire experience

Education

BS/MS in CS or equivalent

Tools

Docker

Kubernetes

SQL

Spark

AWS Glue

Terraform

TeamCity

Job description

Guidewire’s Generative AI (GenAI) team sits within Product Strategy and shapes the future of our cloud and AI-powered platform for P&C insurers worldwide. We partner with Product, Engineering, and Go-to-Market teams to embed AI, cloud, and data capabilities across the portfolio, delivering secure, scalable solutions.

As a Senior ML Engineer, Generative AI, you’ll lead design, development, and operation of GenAI and LLM capabilities.