AI Engineer: Healthcare Conversational AI on Vertex AI

Blue Cross Blue Shield of Massachusetts; Boston (MA); On-site; USD 140,000 - 171,000; Full time

Benefits offered by this job

Health insurance

401(k)

Paid time off

Dental insurance

Job summary

Blue Cross Blue Shield of Massachusetts in Boston is seeking an AI Engineer to join our AI Engineering team focused on designing, building, and deploying intelligent AI assistants powered by Google Cloud Platform (GCP) and Vertex AI. You will work at the intersection of large language models, cloud infrastructure, and product engineering to deliver conversational AI experiences that drive value.

You will design and implement agents, integrate tools and enterprise APIs, apply responsible AI

Qualifications

• Bachelor's or Master’s degree in Computer Science, ML, DS, or related field.
• 5+ years of software engineering experience with at least 2+ years in AI/ML or LLM-based development.
• Hands-on experience with Google Cloud Platform services (BigQuery, Cloud Run, Cloud Functions).
• Experience with Vertex AI Agent Builder, Vertex AI Search, or Dialogflow CX.
• Proficiency in Python and ML/AI frameworks (LangChain, PyTorch, TensorFlow).
• Experience building AI agents with LLMs, prompts, embeddings, and retrieval.
• Strong knowledge of API design, microservices, and cloud-native patterns.
• Version control, CI/CD, and Infrastructure as Code (Terraform, Cloud Build).

Responsibilities

• Design and develop AI assistants using Vertex AI, including model selection, prompt engineering, grounding, and RAG.
• Build multi-step AI agents with ADK for complex conversations.
• Develop applications using Google Cloud AI/ML SDKs for access to foundation models.
• Design agent architectures with orchestration capabilities for multi-turn, multi-domain use cases.
• Implement tool and function calling patterns connecting to APIs and databases.
• Apply responsible AI practices including safety filters and bias detection.
• Architect scalable production-grade solutions using Vertex AI and other GCP services.
• Develop evaluation and monitoring frameworks for model quality, latency, and cost.
• Collaborate with product managers, data engineers, and stakeholders.
• Stay current with AI landscape and recommend adoption of new models and tools.

Skills

LLM development

Prompt engineering

Vertex AI / GCP

Python

Cloud-native architectures

MLOps

APIs & microservices

CI/CD

Education

Bachelor’s or Master’s in CS/ML/DS

Tools

Vertex AI

BigQuery

GCP SDKs

CI/CD tools

Job description

Blue Cross Blue Shield of Massachusetts in Boston is seeking an AI Engineer to join our AI Engineering team focused on designing, building, and deploying intelligent AI assistants powered by Google Cloud Platform (GCP) and Vertex AI. You will work at the intersection of large language models, cloud infrastructure, and product engineering to deliver conversational AI experiences that drive value.

You will design and implement agents, integrate tools and enterprise APIs, apply responsible AI