Senior Data Scientist - GCP AI & LLM Agent Architect

Insight Global; Hartford (CT); On-site; USD 140,000 - 190,000; Full time

Job summary

Insight Global seeks a Senior Data Scientist to design and deploy agent-based solutions on GCP, improving the Medicare stars program. You will build agents using local and cloud LLMs, orchestrate inputs/outputs, and collaborate with engineers and domain experts to deliver production systems.

Responsibilities include end-to-end AI project leadership, CI/CD deployment, and strong communication across technical and business audiences.

Qualifications

• 3+ years using GCP services (BigQuery, Dataproc, Kubernetes, Vertex AI, GKE).
• 3+ years coding Python in a production cloud environment.
• 2+ years deploying ML or agentic systems with CI/CD, on-prem and in the cloud.
• 2+ years using orchestration frameworks such as LangGraph, LangChain, OpenAI Agents, or ADK.
• Experience building agents with local and cloud LLMs including API integration, tool calls, workflows, and state management.
• Experience orchestrating agent inputs and outputs, including pre-processing, post-processing, routing, guardrails, validation, and evaluation.
• Experience with SQL (aggregation, window functions, filter, group data).
• Experience with Git for version control and collaboration.
• Experience with GPU-mounted containers for development and inference workflows.
• Experience hardening container images, including distroless patterns and CVE scanning.
• Bachelor's degree in data science, statistics, CS, engineering, or a related field (PhD STRONGLY PREFERRED).
• Experience deploying local LLMs with vLLM or SGLang.
• Experience with CUDA, TensorRT, and TensorRT-LLM for GPU inference optimization.
• Experience with LLMOps, including evaluation, tracing, monitoring, and prompt or version management.
• Experience leading AI projects end to end and mentoring junior colleagues.
• Advanced degree in data science, statistics, CS, engineering, or a related field.

Responsibilities

• Design and deploy MCP and agent-based solutions on GCP to improve Medicare stars program.
• Build agents using local and cloud LLMs.
• Orchestrate agent inputs and outputs, including pre-processing, post-processing, validation, and tool use.
• Partner with engineers, domain experts, and stakeholders to define objectives and deliver production systems.

Skills

Python programming

ML deployment

Orchestration frameworks

LLM integration

SQL

Git

GPU inference workflows

Container security

Communication

AI project leadership

Education

Bachelor's degree in data science, statistics, CS, engineering, or related field

PhD preferred

Advanced degree in data science, statistics, CS, engineering, or related field

Tools

BigQuery

Dataproc

Kubernetes

Vertex AI

GKE

LangGraph

LangChain

OpenAI Agents

ADK

Git

vLLM

SGLang

CUDA

TensorRT

TensorRT-LLM

Job description

Insight Global seeks a Senior Data Scientist to design and deploy agent-based solutions on GCP, improving the Medicare stars program. You will build agents using local and cloud LLMs, orchestrate inputs/outputs, and collaborate with engineers and domain experts to deliver production systems.

Responsibilities include end-to-end AI project leadership, CI/CD deployment, and strong communication across technical and business audiences.