Sr. Data Scientist

Insight Global; Raleigh (NC); On-site; USD 140,000 - 180,000; Full time

Job summary

Insight Global in Raleigh, NC seeks a Senior Data Scientist II to lead AI-driven product capabilities in the legal domain. You will design experiments, build ML/NLP models, and partner with engineers to translate validated approaches into scalable, customer-facing solutions.

You will shape retrieval strategies, evaluate LLM-based methods, mentor teammates, and communicate findings to product and legal stakeholders while focusing on business impact and model quality.

Qualifications

• Proven experience in machine learning, NLP and LLM-based modeling.
• Experience designing and running experiments with model evaluation and iteration.
• Experience with generative AI techniques and prompt strategies.
• Experience designing hybrid search using embeddings and vector databases.
• Ability to translate ambiguous problems into structured AI solutions.

Responsibilities

• Lead experimentation and model development for AI/ML solutions in legal products.
• Design and evaluate NLP, LLM, and generative AI approaches (e.g., RAG, prompt strategies).
• Define agentic workflows and reasoning strategies for multi-step legal tasks.
• Define retrieval strategies, including hybrid search (semantic + lexical).
• Analyze large-scale legal datasets to extract insights and improve model performance.
• Mentor team members and provide technical leadership in data science and AI.

Skills

Machine Learning

NLP

LLM Modeling

Experimentation

Python

Data Analysis

Communication

Tools

LangChain

LangGraph

AutoGen

Job description

Job Description

We are seeking a Senior Data Scientist II to lead the design and validation of AI-driven product capabilities within the legal domain. This role focuses on defining what to build and why—leveraging machine learning, NLP, and large language models (LLMs) to solve complex legal workflows. You will drive experimentation, modeling, and evaluation, partnering closely with engineers to translate validated approaches into scalable, customer-facing solutions.

Lead experimentation and model development for AI/ML solutions in legal products.

Design and evaluate NLP, LLM, and generative AI approaches (e.g., RAG, prompt strategies).

Define agentic workflows and reasoning strategies for multi-step legal tasks.

Define retrieval strategies, including hybrid search (semantic + lexical), and evaluation metrics (e.g., relevance, ranking quality).

Analyze large-scale legal datasets to extract insights and improve model performance.

Establish best practices for model evaluation, validation, and benchmarking.

Translate experimental results into clear product recommendations and business impact.

Collaborate with product, legal experts, and engineers to align solutions with user needs.

Mentor team members and provide technical leadership in data science and AI.

Skills and Requirements

Strong experience in machine learning, NLP, and LLM-based modeling.

Proven experience designing and running experiments, including model evaluation and iteration.

Experience with generative AI techniques (e.g., prompt engineering, RAG).

Experience designing and evaluating hybrid search (semantic + lexical) using embeddings and vector databases.

Experience designing agentic workflows and reasoning strategies, with hands-on experience applying agent frameworks (e.g., LangChain, LangGraph, AutoGen) in real-world use cases.

Proficiency in Python and data analysis tools.

Strong problem framing and experimental design skills.

Ability to translate ambiguous problems into structured AI solutions.

Clear communication of technical findings to diverse stakeholders.

Collaboration with engineering to bridge research and production.

Ownership of model quality, accuracy, and business impact.

Strong foundation in statistics, modeling, and large-scale text processing.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.