Senior Data Scientist II — Generative AI & RAG Expert

Compunnel Inc.; Raleigh (NC); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Compunnel, Inc. seeks a Senior Data Scientist II with deep expertise in analytics and machine learning to derive insights from complex datasets and drive data-driven products.

The role emphasizes Generative AI, agentic AI, MCP, and RAG solutions, and collaboration with ML Engineers across the production lifecycle. You will work with unstructured data, build scalable models, and mentor teammates while applying LLMs such as BERT, RoBERTa, T5 and models like ChatGPT.

Qualifications

• 8+ years of total professional experience.
• 5+ years Data Scientist experience.
• 5+ years MCP, RAG implementations, evaluations, validations, or proof-of-concept development, agentic AI, Generative AI, and unstructured data.
• Experience building or supporting customer-facing products using data science.
• Experience collaborating with Machine Learning Engineers throughout the production lifecycle.
• Strong Python programming skills.
• Experience with machine learning algorithms, including deep learning, gradient boosting, and random forests.
• Strong knowledge and hands-on experience with large language models and Transformer-based architectures, including BERT, RoBERTa, and T5.
• Experience applying LLMs such as ChatGPT, GPT-3.5, Claude, Mistral, or similar models.
• Experience working with large datasets and distributed computing systems such as Hadoop and Spark.
• Experience mentoring, training, and serving as a subject matter expert to guide colleagues.

Responsibilities

• Apply advanced analytical skills to extract insights from complex datasets to support data-driven decision-making.
• Design, implement, evaluate, validate, and proof MCP and RAG solutions.
• Develop and support agentic and Generative AI solutions.
• Work with unstructured data to develop innovative data science and AI solutions.
• Collaborate with Machine Learning Engineers throughout the production lifecycle of customer-facing products.
• Apply machine learning algorithms, including deep learning, gradient boosting, and random forests.
• Work directly with large language models and Transformer-based architectures, including BERT, RoBERTa, and T5.
• Apply LLM technologies including ChatGPT, GPT-3.5, Claude, Mistral, and similar models.
• Work with large datasets and distributed computing systems such as Hadoop and Spark.
• Collaborate with cross-functional teams to enhance business strategies and drive growth through actionable data analysis.
• Provide mentorship, training, and subject matter expertise to colleagues.
• Contribute to the development of innovative solutions and data-driven products.

Skills

Python

Machine Learning

Deep Learning

RAG

MCP implementations

Unstructured data

Data Science

Transformers

LLMs

Hadoop

Spark

Job description

Job Summary
We are seeking a Senior Data Scientist II with advanced analytical and machine learning expertise to extract insights from complex datasets and develop innovative data-driven solutions. The ideal candidate will have strong experience with Generative AI, agentic AI, RAG, MCP implementations, unstructured data, and customer-facing products. The role will involve collaborating with Machine Learning Engineers and cross-functional teams throughout the production lifecycle while providing technical mentorship and subject matter expertise.

Key Responsibilities
• Apply advanced analytical skills to extract insights from complex datasets and support data-driven decision-making.
• Design, implement, evaluate, validate, and proof MCP and RAG solutions.
• Develop and support agentic and Generative AI solutions.
• Work with unstructured data to develop innovative data science and AI solutions.
• Collaborate with Machine Learning Engineers throughout the production lifecycle of customer-facing products.
• Apply machine learning algorithms, including deep learning, gradient boosting, and random forests.
• Work directly with large language models and Transformer-based architectures, including BERT, RoBERTa, and T5.
• Apply LLM technologies including ChatGPT, GPT-3.5, Claude, Mistral, and similar models.
• Work with large datasets and distributed computing systems such as Hadoop and Spark.
• Collaborate with cross-functional teams to enhance business strategies and drive growth through actionable data analysis.
• Provide mentorship, training, and subject matter expertise to colleagues.
• Contribute to the development of innovative solutions and data-driven products.

Required Qualifications
• 8+ years of total professional experience.
• 5+ years of recent Data Scientist experience.
• 5+ years of experience with MCP, RAG implementations, evaluations, validations, or proof-of-concept development, agentic AI, Generative AI, and unstructured data.
• Experience building or supporting customer-facing products using data science.
• Experience collaborating with Machine Learning Engineers throughout the production lifecycle.
• Strong Python programming skills.
• Experience with machine learning algorithms, including deep learning, gradient boosting, and random forests.
• Strong knowledge and hands-on experience with large language models and Transformer-based architectures, including BERT, RoBERTa, and T5.
• Experience applying LLMs such as ChatGPT, GPT-3.5, Claude, Mistral, or similar models.
• Experience working with large datasets and distributed computing systems such as Hadoop and Spark.
• Experience mentoring, training, and serving as a subject matter expert to guide colleagues.

Preferred Qualifications
• Experience working in large enterprise environments.