Senior LLM Data Scientist — NLP, Prompts & RAG

Datumtg; Raleigh (NC); Hybrid; USD 120,000 - 170,000; Full time

Job summary

Datumtg in Raleigh, NC is seeking engineers to advance LLM-based information-extraction and NLP workflows. You will design prompts, build RAG and multi-step agents, and create robust data-prep pipelines with strong testing practices.

We value collaboration with SMEs to ensure factual accuracy, and you will balance quality, latency, and cost while maintaining clear, versioned code and documentation. A strong background in Python and ML is essential.

Qualifications

• Bachelor's degree or higher in CS/DS/Stats or related field.
• At least 3 years in data science, ML, or NLP with hands-on LLM apps.
• Strong Python, SQL, and data handling (JSON/XML).
• Experience with prompt design, structured outputs, and LLM evaluation.
• Familiar with Git, debugging, and automated tests.
• Ability to communicate findings clearly and manage risks.

Responsibilities

• Develop and improve LLM-based workflows for extraction, classification, summarization, and content generation.
• Design and evaluate prompts, RAG, and multi-step agent workflows.
• Build data-prep pipelines including parsing, transformation, validation, and caching.
• Create evaluation datasets and run controlled experiments and regression tests.
• Collaborate with SMEs to assess factual accuracy and translate feedback into improvements.
• Diagnose problems across data, model behavior, and application logic.
• Balance output quality, latency, and cost of approaches.
• Maintain tested, version-controlled code and documentation.

Skills

Python programming

SQL

LLM development

Git

Automated tests

Education

Bachelor's degree or higher in CS/DS/Stats

Tools

PyTorch

scikit-learn

AWS S3/EC2

JSON

XML

Linux

Job description

Datumtg in Raleigh, NC is seeking engineers to advance LLM-based information-extraction and NLP workflows. You will design prompts, build RAG and multi-step agents, and create robust data-prep pipelines with strong testing practices.

We value collaboration with SMEs to ensure factual accuracy, and you will balance quality, latency, and cost while maintaining clear, versioned code and documentation. A strong background in Python and ML is essential.