Applied AI Data Scientist

Jobzhr; New York, Northern (NY, KY); Hybrid; USD 130,000 - 180,000; Full time

Benefits offered by this job

Benefits package

Inclusive workplace

Job summary

Jobzhr in New York City seeks an Applied AI Data Scientist to help develop next-generation AI tools for the legal sector. This full-time role sits in our NYC office and focuses on turning customer needs into production-ready features, working closely with engineers and product teams to design experiments, evaluate models, and refine agentic workflows.

You will build and evaluate LLM applications, implement prompt engineering, retrieval augmented generation, and multi-step agentic systems, and

Qualifications

• Six+ years in data science or applied ML delivering production grade solutions.
• Strong Python, pandas, NumPy and scikit-learn with SQL experience.
• Experience building/app evaluating LLM apps using LangChain or similar.
• Solid experimental design and statistics foundations.
• Production-ready code and cloud experience required.

Responsibilities

• Engage with users to translate workflows into measurable goals.
• Develop and iterate on LLM apps including prompt engineering.
• Design evaluation frameworks for accuracy and reliability.
• Build prototypes to test concepts and steer architecture decisions.
• Collaborate across teams to ensure scalable, explainable AI.

Skills

Python

Pandas

NumPy

SQL

LangChain

LlamaIndex

LLMs

Prompt Engineering

Tools

AWS

Azure

GCP

Job description

Our client a global leader in professional information and analytics is seeking an Applied AI Data Scientist to help develop the next generation of artificial intelligence tools for the legal sector. This role is based full time in their New York City office.

This is a highly collaborative position that bridges the gap between customer needs and production ready AI features. You will work closely with engineers and product teams to design experiments evaluate model performance and refine agentic workflows. The focus is on moving beyond theory to build tangible high quality tools that assist with complex research and decision making processes.

Core Responsibilities

Engage directly with end users and subject matter experts to understand workflows and translate requirements into measurable technical goals.

Develop and iterate on large language model applications including prompt engineering retrieval augmented generation and multi step agentic systems.

Design rigorous evaluation frameworks to measure accuracy groundedness and reliability in high stakes environments.

Build runnable prototypes to test new concepts and de risk architectural choices before full scale development.

Conduct detailed error analysis and quality assessments to drive continuous improvement of AI pipelines.

Collaborate across functions to ensure AI solutions are scalable cost effective and explainable to non technical stakeholders.

Candidate Requirements

At least six years of professional experience in data science machine learning or applied science with a focus on shipping production grade solutions.

Advanced proficiency in Python and the standard data science stack including pandas NumPy and scikit learn alongside SQL expertise.

Practical experience building and evaluating applications powered by LLMs using frameworks such as LangChain LlamaIndex or various provider APIs.

Solid foundation in experimental design and statistics including hypothesis testing and uncertainty quantification.

Ability to write production oriented code and work within cloud environments like AWS Azure or GCP.

Strong communication skills with the ability to explain complex technical concepts to legal professionals and business leaders.

Preferred Skills

Experience in regulated industries such as legal tech finance or healthcare.

Background in building autonomous agents multi step reasoning systems or hybrid search architectures.

Knowledge of hallucination detection responsible AI practices and citation based generation.

Familiarity with fine tuning techniques and human in the loop annotation workflows.

This is an opportunity to join a major enterprise investing heavily in generative AI to reshape how professionals interact with information. The company provides a comprehensive benefits package and is committed to an inclusive and accessible workplace culture.