Principal Data Scientist, NLP & Production AI

Wiley & Sons, Inc.; Hoboken (NJ); On-site; USD 120,000 - 201,000; Full time

Benefits offered by this job

Meeting-free Fridays

Professional development

Fair, transparent pay

Comprehensive benefits

Job summary

Wiley & Sons, Inc. in Hoboken, NJ seeks a Principal Data Scientist to own domain-specific content modeling end to end, building NLP enrichment pipelines over millions of scientific articles and delivering production-ready code that users rely on.

You will collaborate with editors, product managers, and engineers, compare NLP approaches, optimize for cost and latency, and ship end-to-end solutions from eval sets to deployment in a fast-evolving market.

Qualifications

• Deep Python. You’ve written it in production, at scale, for years.
• Strong NLP background across modern (LLMs, transformers, embeddings, retrieval) and classical approaches.
• Evaluations and learning from results.
• Habit of comparing approaches and choosing the right one for the task.
• Track record of shipping production systems that deliver value.
• Preferred: Experience with scientific or scholarly text.
• Familiarity with AWS services and data lake patterns.

Responsibilities

• Design and build NLP enrichment pipelines that extract entities, classifications, claims, and summaries from scientific full-text at scale.
• Compare NLP approaches to extraction and enrichment against LLM-based approaches, and pick the right tool for each task.
• Own evaluation.
• Build the golden sets in consultation with SMEs and vendors, choose the metrics, and balance speed, quality, and cost.
• Write production-quality Python.
• Manage concurrency and cost for high-volume LLM workloads.
• Structure code that engineers can ship and other data scientists can extend.
• Collaborate with data engineers to orchestrate data pipelines with Airflow and Dagster.
• Design idempotent, retryable, evaluable pipeline stages for reliability at scale.
• Contribute to agentic AI application work: tool-using systems that reason over the enriched corpus.
• Work directly with editors, product managers, and engineers.
• Bring modeling perspective into product decisions, translate stakeholder pushback into concrete modeling work.

Skills

Python

NLP

LLMs

Retrieval

Cost tradeoffs

Production systems

Prompt engineering

Model evaluation

Tools

Airflow

Dagster

SageMaker

Parquet/Iceberg

Job description

Wiley & Sons, Inc. in Hoboken, NJ seeks a Principal Data Scientist to own domain-specific content modeling end to end, building NLP enrichment pipelines over millions of scientific articles and delivering production-ready code that users rely on.

You will collaborate with editors, product managers, and engineers, compare NLP approaches, optimize for cost and latency, and ship end-to-end solutions from eval sets to deployment in a fast-evolving market.