Associate Director of Data Science - RAG, NLP, LLM and GenAI

Lensa; New York (NY); On-site; USD 150,000 - 215,000; Full time

Job summary

An opportunity has arisen for an Associate Director of Data Science at a leading firm in the risk management solutions sector. This position involves developing cutting-edge ML models, leveraging expertise in NLP and GenAI, and collaborating with diverse stakeholders to drive impactful business outcomes. Ideal candidates will possess advanced degrees and significant experience in machine learning and data science methodologies.

Benefits

Health & Wellness benefits

Flexible Downtime

Continuous Learning resources

Financial wellness programs

Family-friendly perks

Qualifications

• 8+ years of experience with structured and unstructured data.
• 3+ years of hands-on experience with NLP models.
• Expertise in Python programming.

Responsibilities

• Design and develop custom ML, Gen AI, NLP, LLM Models.
• Collaborate with teams for model evaluation and deployment.
• Document ML modeling processes and procedures.

Skills

Machine Learning

Natural Language Processing

Generative AI

Deep Learning

Data Engineering

Python

Education

Bachelor's / Master’s or Ph.D in Computer Science, Mathematics, Statistics, Engineering or related field

Tools

Python

Hugging Face

TensorFlow

Keras

PyTorch

Job description

Associate Director of Data Science - RAG, NLP, LLM and GenAI

Associate Director of Data Science - RAG, NLP, LLM and GenAI

2 days ago Be among the first 25 applicants

Lensa is the leading career site for job seekers at every stage of their career. Our client, S&P Global, is seeking professionals in New York, NY. Apply via Lensa today!

About The Role

Grade Level (for internal use):

12

The Role: Associate Director of Data Science – RAG, NLP, LLM and GenAI

S&P is a leader in risk management solutions leveraging automation and AI/ML. This role is a unique opportunity for hands-on ML scientists and NLP/Gen AI/ LLM scientists to grow into the next step in their career journey and apply her or his technical expertise in NLP, deep learning, GenAI, and LLMs to drive business value for multiple stakeholders while conducting cutting-edge applied research around LLMs, Gen AI, and related areas.

Responsibilities And Impact

• ML, Gen AI, NLP, LLM Model Development: Design and develop custom ML, Gen AI, NLP, LLM Models for batch and stream processing-based AI ML pipelines. Model components will include data ingestion, preprocessing, search and retrieval, Retrieval Augmented Generation (RAG), NLP/LLM model development, fine-tuning and prompt engineering and ensure the solution meets all technical and business requirements. Work closely with other members of data science, MlOps, technology teams in the design, development, and implementation of the ML model solutions.
• ML, NLP, LLM Model Evaluation: Work closely with the other data science team members to develop, validate, and maintain robust evaluation solutions and tools to evaluate model performance, accuracy, consistency, reliability, during development, UAT. Implement model optimizations to improve system efficiency.
• NLP, LLM, Gen AI Model Deployment: Work closely with the MLOps team for the deployment of machine learning models into production environments, ensuring reliability and scalability.
• Internal Collaboration: Collaborate closely with product teams, business stakeholders, Mlops, machine learning engineers, and software engineers to ensure smooth integration of machine learning models into production systems.
• Documentation: Write and Maintain comprehensive documentation of ML modeling processes and procedures for reference and knowledge sharing.
• Develop Models Based on Standards and Best Practices: Ensure that the models are designed and developed while adhering to specified standards, governance and best practices in ML model development as specified by senior Data Science and MLOps leads.
• Assist in Problem Solving: Troubleshoot complex issues related to machine learning model development and data pipelines and develop innovative solutions.
  
  

What We’re Looking For

Basic Required Qualifications:

• Bachelor's / Master’s or Ph.D degree in Computer Science, Mathematics or Statistics, Computational linguistics, Engineering, or a related field.
• 8+ years of professional hands-on experience leveraging large sets of structured and unstructured data to develop data-driven tactical and strategic analytics and insights using ML, RAG, and NLP.
• Demonstrated 3+ years hands-on experience with Python, Hugging Face, TensorFlow, Keras, PyTorch or similar statistical tools. Expert in python programming.
• 3+ years hands-on experience developing natural language processing (NLP) models, ideally with transformer architectures.
• 3+ years of experience with implementing information search and retrieval at scale, using a range of solutions ranging from keyword search to semantic search using embeddings.
• Knowledge of and measurable hands-on experience with developing or tuning Large Language Models (LLM) and Generative AI (GAI)
• Experienced with NLP, LLMs (extractive and generative), fine-tuning and LLM model development. Strong familiarity with higher level trends in LLMs and open-source platforms
• Nice to have: Experience with contributing to Github and open source initiatives or in research projects and/or participation in Kaggle competitions.
  
  

Compensation/Benefits Information (US Applicants Only)

S&P Global states that the anticipated base salary range for this position is $150,000 - $215,000. Final base salary for this role will be based on the individual’s geographical location as well as experience and qualifications for the role.

In addition to base compensation, this role is eligible for an annual incentive plan.

This role is eligible to receive additional S&P Global benefits. For more information on the benefits we provide to our employees, please click here (https://spgbenefits.com/benefit-summaries/us) .

About S&P Global Ratings

At S&P Global Ratings, our analyst-driven credit ratings, research, and sustainable finance opinions provide critical insights that are essential to translating complexity into clarity so market participants can uncover opportunities and make decisions with conviction. By bringing transparency to the market through high-quality independent opinions on creditworthiness, we enable growth across a wide variety of organizations, including businesses, governments, and institutions.

S&P Global Ratings is a division of S&P Global (NYSE: SPGI). S&P Global is the world’s foremost provider of credit ratings, benchmarks, analytics and workflow solutions in the global capital, commodity and automotive markets. With every one of our offerings, we help many of the world’s leading organizations navigate the economic landscape so they can plan for tomorrow, today.

For more information, visit www.spglobal.com/ratings

What’s In It For You?

Our Purpose

Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology–the right combination can unlock possibility and change the world.

Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence, pinpointing risks and opening possibilities. We Accelerate Progress.

Our People

We're more than 35,000 strong worldwide—so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.

From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We’re committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We’re constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.

Our Values

Integrity, Discovery, Partnership

At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of integrity in all we do, bring a spirit of discovery to our work, and collaborate in close partnership with each other and our customers to achieve shared goals.

Benefits

We take care of you, so you can take care of business. We care about our people. That’s why we provide everything you—and your career—need to thrive at S&P Global.

Our Benefits Include

• Health & Wellness: Health care coverage designed for the mind and body.
• Flexible Downtime: Generous time off helps keep you energized for your time on.
• Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
• Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
• Family Friendly Perks: It’s not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
• Beyond the Basics: From retail discounts to referral incentive awards—small perks can make a big difference.
  
  

For more information on benefits by country visit: https://spgbenefits.com/benefit-summaries

Inclusive Hiring And Opportunity At S&P Global

At S&P Global, we are committed to fostering an inclusive workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and equal opportunity, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.

S&P Global has a Securities Disclosure and Trading Policy (“the Policy”) that seeks to mitigate conflicts of interest by monitoring and placing restrictions on personal securities holding and trading. The Policy is designed to promote compliance with global regulations. In some Divisions, pursuant to the Policy’s requirements, candidates at S&P Global may be asked to disclose securities holdings. Some roles may include a trading prohibition and remediation of positions when there is an effective or potential conflict of interest. Employment at S&P Global is contingent upon compliance with the Policy.

Equal Opportunity Employer

S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.

If you need an accommodation during the application process due to a disability, please send an email to: [e-mail] and your request will be forwarded to the appropriate person.

US Candidates Only: The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - https://www.dol.gov/sites/dolgov/files/ofccp/pdf/pay-transp_%20English_formattedESQA508c.pdf

20 - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority – Ratings - (Strategic Workforce Planning)

Job ID: 310834

Posted On: 2025-02-24

Location: New York, New York, United States

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Lensa by 2x

Get notified about new Director Data Science jobs in New York, NY.

New York, NY $253,000.00-$314,000.00 4 days ago

Head of Data Science & AI Lead/Co-Founder

Vice President, Data Science & Analytics

Brooklyn, NY $326,000.00-$424,000.00 1 day ago

Vice President, Data Science & Analytics

New York, NY $148,000.00-$185,000.00 1 hour ago

Senior Artificial Intelligence (AI) Data Scientist (Director), Data & Technology, Data Analytics & AI (Remote)

New York City Metropolitan Area 2 weeks ago

Senior Director, Machine Learning and AI

New York, NY $220,000.00-$250,000.00 1 week ago

New York, NY $200,000.00-$230,000.00 2 days ago

Vice President Computational Data Science

New York City Metropolitan Area 3 weeks ago

Director, Data Science/Advanced Analytics - VP

New York, NY $160,000.00-$220,000.00 3 weeks ago

New York, NY $163,210.00-$234,570.00 1 hour ago

New York, NY $200,000.00-$230,000.00 2 days ago

New York, NY $190,000.00-$215,000.00 1 week ago

New York, NY $222,000.00-$299,000.00 1 week ago

Customer Intelligence Lead (Director), Data Science & Advanced Analytics

New York, NY $98,000.00-$186,000.00 1 day ago

Director, Data Science Platform | Data Science Platform

New York City Metropolitan Area $170,000.00-$185,000.00 4 days ago

New York City Metropolitan Area 2 weeks ago

Vice President, Data Science & Analytics

Director of Data Science & Artificial Intelligence (AI)

Manhattan, NY $196,000.00-$264,000.00 4 days ago

New York, NY $170,000.00-$180,000.00 2 days ago

New York, NY $209,000.00-$359,150.00 5 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.