Senior GenAI Scientist II - Risk & Responsible AI (Remote)

Cotiviti; United States; Remote; USD 153,000 - 180,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k)

Paid family leave

Paid holidays

Paid time off

Job summary

Cotiviti is seeking a Senior GenAI Scientist II - Risk to join a newly formed team focused on Model Risk and Responsible AI. You will apply knowledge and experience to real world problems and seek to utilize your skills to reduce the cost of healthcare and improve health quality and outcomes.

You will focus on three main project areas: Model Validation, Model Metrics and Monitoring, and Responsible AI, requiring depth in AI/ML/GenAI and strong systems thinking. This role is remote from the U.S.

Qualifications

• Graduate degree in a quantitative discipline such as Computer Science/Engineering, Statistics, Operations Research covering Advanced Statistics, Machine learning and AI.
• Experience with the latest techniques in natural language processing including transformers, fine-tuning LLMs, measuring/benchmarking and deploying LLMs with tools such as HuggingFace, Langchain, LLAMA/Mistral and OpenAI, vector databases.
• 5+ years of hands-on data science/AI experience, using typical machine learning and data science tools including pandas, scikit-learn, keras, nltk, and TensorFlow/PyTorch, GPU.

Responsibilities

• Conduct independent model validation of existing models for benchmarking, assessment, and gauging effectiveness.
• Benchmark and potentially rebuild existing models as needed using updated data and newer algorithms.
• Actively drive improvements in model monitoring activities, including methods for model registration, model metadata management, and conceptualizing approaches for related tools and techniques.
• Must be able to perform duties with or without reasonable accommodation.

Skills

GenAI/AI/ML

Model validation

NLP transformers

Bias/Fairness

Model monitoring

Distributed computing

Spark

Python

Communication

AWS/Azure/GCP

Education

Graduate degree in Computer Science/Engineering/Statistics

Tools

HuggingFace

Langchain

LLAMA/Mistral

OpenAI

Vector databases

AWS SageMaker

DataBricks

MLFlow

NannyML

Arize

Job description

Cotiviti is seeking a Senior GenAI Scientist II - Risk to join a newly formed team focused on Model Risk and Responsible AI. You will apply knowledge and experience to real world problems and seek to utilize your skills to reduce the cost of healthcare and improve health quality and outcomes.

You will focus on three main project areas: Model Validation, Model Metrics and Monitoring, and Responsible AI, requiring depth in AI/ML/GenAI and strong systems thinking. This role is remote from the U.S.