Sr. Data Scientist - AI Voice

Lumeris; Massachusetts; On-site; USD 113,800 - 154,525; Full time

Benefits offered by this job

Medical, Vision and Dental Plans

401k with company match

PTO, Sick Time, Paid Leave

Job summary

Lumeris is seeking a Senior Data Scientist to build the voice AI and model capabilities behind Tom, our AI-enabled primary care platform. Reporting to the VP of AI, you will develop and fine-tune models and design the voice systems to test and trust them before patient use.

This hands-on role expects you to ship production voice solutions, optimize latency, and collaborate with clinical, product, and engineering teams to deliver scalable, reliable AI in healthcare.

Qualifications

• Bachelor's degree in a quantitative major or equivalent.
• 5+ years of data science, ML, or applied AI experience.
• Hands-on experience building and deploying production voice or conversational AI systems.
• Experience training neural networks from scratch and fine-tuning language models.
• Proven track record of shipping AI systems in production.
• Strong Python programming and frameworks (PyTorch, TensorFlow).
• Working knowledge of real-time audio infrastructure and telephony integration.

Responsibilities

• Build and deploy real-time conversational voice agents across the speech stack.
• Solve telephony audio fidelity, latency, interruptions and noise.
• Develop simulations to generate patient conversations at scale.
• Make architecture tradeoffs balancing control, latency and simplicity.
• Partner with clinical, product, and engineering teams to turn problems into technical work.

Skills

Voice AI systems

Python

Deep learning

PyTorch

TensorFlow

Real-time audio

Telephony integration

Model training from scratch

LLM / conversational AI

Education

Bachelor's degree in quantitative field

Master's degree preferred

Tools

GCP

Speech-to-text systems

Job description

Your Future is our Future At Lumeris, we believe that our greatest achievements are made possible by the talent and commitment of our team members. That's why we are actively seeking talented and collaborative individuals who are passionate about making a difference in the healthcare industry. Join us today as we strive to create a system of care that every doctor wants for their own family and become part of a community that values its people and empowers you to make an impact.

We're excited to consider every qualified candidate authorized to work in the United States, although we are unable to sponsor visas for this role at this time.

Position

Sr. Data Scientist - AI Voice

Position Summary

We're seeking a Senior Data Scientist to build the voice AI and model capabilities behind Tom, our AI-enabled primary care platform. Reporting directly to our VP of AI, you'll split your time between two halves of the same problem: developing and fine-tuning the models that power clinical AI, and building the voice systems that let us test, stress, and trust those models before they ever reach a patient. This is a hands-on, build-first role for someone who has personally trained models and shipped conversational voice systems into production.

Primary Responsibilities

• Build and deploy real-time conversational voice agents, working across the speech stack - speech-to-text, LLM reasoning, and text-to-speech, as well as newer speech-to-speech approaches.
• Solve the practical problems that determine whether voice works in the real world: telephony audio fidelity, latency, interruptions and barge-in, background noise, and variable capture conditions.
• Develop simulation capabilities that generate and role-play patient conversations at scale, covering the range of real-world conditions and edge cases that manual testing cannot reach.
• Make and defend architecture tradeoffs across the voice stack, balancing control, latency, and simplicity.

Model Development & Fine-tuning

• Design and train deep neural networks from the ground up, moving beyond off-the-shelf and regression-based approaches.
• Fine-tune language models on clinical and longitudinal healthcare data for prediction and generation tasks.
• Select and apply the right training approach for the problem, and articulate clearly where training, fine-tuning, and prompting each belong.
• Build the data pipelines and transformations that make clinical data usable for model development.

Evaluation & Safety

• Build evaluation pipelines that measure model output for accuracy, consistency, completeness, and omission - including LLM-as-judge approaches.
• Red-team AI agents to surface failure modes before they reach production, and translate findings into measurable quality improvements.
• Establish the testing discipline and quality signals that clinical reviewers rely on.

Cross-Functional Partnership

• Partner with clinical, product, and engineering teams to turn ambiguous problems into defined technical work.
• Communicate complex technical concepts credibly to both technical and non-technical audiences, including company leadership.
• Mentor junior team members and raise the technical standard across the group.

Qualifications

• Bachelor's degree with quantitative major (e.g. statistics, mathematics, economics, and actuarial science) or equivalent.
• 5+ year of relevant data science, machine learning, or applied AI experience, or the knowledge, skills, and abilities to succeed in the role.
• Must-have hands-on experience building and deploying production voice or conversational AI systems - speech and speech-to-speech, working with real audio in live environments, not text-only NLP or chat.
• Must-have demonstrated experience training neural networks from scratch and fine-tuning language models, with the ability to explain different training approaches and when each applies.
• Proven track record of shipping, scaling, and hardening AI systems in production.
• Strong programming skills in Python and fluency with modern deep learning frameworks (PyTorch, TensorFlow).
• Working knowledge of real-time audio infrastructure and telephony integration.

Preferred

• Master's or PhD in a quantitative or scientific discipline.
• Google Cloud Platform (GCP) experience.
• Healthcare or other regulated-domain experience, including familiarity with clinical data standards such as FHIR.
• Experience building voice models or conversational agents at an AI lab or voice-first platform.

Working Conditions

While performing the duties of this job, the employee works in normal office working conditions.

Disclaimer

The job description describes the general nature and level of work being performed by people assigned to this job and is not intended to be an exhaustive list of all responsibilities, duties and skills required. The physical activities, demands and working conditions represent those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential job duties and responsibilities.

Pay Transparency

Factors that may be used to determine your actual pay rate include your specific skills, experience, qualifications, location, and comparison to other employees already in this role. In addition to the base salary, certain roles may qualify for a performance-based incentive and/or equity, with eligibility depending on the position. These rewards are based on a combination of company performance and individual achievements.

The hiring range for this position is:

$113,800.00-$154,525.00

Benefits of working at Lumeris

• Medical, Vision and Dental Plans
• Tax-Advantage Savings Accounts (FSA & HSA)
• Life Insurance and Disability Insurance
• Paid Time Off (PTO, Sick Time, Paid Leave, Volunteer & Wellness Days)
• Employee Assistance Program
• 401k with company match
• Employee Resource Groups
• Employee Discount Program
• Learning and Development Opportunities
• And much more...

Be part of a team that is changing healthcare!

Member Facing Position

Drug Screen Requirement

Location

Massachusetts

Time Type

Full time

Lumeris and its partners are committed to protecting our high-risk members & prospects when conducting business in-person. All personnel who interact with at-risk members or prospects are required to have completed, at a minimum, the initial series of an approved COVID-19 vaccine. If this role has been identified as member-facing, proof of vaccination will be required as a condition of employment.

The job description describes the general nature and level of work being performed by people assigned to this job and is not intended to be an exhaustive list of all responsibilities, duties and skills required. The physical activities, demands and working conditions represent those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individual with disabilities to perform the essential job duties and responsibilities.

Lumeris is an EEO/AA employer M/F/V/D.