Sr. Data Scientist - AI Voice

The Blue Venture Fund; Massachusetts; On-site; USD 113,800 - 154,525; Full time

Benefits offered by this job

Medical, Vision and Dental Plans

401k with company match

Paid Time Off (PTO, Sick Time, PaidLe

Employee Assistance Program

Learning and Development Opportunities

Job summary

Lumeris is seeking a Senior Data Scientist to build the voice AI and model capabilities behind Tom, our AI-enabled primary care platform. You will report to the VP of AI and split time between developing models and building the voice systems for testing and production.

This hands-on role requires experience training neural networks from scratch and deploying production voice systems, with strong Python and deep learning framework skills.

Qualifications

• Bachelor's degree with quantitative major (e.g. statistics, mathematics, economics, actuarial science) or equivalent.
• 5+ year of relevant data science, machine learning, or applied AI experience, or the knowledge, skills, and abilities to succeed in the role.
• Must-have hands-on experience building and deploying production voice or conversational AI systems — speech and speech-to-speech, working with real audio in live environments, not text-only NLP or chat.
• Must-have demonstrated experience training neural networks from scratch and fine-tuning language models, with the ability to explain different training approaches and when each applies.
• Proven track record of shipping, scaling, and hardening AI systems in production.
• Strong programming skills in Python and fluency with modern deep learning frameworks (PyTorch, TensorFlow).
• Working knowledge of real-time audio infrastructure and telephony integration.

Responsibilities

• Build and deploy real-time conversational voice agents across the speech stack.
• Solve practical problems like telephony audio fidelity, latency, interruptions and noise.
• Develop simulation capabilities to stress-test conversations at scale.
• Make and defend architecture tradeoffs across the voice stack.

Skills

Voice AI development

Real-time audio systems

ML model training

Python

Production ML deployment

Model evaluation

Communication of technical concepts

Education

Bachelor's degree in quantitative major

Tools

PyTorch

TensorFlow

GCP

Job description

Your Future is our Future

At Lumeris, we believe that our greatest achievements are made possible by the talent and commitment of our team members. That's why we are actively seeking talented and collaborative individuals who are passionate about making a difference in the healthcare industry. Join us today as we strive to create a system of care that every doctor wants for their own family and become part of a community that values its people and empowers you to make an impact.

We're excited to consider every qualified candidate authorized to work in the United States, although we are unable to sponsor visas for this role at this time.

Position:

Sr. Data Scientist - AI Voice

Position Summary:

We're seeking a Senior Data Scientist to build the voice AI and model capabilities behind Tom, our AI-enabled primary care platform. Reporting directly to our VP of AI, you'll split your time between two halves of the same problem: developing and fine-tuning the models that power clinical AI, and building the voice systems that let us test, stress, and trust those models before they ever reach a patient. This is a hands-on, build-first role for someone who has personally trained models and shipped conversational voice systems into production.

Job Description:

Primary Responsibilities

Voice AI Development

• Build and deploy real-time conversational voice agents, working across the speech stack — speech-to-text, LLM reasoning, and text-to-speech, as well as newer speech-to-speech approaches.
• Solve the practical problems that determine whether voice works in the real world: telephony audio fidelity, latency, interruptions and barge-in, background noise, and variable capture conditions.
• Develop simulation capabilities that generate and role-play patient conversations at scale, covering the range of real-world conditions and edge cases that manual testing cannot reach.
• Make and defend architecture tradeoffs across the voice stack, balancing control, latency, and simplicity.

Model Development & Fine-Tuning

• Design and train deep neural networks from the ground up, moving beyond off-the-shelf and regression-based approaches.
• Fine-tune language models on clinical and longitudinal healthcare data for prediction and generation tasks.
• Select and apply the right training approach for the problem, and articulate clearly where training, fine-tuning, and prompting each belong.
• Build the data pipelines and transformations that make clinical data usable for model development.

Evaluation & Safety

• Build evaluation pipelines that measure model output for accuracy, consistency, completeness, and omission — including LLM-as-judge approaches.
• Red-team AI agents to surface failure modes before they reach production, and translate findings into measurable quality improvements.
• Establish the testing discipline and quality signals that clinical reviewers rely on.

Cross-Functional Partnership

• Partner with clinical, product, and engineering teams to turn ambiguous problems into defined technical work.
• Communicate complex technical concepts credibly to both technical and non-technical audiences, including company leadership.
• Mentor junior team members and raise the technical standard across the group.

Qualifications

• Bachelor's degree with quantitative major (e.g. statistics, mathematics, economics, and actuarial science) or equivalent.
• 5+ year of relevant data science, machine learning, or applied AI experience, or the knowledge, skills, and abilities to succeed in the role.
• Must-have hands-on experience building and deploying production voice or conversational AI systems — speech and speech-to-speech, working with real audio in live environments, not text-only NLP or chat.
• Must-have demonstrated experience training neural networks from scratch and fine-tuning language models, with the ability to explain different training approaches and when each applies.
• Proven track record of shipping, scaling, and hardening AI systems in production.
• Strong programming skills in Python and fluency with modern deep learning frameworks (PyTorch, TensorFlow).
• Working knowledge of real-time audio infrastructure and telephony integration.

Preferred

• Master's or PhD in a quantitative or scientific discipline.
• Google Cloud Platform (GCP) experience.
• Healthcare or other regulated-domain experience, including familiarity with clinical data standards such as FHIR.
• Experience building voice models or conversational agents at an AI lab or voice-first platform.

Working Conditions

• While performing the duties of this job, the employee works in normal office working conditions.

Disclaimer

• The job description describes the general nature and level of work being performed by people assigned to this job and is not intended to be an exhaustive list of all responsibilities, duties and skills required. The physical activities, demands and working conditions represent those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential job duties and responsibilities.

Pay Transparency:

Factors that may be used to determine your actual pay rate include your specific skills, experience, qualifications, location, and comparison to other employees already in this role. In addition to the base salary, certain roles may qualify for a performance-based incentive and/or equity, with eligibility depending on the position. These rewards are based on a combination of company performance and individual achievements.

The hiring range for this position is:

$113,800.00-$154,525.00

Benefits of working at Lumeris

• Medical, Vision and Dental Plans
• Tax-Advantage Savings Accounts (FSA & HSA)
• Life Insurance and Disability Insurance
• Paid Time Off (PTO, Sick Time, Paid Leave, Volunteer & Wellness Days)
• Employee Assistance Program
• 401k with company match
• Employee Resource Groups
• Employee Discount Program
• Learning and Development Opportunities
• And much more...

Be part of a team that is changing healthcare!

Member Facing Position:

Drug Screen Requirement:

Location:

Massachusetts

Time Type:

Full time

Lumeris and its partners are committed to protecting our high-risk members & prospects when conducting business in-person. All personnel who interact with at-risk members or prospects are required to have completed, at a minimum, the initial series of an approved COVID-19 vaccine. If this role has been identified as member-facing, proof of vaccination will be required as a condition of employment.

Lumeris is an EEO/AA employer M/F/V/D.