AI Engineer I

Duly Health and Care; Chicago (IL); On-site; USD 65,000 - 85,000; Full time

Benefits offered by this job

Comprehensive medical, dental, vision

Mental health benefit

Employer provided life and disability

Tuition reimbursement

Immediate 401(k) match

Volunteer time off

Parental leave

Job summary

Duly Health and Care is seeking an AI Engineer I to join the Data & Analytics team. You will help build and support AI platforms and models that improve patient care and operations, with a focus on conversational AI and generative AI solutions using Kore.ai and Claude.

The role emphasizes deployment, monitoring, and collaboration with engineers, data scientists, and clinical partners, with training provided for healthcare-specific needs.

Qualifications

• Bachelor's degree in computer science, data science, information systems, engineering, or a related field; or 2 years of related experience; or an equivalent combination of education and experience
• 0-2 years of experience in software development, data engineering, DevOps, or machine learning (internships, co-ops, research, and academic projects count)
• Proficiency in Python and working knowledge of SQL
• Experience working with REST APIs and JSON
• Experience with LLMs, prompt engineering, or GenAI frameworks beneficial
• Experience with conversational AI or chatbot platforms, such as Kore.ai, beneficial
• Experience with Git, CI/CD, and cloud platforms (Azure preferred), Databricks, or MLflow beneficial
• Healthcare or Epic experience not required; training provided

Responsibilities

• AI platform implementation and integration (40%)
• Support the implementation of Claude-powered applications, including API integrations, prompt and system configuration, retrieval-augmented generation (RAG) pipelines, and tool or agent workflows
• Deploy, monitor, and provide operational support for AI models and applications across environments
• Build and maintain CI/CD pipelines and infrastructure-as-code for deployment of models, prompts, and AI apps
• Monitor performance, availability, latency, and cost of AI solutions and respond to alerts
• Collaborate with data scientists, data engineers, architects, and business stakeholders to define requirements and deliver reliable AI solutions
• Stay current with advances in generative AI, conversational AI, and MLOps practices

Skills

Python

SQL

REST APIs

JSON

LLMs

Prompt engineering

Azure

Git

Databricks

MLflow

Education

Bachelor's degree in computer science or related field

Tools

Kore.ai

Claude

Azure

Databricks

MLflow

Job description

Information and Transform

At Duly Health and Care, you are supported to do your best work and make a meaningful impact every day. You will be part of a collaborative, physician-led team that works as one and puts patients at the center of everything we do. With a connected network of providers, care teams, and services across primary and specialty care, surgery centers, imaging, lab, and therapy, you are part of a system designed to deliver high-quality, coordinated care. Together, we create an environment where you can grow, contribute, and help improve the experience and outcomes for every patient we serve.

Benefits:

• Comprehensive medical, dental, and vision benefits that include healthcare navigation assistance.


• Access to a mental health benefit at no cost.


• Employer provided life and disability insurance.


• $5,250 Tuition Reimbursement per year.


• Immediate 401(k) match.


• 40 hours paid volunteer time off.


• A culture committed to community engagement and social impact.


• Up to 12 weeks parental leave at 100% pay and a financial benefit for adoption and surrogacy for non-physician team members once eligibility requirements are met.

Primary Purpose

The AI Engineer I is an early-career role within the Data & Analytics team, working with the AI/ML team to implement, deploy, and support the AI platforms and models that improve patient care, operations, and the colleague experience. This position focuses on conversational AI and generative AI solutions, including the Kore.ai platform and large language model (LLM) applications built on Claude, and on the automation, monitoring, and operational practices that keep those solutions reliable, secure, and cost-effective. This role is a strong fit for someone with solid programming and cloud fundamentals who wants to grow into AI engineering and MLOps in a healthcare setting. No prior healthcare or Epic experience is required; we will train you.

Major Responsibilities

AI platform implementation and integration (40%)

• Help configure, build, and integrate conversational AI and virtual assistant solutions on the Kore.ai platform


• Support the implementation of Claude-powered applications, including API integrations, prompt and system configuration, retrieval-augmented generation (RAG) pipelines, and tool or agent workflows


• Integrate AI solutions with enterprise systems, data sources, and APIs in collaboration with data engineers and application teams


• Support testing of AI solutions, including functional testing, regression testing, and evaluation of output quality, accuracy, and safety


• Document solution designs, configurations, integrations, and release notes

Deployment, monitoring, and operational support (40%)

• Build and maintain CI/CD pipelines and infrastructure-as-code for the deployment of models, prompts, and AI applications across environments


• Monitor the performance, availability, usage, latency, and cost of AI solutions, and respond to alerts and incidents


• Provide day-to-day support and troubleshooting for AI platforms and the users who depend on them, escalating to vendors and senior engineers as needed


• Support model and prompt versioning, evaluation, and retraining or refresh using the organization's ML platform and MLOps practices


• Follow organizational standards for responsible AI, data privacy, security, and the protection of PHI/PII, including access control and audit practices

Collaboration and continuous improvement (20%)

• Partner with data scientists, data engineers, architects, application teams, and business stakeholders to define requirements and deliver reliable AI solutions


• Communicate technical concepts to non-technical audiences, including clinical and operational leaders


• Learn from senior engineers and data scientists through code reviews and mentoring


• Stay current with advances in generative AI, conversational AI, and MLOps practices and share learnings with the team


• All other duties as assigned

Minimum Education and Experience

Bachelor's degree in computer science, data science, information systems, engineering, or a related field; or 2 years of related experience; or an equivalent combination of education and experience

0-2 years of experience in software development, data engineering, DevOps, or machine learning (internships, co-ops, research, and academic projects count)

Proficiency in Python and working knowledge of SQL

Experience working with REST APIs and JSON

Experience with LLMs, prompt engineering, or GenAI frameworks beneficial

Experience with conversational AI or chatbot platforms, such as Kore.ai, beneficial

Experience with Git, CI/CD, and cloud platforms (Azure preferred), Databricks, or MLflow beneficial

Healthcare or Epic experience not required; training provided

Minimum Knowledge, Skills, and Abilities (KSA)

• Solid foundation in software engineering practices, including version control, testing, and code review


• Understanding of how LLMs work, including their strengths and limitations


• Understanding of the machine learning lifecycle, including deployment, monitoring, and retraining


• Strong analytical, organizational, and problem-solving skills, including troubleshooting production issues


• Strong communication skills and the ability to explain technical concepts to all levels of the organization


• Ability to work both independently and in a team-oriented environment


• Intellectual curiosity and a desire to learn and adopt new AI and MLOps techniques


• Awareness of ethical AI, data privacy, and information security considerations helpful

If you are committed to putting our patients first and helping shape the future of care, you belong at Duly.

The compensation for this role includes a base pay range of $65,000 - $85,000, with the actual pay determined by factors such as skills, experience, education, certifications, geographic location, and internal equity. Additional compensation may be available through shift differentials, bonuses, and other incentives. Base pay is only a portion of the total rewards package.

Artificial Intelligence Disclosure

Artificial Intelligence (AI) tools may be used in some portions of the candidate review process for this position, however, all employment decisions will be made by a person.

Let’s start with what matters. People. Purpose. Care. At Duly Health and Care, we believe healthcare works best when it’s personal, connected, and led by people who truly care. We are a physician-led medical group built on trusted relationships, teamwork, and a shared commitment to putting patients first in every decision we make. Our team members are caregivers, collaborators, problem-solvers, and leaders. Together, we show up with compassion, act with purpose, and take ownership of the care we deliver and the experience we create. Whether you’re caring directly for patients or supporting the teams who do, your role matters here, and your voice is valued. We listen with intention, work as one, and challenge ourselves to keep improving, not for recognition, but because our patients, families, and communities count on us.

Innovation at Duly isn’t about chasing what’s next for its own sake. It’s about finding better ways to deliver high-quality, affordable, and accessible care, today and into the future.

If you’re looking for meaningful work, supportive teammates, and the opportunity to help shape the future of care while staying grounded in compassion and community, you’ll find your place at Duly.