Academic Research
Lirio is a science-focused company, using evidence-based approaches to creating solutions to nudge individuals to take action for better health. Our team of PhDs collaborate through the Behavioral Reinforcement Learning Lab (BReLL). Their expertise: behavioral science, machine learning, computer science, mathematics, and more.
Lirio’s Behavioral Reinforcement Learning Lab (BReLL) aims to re-shape the current understanding of how behavior change and AI come together to address some of the most stubbornly persistent challenges in healthcare: patient engagement, care gaps, and improved health outcomes.
Selected, published research of Lirio team members can be found below. If you have questions for our researchers, please email behavioralresearch@lirio.com.
Featured Research
Responses to a COVID-19 Vaccination Intervention: Qualitative Analysis of 17k Unsolicited SMS Replies
Blazek, E.S., West, A.B., & Bucher, A. (2023)
Health Psychology
Understanding why some people choose to not get vaccinated against COVID-19 continues to be important. In this study of more than 17,000 text messages sent in reply to Lirio’s COVID-19 vaccination Precision Nudging intervention, Lirio’s behavioral scientists coded 22 types of reply. Insights from these unsolicited replies enhance the ability to identify appropriate intervention techniques that can promote COVID-19 vaccination.
The Patient Experience of the Future is Personalized: Using Technology to Scale an N of 1 Approach
Bucher, A. (2023)
Journal of Patient Experience
Personalized experiences are more effective at creating sustained behavior change. Digitally enabled personalized outreach can improve patient’s experience by providing relevant, meaningful calls to action at a time when labor-intensive human-to-human personalization is challenged by systemic health staffing shortages. Strategic use of digital tools to engage patients and supplement human-to-human care scale personalization to the benefit of patient and provider experience.
Persona-Based Conversational AI: State of the Art and Challenges
Liu, J., Symons, C., & Vatsavai, R. R. (2022)
2022 IEEE International Conference on Data Mining Workshops
Conversational AI has become an increasingly prominent and practical application of machine learning. However, existing conversational AI techniques suffer from various limitations such as a lack of well-developed methods for incorporating auxiliary information that could help a model understand conversational context better. We explore how persona-based information could help improve the quality of response generation in conversations.
Additional Research
Examining Policy Entropy of Reinforcement Learning Agents for Personalization Tasks
Dereventsov, A., Starnes, A., & Webster, C. G. (2022)
We demonstrate that Policy Optimization agents often possess low-entropy policies during training, which in practice results in agents prioritizing certain actions and avoiding others. Conversely, we also show that Q-Learning agents are far less susceptible to such behavior and generally maintain high-entropy policies throughout training, which is often preferable in real-world applications.
On the Unreasonable Efficiency of State Space Clustering in Personalization Tasks
A. Dereventsov, R. R. Vatsavai, & C. G. Webster (2022)
2021 IEEE International Conference on Data Mining Workshops
In this effort we consider a reinforcement learning (RL) technique for solving personalization tasks with complex reward signals. Numerical examples demonstrate the efficiency of different RL procedures and are used to illustrate that this technique accelerates the agent’s ability to learn and does not restrict the agent’s performance.
An Adaptive Stochastic Gradient-free Approach for High-dimensional Blackbox Optimization
Dereventsov, A., Webster, C. G., & Daws, J. (2020)
Proceedings of the International Conference on Computational Intelligence
We propose a novel adaptive stochastic gradient-free (ASGF) approach for solving high-dimensional nonconvex optimization problems based on function evaluations. We employ a directional Gaussian smoothing of the target function that generates a surrogate of the gradient and assists in avoiding bad local optima by utilizing nonlocal information of the loss landscape. Applying a deterministic quadrature scheme results in a massively scalable technique that is sample-efficient and achieves spectral accuracy.
Simulated Contextual Bandits for Personalization Tasks from Recommendation Datasets
Dereventsov, A., & Bibin, A. (2022)
2022 IEEE International Conference on Data Mining Workshops
We propose a method for generating simulated contextual bandit environments for personalization tasks from recommendation datasets like MovieLens, Netflix, Last.fm, Million Song, etc. The obtained environments can be used to develop methods for solving personalization tasks, algorithm benchmarking, model simulation, and more.
Modeling Non-deterministic Human Behaviors in Discrete Food Choices
A. Starnes, A. Dereventsov, E. S. Blazek, & F. Phillips (2022)
2022 IEEE International Conference on Data Mining Workshops
We establish a non-deterministic model that predicts a user’s food preferences from their demographic information. Our simulator is based on NHANES dataset and domain expert knowledge in the form of established behavioral studies.
Offline Policy Comparison Under Limited Historical Agent-environment Interactions
Dereventsov, A., Daws, J., & Webster, C. G. (2022)
We address the challenge of policy evaluation in real-world applications of reinforcement learning systems where the available historical data is limited due to ethical, practical, or security considerations.
Feasibility of a Reinforcement Learning–Enabled Digital Health Intervention to Promote Mammograms: Retrospective, Single-Arm, Observational Study
Bucher, A., Blazek, E.S., & West, A.B. (2022)
In a retrospective single-arm observational study, Lirio’s Precision Nudging for Mammography reached almost 140,000 women significantly overdue for recommended breast cancer screening. Data suggested that Precision Nudging has equitable outreach, with proportional responses across age groups, race, household income levels, and educational attainment.
If We Build It Right, They Will Come: Driving Health Outcomes With Precision Nudging
Delaney, S., & Bucher, A. (2022)
The Behavioral Economics Guide 2022
Lirio matches behavioral techniques to best support the desired target behaviors. In this paper, learn how Lirio’s designers leverage behavioral economics “nudges” as an engagement strategy that allows them to deliver in-depth behavior change techniques within the intervention.
An Economic Impact Model for Estimating the Value to Health Systems of a Digital Intervention for Diabetes Primary Care: Development and Usefulness Study
Powers, B. & Bucher, A. (2022)
What is the value of a primary care visit for a patient with diabetes to a health system? In this paper, Lirio shares a model leveraging publicly available national data that allows health systems to calculate an economic impact for primary care in patients with Type 1 and Type 2 diabetes by adding the payer mix for their population.
Personalized Digital Health Communications to Increase COVID-19 Vaccination in Underserved Populations: A Double Diamond Approach to Behavioral Design
Ford, K. L., West, A. B., Bucher, A., & Osborn, C. Y. (2022)
In this paper, learn about how Lirio’s behavioral designers used the Double Diamond model to intentionally incorporate research from diverse populations to deliver health equity for COVID-19 vaccination.