Document text
Principal Investigator: HERBERT M. SAURO
Organization: UNIVERSITY OF WASHINGTON
Fiscal Year: 2024
Award: $241,638
Funding agency: National Institute of Biomedical Imaging and Bioengineering
TECHNOLOGY RESEARCH & DEVELOPMENT 1: Project Summary
Computational modeling and simulation continue to be popular in biomedical research. However, doubts
remain as to the reliability or trustworthiness of such efforts. We say that a model is credible for an application
if its predictions are trusted and useful. Although what constitutes a credible model depends on its intended
usage, many current models are not credible. For example, it has been shown that a vast number of published
models cannot even be easily reproduced. That is, recreating the results of a published study is either
impossible or very difficult to achieve. If a model cannot be reproduced, then its credibility is immediately
suspect. Moreover, during the COVID pandemic, there has been much discussion of the credibility and utility
of COVID models, with a great deal focused on the way COVID models were built and tested. With more and
more models finding their way into the clinic, being used by policymakers, and in pharmaceutical companies,
the credibility of biomedical models has become a pressing problem. We therefore feel it is very important that
we begin to consider a systematic approach to assessing the credibility of biomedical models that allows non-
experts (or even researchers outside their particular domain) a means to gauge the credibility of a given
biomedical model. Work over the last decade to improve model reproducibility is a natural first step towards
improving model credibility. The Center for Reproducible Biomedical Modeling has advanced the
reproducibility of biomedical models by developing the biosimulation portal, a service that provides access to
reproducible models across a wide range of biological domains, not just systems biology. However, even though
a model may be reproducible, the question still arises as to how credible is the model.
The goals of this project include: (1) Develop a model management system (MMS) which will be a repository or
simulatable and reusable model parts. Add sophisticated query systems and model decomposition capabilities;
(2) Develop a flexible import/export layer that can accommodate many of the ways that modelers build
models; (3) Create a series of credibility tools that can be used to assess various credibility metrics of models
either held in the MMS or provided by users directly. Technology from TR&D 1 will be used by TR&D 3 as well
as our CPs and SPs.
Terms: <Address><Agreement><Area><Attention><Automation><Biological><Biomedical Research><Black Box><COVID crisis><COVID epidemic><COVID pandemic><COVID-19><COVID-19 crisis><COVID-19 epidemic><COVID-19 era><COVID-19 global health crisis><COVID-19 global pandemic><COVID-19 health crisis><COVID-19 pandemic><COVID-19 period><COVID-19 public health crisis><COVID-19 years><CV-19><Caring><Cell model><Cellular model><Charge><Clinic><Code><Coding System><Collaborations><Communities><Computer Models><Computer Simulation><Computer Software Development><Computer Software Engineering><Computer based Simulation><Computer software><Computerized Models><Coronavirus Infectious Disease 2019><Data><Documentation><Equilibrium><Event><Evolution><Fostering><Future><Goals><Grant><Healthcare><Industry><Infrastructure><Investigators><Laws><Learning><Modeling><Pharmaceutical Agent><Pharmaceuticals><Pharmacologic Substance><Pharmacological Substance><Phase><Policy Maker><Process><Programming Languages><Publishing><Pythons><Recommendation><Reporting><Reproducibility><Research Personnel><Researchers><SARS-CoV-2 epidemic><SARS-CoV-2 global health crisis><SARS-CoV-2 global pandemic><SARS-CoV-2 pandemic><SARS-coronavirus-2 epidemic><SARS-coronavirus-2 pandemic><Series><Services><Severe Acute Respiratory Syndrome CoV 2 epidemic><Severe Acute Respiratory Syndrome CoV 2 pandemic><Severe acute respiratory syndrome coronavirus 2 epidemic><Severe acute respiratory syndrome coronavirus 2 pandemic><Software><Software Engineering><Source Code><Specific qualifier value><Specified><System><Systems Biology><Techniques><Technology><Testing><Time><Trust><Uncertainty><Validation><Work><balance><balance function><biologic><computational modeling><computational models><computational simulation><computer based models><computerized modeling><computerized simulation><coronavirus disease 2019><coronavirus disease 2019 crisis><coronavirus disease 2019 epidemic><coronavirus disease 2019 global health crisis><coronavirus disease 2019 global pandemic><coronavirus disease 2019 health crisis><coronavirus disease 2019 pandemic><coronavirus disease 2019 public health crisis><coronavirus disease crisis><coronavirus disease epidemic><coronavirus disease pandemic><coronavirus disease-19><coronavirus disease-19 global pandemic><coronavirus disease-19 pandemic><coronavirus infectious disease-19><depository><develop software><developing computer software><digital twin><doubt><flexibility><flexible><health care><improved><model building><model-based simulation><models and simulation><neurophysiological><neurophysiology><pharmaceutical><repository><severe acute respiratory syndrome coronavirus 2 global health crisis><severe acute respiratory syndrome coronavirus 2 global pandemic><software development><success><technological research and development><technology research and development><tool><trustworthiness><user-friendly><validations>