A Novel Method for Expediting the Development of Patient-Reported Outcome Measures and an Evaluation of its Performance via Simulation
Date
2015-09
Authors
Garrard, Lili
Price, Larry R.
Bott, Marjorie J.
Gajewski, Byron J.
Journal Title
Journal ISSN
Volume Title
Publisher
Springer Nature
Abstract
Background: Developing valid and reliable patient-reported outcome measures (PROMs) is a critical step in promoting patient-centered health care, a national priority in the U.S. Small populations or rare diseases often pose difficulties in developing PROMs using traditional methods due to small samples.
Methods: To overcome the small sample size challenge while maintaining psychometric soundness, we propose an innovative Ordinal Bayesian Instrument Development (OBID) method that seamlessly integrates expert and participant data in a Bayesian item response theory (IRT) with a probit link model framework. Prior distributions obtained from expert data are imposed on the IRT model parameters and are updated with participants’ data. The efficiency of OBID is evaluated by comparing its performance to classical instrument development performance using actual and simulation data.
Results and Discussion: The overall performance of OBID (i.e., more reliable parameter estimates, smaller mean squared errors (MSEs) and higher predictive validity) is superior to that of classical approaches when the sample size is small (e.g. less than 100 subjects). Although OBID may exhibit larger bias, it reduces the MSEs by decreasing variances. Results also closely align with recommendations in the current literature that six subject experts will be sufficient for establishing content validity evidence. However, in the presence of highly biased experts, three experts will be adequate.
Conclusions: This study successfully demonstrated that the OBID approach is more efficient than the classical approach when the sample size is small. OBID promises an efficient and reliable method for researchers and clinicians in future PROMs development for small populations or rare diseases.
Description
Keywords
patient-reported outcome measures, health care, Counseling, Leadership, Adult Education, and School Psychology
Citation
Garrard, L., Price, L. R., Bott, M. J., & Gajewski, B. J. (2015). A novel method for expediting the development of patient-reported outcome measures and an evaluation of its performance via simulation. BMC Medical Research Methodology, 15, 77.
Rights
Rights Holder
© 2015 Garrard et al.
Rights License
This work is licensed under a Creative Commons Attribution 4.0 International License.