PSYCHOMETRIC EVALUATION OF FLOOD DISASTER MANAGEMENT QUESTIONNAIRE: CONFIRMATORY FACTOR ANALYSIS AND ITEM RESPONSE THEORY ANALYSIS
DOI:
https://doi.org/10.37268/mjphm/vol.21/no.2/art.859Keywords:
Flood, Disaster, Questionnaire, Validation studiesAbstract
Flood disaster is the commonest natural disaster with huge impact on healthcare services in Malaysia. The FloodDMQ-BM© questionnaire was developed as a tool to assess the knowledge, attitude, and practice of healthcare providers regarding patient management during a flood disaster. We aim to further validate the FloodDMQ-BM© questionnaire by using Confirmatory Factor Analysis (CFA) and Item Response Theory (IRT).This cross-sectional study involved doctors, nurses and paramedics working in the Emergency Department of Hospital Universiti Sains Malaysia, Hospital Raja Perempuan Zainab II and Hospital Kuala Krai. Respondents were required to complete the FloodDMQ-BM© questionnaire. The responses were analysed by using CFA and IRT to establish its validity and reliability. A total of 215 respondents participated in this study. CFA analysis with Maximum Likelihood Robust as the estimation method, on the attitude and practice components resulted in good factor loadings (>0.5) in nearly all items and excellent model fit indices values (CFI = 0.96-0.98, TLI = 0.95-0.96, SRMR = 0.04-0.05, RMSEA = 0.07). Meanwhile, IRT analysis on the knowledge section showed a good two-way marginal fit based on S-X2, and a good model fit with RMSEA of 0.08. Based on the 2PL model by using the IRT assessment of the knowledge section, one item in the knowledge section (K3) was removed (chi-squared residual >4) resulting in improved model fit. The included items had well-standardized loadings (>0.3) and marginal reliability of 0. 651.Our results confirmed that the FloodDMQ-BM© questionnaire displayed valid and reliable psychometric properties.
References
International Federation of Red Cross and Red Crescent Societies. World Disasters Report: Focus on local actors, the key to humanitarian effectiveness [Internet]. Geneva: International Federation of Red Cross and Red Crescent Societies; 2015 [cited 2019 June 30]. Available from https://www.ifrc.org/en/news-and-media/press-releases/general/wdr-press-release/
Baharuddin KA, Abd Wahab SF, Nik Ab Rahman NH, et al. The Record-Setting Flood of 2014 in Kelantan: Challenges and Recommendations from an Emergency Medicine Perspective and Why the Medical Campus Stood Dry. Malays J Med Sci 2015; 22(2):1-7.
Abdul Ghani MN, Tuan Kamauzaman TH, Mohd Fudzi MFM, et al. Development And Psychometric Evaluation Of Flood Disaster Management Questionnaire-(FloodDMQ-BM): Exploratory Factor Analysis And Item Response Theory Analysis. International Journal of Public Health and Clinical Sciences 2016; 3(3).
Statistics Solutions. Confirmatory Factor Analysis [Internet]. Florida: Statistics Solutions; 2013 [cited 2019 June 30]. Available from: http://www.statisticssolutions.com/academic-solutions/resources/directory-of-statistical-analyses/confirmatory-factor-analysis/
Makransky G, Lilleholt L, Aaby A. Development and Validation of the Multimodal Presence Scale for Virtual Reality Environments: A Confirmatory Factor Analysis and Item Response Theory Approach. Comput Human Behav 2017; 72.
Diana DS. Exploratory or Confirmatory Factor Analysis? [Internet]. Northern Colorado: SAS Institute; 2006 [cited 2019 June 30]. Available from https://support.sas.com/resources/papers/proceedings/proceedings/sugi31/200-31.pdf
Yang FM, Kao ST. Item response theory for measurement validity. Shanghai Arch Psychiatry 2014; 26(3):171-177.
Rex BK. Principles and Practice of Structural Equation Modeling. New York: The Guilford Press 2011:427.
Rosseel Y. Package ‘lavaan’: Latent Variable Analysis [Internet]. Lavaan; 2019 [cited 2019 June 30] Available from https://cran.r-project.org/web/packages/lavaan/lavaan.pdf
Timothy AB. Confirmatory Factor Analysis for Applied Research. New York: The Guilford Press 2015:462.
Arifin WN, Yusoff MSB. Item response theory for medical educationists. Education in Medicine Journal 2017; 9(3):69–81.
Bartholomew DJ, Steele F, Moustaki I,et al. Analysis of Multivariate Social Science Data. Florida: CRC Press 2011:384.
Kenny DA, Kaniskan B, McCoach DB. The Performance of RMSEA in Models with Small Degrees of Freedom. Sociology Method & Research 2015; 44(3):486-507.
Orlando M, Thissen D. Further Investigation of the Performance of S-X2: An Item Fit Index for Use with Dichotomous Item Response Theory Models. Appl Psychol Meas 2003; 27(4):289-298.
Dimitrov D. Marginal True-Score Measures and Reliability for Binary Items as a Function of Their IRT Parameters. Appl Psychol Meas 2003; 27(6):440-458.
An GY, Sean P. A Beginner’s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis. Tutor Quant Methods Psychol 2013; 9(2):79-94.
Stoop VD. Using Item Response Theory to Analyze Properties of the Leadership Practices Inventory. British Journal of Science 2011; 1(1):140-162.
Hooper D, Coughlan J, Mullen M. Structural Equation Modelling: Guidelines for Determining Model Fit. Electronic Journal of Business Research Methods 2008; 6(1):53-60.
