SATISFACTION LEVEL AND ITS ASSOCIATED FACTORS AMONG GOVERNMENT ELECTRONIC MEDICAL RECORD SYSTEM USERS IN KLANG VALLEY
Abstract
To ensure a good return of investment of future nationwide integrated EMR systems, the systems must be accepted and well utilised, which depend on user satisfaction level. Therefore, this study was conducted to assess the satisfaction level among EMR system users and determine its associated factors and predictors. A cross-sectional study using stratified proportionate random sampling was conducted among doctors, assistant medical officers, staff nurses, pharmacists, pharmacy assistants, medical laboratory technologists, and radiographers in government health facilities with EMR systems in the Klang Valley. Data were collected using an online self-administered questionnaire. A total of 440 respondents participated in this study (70.5% response rate). The majority of the respondents (84.8%) were satisfied with the current EMR systems. Five variables had statistically significant associations with EMR system user satisfaction; technical proficiency, perceived benefits, education level, gender, and system experience. There were three predictors to EMR system user satisfaction. Users with technical proficiency were 18.1 times more likely to be satisfied than users without technical proficiency. Users with certificate and diploma education levels were 2.2 times more likely to be satisfied than those with bachelor and postgraduate education. Female users were 2.1 times more likely to be satisfied than male users. Thus, change management or any interventions should be tailored according to the needs of staff who tend to be less satisfied with the systems.
Keywords: Electronic medical record, health information system, hospital, health clinic, user satisfaction
References
Ministry of Health Malaysia. Telemedicine Flagship Application. Malaysia’s Telemedicine Blueprint: Leading Healthcare into the Information Age.; 1997.
Mat Som MH, Norali AN, Megat Ali MSA. Telehealth in Malaysia - An overview. 2010 IEEE Symp Ind Electron Appl (ISIEA 2010). 2010;(October):660-664. doi:10.1109/ISIEA.2010.5679384
Abd Ghani MK, Bali RK, Naguib RNG, Marshall IM, Wickramasinghe NS. Electronic health records approaches and challenges: A comparison between Malaysia and four East Asian countries. Int J Electron Healthc. 2008;4(1):78-104. doi:10.1504/IJEH.2008.018922.
Ismail NI, Abdullah NH. Developing electronic medical records (EMR) framework for Malaysia’s public hospitals. 2011 IEEE Colloq Humanit Sci Eng (CHUSER 2011). 2011;(December):131-136. doi:10.1109/CHUSER.2011.6163702.
The Star. EMR system to be implemented at 145 hospitals within the next three years. Star Online. Published online 2018. https://www.thestar.com.my/news/nation/2018/11/08/health-minister-emr-system-to-be-implemented-at-145-hospitals-within-the-next-three-years/.
Choi J, Wook Kim J, Seo JW, et al. Implementation of consolidated HIS: Improving quality and efficiency of healthcare. Healthc Inform Res. 2010;16(4):299-304. doi:10.4258/hir.2010.16.4.299.
Malaysian Investment Development Authority. Malaysia Investment Performance Report 2019. Published online 2019.
Saghaeiannejad-Isfahani S, Jahanbakhsh M, Habibi M, Mirzaeian R, Nasirian M, Rad JS. A survey on the users’ satisfaction with the hospital information systems (HISs) based on DeLone and McLean’s model in the medical-teaching hospitals in Isfahan city. Acta Inform Medica. 2014;22(3):179-182. doi:10.5455/aim.2014.22.179-182.
Doll WJ, Torkzadeh G. The Measurement of End-User Computing Satisfaction. MIS Q. 1988;12(2):259-274. http://www.jstor.org/stable/248851.
DeLone WH, McLean ER. Information systems success: The quest for the dependent variable. Inf Syst Res. 1992;3(1):60-95. doi:10.1287/isre.3.1.60.
Ives B, Olson MH. User Involvement and MIS Success: A Review of Research. Manage Sci. 1984;30(5):586-603. doi:10.1287/mnsc.30.5.586.
Davis FD. User acceptance of information technology: system characteristics, users perceptions and behavioral impacts. Int J Man-Machine Stud. 1993;38(3):475-487. doi:https://doi.org/10.1006/imms.1993.1022.
Ajami S, Mohammadi-Bertiani Z. Training and its Impact on Hospital Information System (HIS) Success. J Inf Technol Softw Eng. 2012;02(05). doi:10.4172/2165-7866.1000112.
Handayani PW, Hidayanto AN, Pinem AA, Sandhyaduhita PI, Budi I. Hospital information system user acceptance factors: User group perspectives. Informatics Heal Soc Care. 2018;43(1):84-107. doi:10.1080/17538157.2016.1269109.
Perneger TV, Courvoisier DS, Hudelson PM, Gayet-Ageron A. Sample size for pre-tests of questionnaires. Qual Life Res. 2015;24(1):147–51.
Taber KS. The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Res Sci Educ. 2018;48(6):1273–96.
Ismail NI, Abdullah NH. Implementation and acceptance of hospital information system. 1st FPTP Postgrad Semin 2013. Published online 2013:1-5.
Ministry of Health Malaysia. Ministry of Health Malaysia Annual Report 2019.; 2020.
Ministry of Health Malaysia. Ministry of Health Malaysia Annual Report 2017.; 2018.
Ministry of Health Malaysia. Ministry of Health Malaysia Annual Report 2015.; 2016.
Ministry of Health Malaysia. Ministry of Health Malaysia Annual Report 2014.; 2015.
Ministry of Health Malaysia. Ministry of Health Malaysia Annual Report 2016.; 2017.
Al-Mujaini A, Al-Farsi Y, Al-Maniri A, Ganesh A. Satisfaction and perceived quality of an electronic medical record system in a tertiary hospital in Oman. Oman Med J. 2011;26(5):324-328. doi:10.5001/omj.2011.81.
Palm JM, Colombet I, Sicotte C, Degoulet P. Determinants of user satisfaction with a Clinical Information System. AMIA 2006 Symp Proc. Published online 2006:614-618.
Khairat S, Coleman C, Ottmar P, Bice T, Koppel R, Carson SS. Physicians’ gender and their use of electronic health records: findings from a mixed-methods usability study. J Am Med Informatics Assoc. 2019;26(12):1505-1514. doi:10.1093/jamia/ocz126.
Tubaishat A. Perceived usefulness and perceived ease of use of electronic health records among nurses: Application of Technology Acceptance Model. Informatics Heal Soc Care. 2018;43(4):379-389. doi:10.1080/17538157.2017.1363761.
Gagnon MP, Ghandour EK, Talla PK, et al. Electronic health record acceptance by physicians: Testing an integrated theoretical model. J Biomed Inform. 2014;48:17-27. doi:10.1016/j.jbi.2013.10.010.
Merchant K. How men and women differ: Gender differences in communication styles, influence tactics, and leadership styles. Published online 2012. http://scholarship.claremont.edu/cmc_theses/513/.
Reigstad A. Gender differences in communication styles and their influence on workplace communication and the practice of public relations in the United States. Published online 2020.
Cinardo J. Male and Female Differences in Communicating Conflict. Published online 2011. https://digitalcommons.coastal.edu/honors-theses/88.
Kirshner M, Salomon H, Chin H. An evaluation of one-on-one advanced proficiency training in clinicians’ use of computer information systems. Int J Med Inform. 2004;73(4):341-348. doi:10.1016/j.ijmedinf.2003.11.001.
Omune OG, Kandiri JM. Hospital Information Systems Capability and End-User Satisfaction in Hospitals of Nairobi County, Kenya. Int Acad J Inf Syst Technol. 2018;2(1):102-125. http://www.iajournals.org/articles/iajist_v2_i1_102_125.pdf.
Adler KG, Shields J, Edsall RL. EHR satisfaction: User characteristics matter. Fam Pract Manag. 2010;(July/August 2010):22-25. http://www.aafp.org/fpm/2010/0700/p22.
Khalifa M, Alswailem O. Hospital information systems (HIS) acceptance and satisfaction: A case study of a Tertiary Care Hospital. Procedia Comput Sci. 2015;63(Icth):198-204. doi:10.1016/j.procs.2015.08.334.
Sayyah Gilani M, Iranmanesh M, Nikbin D, Zailani S. EMR continuance usage intention of healthcare professionals. Informatics Heal Soc Care. 2017;42(2):153-165. doi:10.3109/17538157.2016.1160245.
Kalankesh LR, Nasiry Z, Fein R, Damanabi S. Factors Influencing User Satisfaction with Information Systems: A Systematic Review. Galen Med J. 2020;9(June):1686. doi:10.31661/gmj.v9i0.1686.
Weigel FK, Hazen BT. Technical proficiency for IS Success. Comput Human Behav. 2014;31(1):27-36. doi:10.1016/j.chb.2013.10.014.
Mahmood Al-Hasson MA. Clinical Information System: Measuring End-user Satisfaction in a Government Hospital in Qatar. Published online 2020.
Adam Mahmood M, Burn JM, Gemoets LA, Jacquez C. Variables affecting information technology end-user satisfaction: a meta-analysis of the empirical literature. Int J Hum Comput Stud. 2000;52(4):751-771. doi:10.1006/ijhc.1999.0353.
Menachemi N, Powers TL, Brooks RG. The role of information technology usage in physician practice satisfaction. Health Care Manage Rev. 2009;34(4):364-371. doi:10.1097/HMR.0b013e3181a90d53.
Wright E, Marvel J. Electronic health records: Postadoption physician satisfaction and continued use. Health Care Manag (Frederick). 2012;31(3):259-267. doi:10.1097/HCM.0b013e3182619e90.
Tilahun B, Fritz F. Comprehensive Evaluation of Electronic Medical Record System Use and User Satisfaction at Five Low-Resource Setting Hospitals in Ethiopia. JMIR Med Informatics. 2015;3(2):e22. doi:10.2196/medinform.4106.
Ayatollahi H, Langarizadeh M, Chenani H. Confirmation of expectations and satisfaction with hospital information systems: A nursing perspective. Healthc Inform Res. 2016;22(4):326-332. doi:10.4258/hir.2016.22.4.326.
Unni P, Staes C, Weeks H, et al. Why aren’t they happy? An analysis of end-user satisfaction with Electronic health records. AMIA Annu Symp Proc. Published online 2016:2026-2035.
Elhorr S. The three dimensional relation between user system experience, user satisfaction, and user acceptance. Published online 2016.
Jung S-R. The Perceived Benefits of Healthcare Information Technology Adoption: Construct and Survey Development. Published online 2006. https://digitalcommons.lsu.edu/gradschool_theses/816.
Krousel-Wood M, McCoy AB, Ahia C, et al. Implementing electronic health records (EHRs): Health care provider perceptions before and after transition from a local basic EHR to a commercial comprehensive EHR. J Am Med Informatics Assoc. 2018;25(6):618-626. doi:10.1093/jamia/ocx094.
Razak FZA, Bakar AA, Abdullah WSW. Role of technical proficiency towards satisfaction: Study on government servant in Malaysia. J Phys Conf Ser. 2020;1529(5). doi:10.1088/1742-6596/1529/5/052092.
Alharthi H, Youssef A, Radwan S, Al-Muallim S, Zainab AT. Physician satisfaction with electronic medical records in a major Saudi Government hospital. J Taibah Univ Med Sci. 2014;9(3):213-218. doi:10.1016/j.jtumed.2014.01.004.
Chisolm DJ, Purnell TS, Cohen DM, McAlearney AS. Clinician perceptions of an electronic medical record during the first year of implementaton in emergency services. Pediatr Emerg Care. 2010;26(2):107-110. doi:10.1097/PEC.0b013e3181ce2f99.
Khajouei R, Abbasi R. Evaluating nurses’ satisfaction with two nursing information systems. CIN - Comput Informatics Nurs. 2017;35(6):307-314. doi:10.1097/CIN.0000000000000319.
Sangaran G, Jamil AT, Aniza I. Level of Satisfaction in Using the Hospital Information System. Malaysian J Public Heal Med 2010. 2014;14(1):29-38.
Batenburg R, Van Den Broek E. Pharmacy information systems: The experience and user satisfaction within a chain of Dutch pharmacies. Int J Electron Healthc. 2008;4(2):119-131. doi:10.1504/IJEH.2008.019788.
Williams DC, Warren RW, Ebeling M, Andrews AL, Teufel II RJ. Physician Use of Electronic Health Records: Survey Study Assessing Factors Associated With Provider Reported Satisfaction and Perceived Patient Impact. JMIR Med Informatics. 2019;7(2). doi:10.2196/10949.
Dokumen Parlimen. Mesyuarat Kedua, Penggal Ketiga Parlimen Keempat Belas 2020, 28 Julai 2020. Portal Rasm Parlim Malaysia. Published online 2020. https://www.parlimen.gov.my/files/jindex/pdf/JDR28072020.pdf.
Abdul Hamid NB. ICT Planning, Implementation and Procurement in Development Projects. Portal Rasm Kementeri Kesihat Malaysia. Published online 2018. https://www.moh.gov.my/moh/resources/Penerbitan/Rujukan/Seminar Health Facility/11._ICT_Planning,Implementation_Procurement_-_Dr_.Bizura_.pdf.
Jabatan Audit Negara Malaysia. Laporan Ketua Audit Negara 2014: Aktiviti Kementerian/Jabatan dan Pengurusan Syarikat Kerajaan Persekutuan Siri 2. Published online 2014:531-533. http://lib.perdana.org.my/PLF/GOVERNMENT PUBLICATION/Laporan Audit Negara/Laporan Audit Negara (roy)/Laporan Persekutuan 1999-2014/Laporan Ketua Audit Negara Persekutuan 2014/siri2/LKAN 2014 Siri 2 - Aktiviti Persekutuan.pdf.
Omar R. ICT@MOH. Portal Rasm Kementeri Kesihat Malaysia. 2014;(November). https://moh.gov.my/moh/resources/Penerbitan/Rujukan/Msyrt Peg ICT 2014/13-ICT%2540MOH_vRO_versi_edit.pdf.
Shaik Allaudin F. AeHIN Webinar 30 March 2016 NATIONAL eHEALTH: “Malaysia Update.” Asia eHealth Inf Netw. 2016;(March). https://aehin.hingx.org/Share/Attachment/3739?fileName=AeHIN Webinar March2016_Msia Update.pdf.
Bahagian Pembangunan Kesihatan Keluarga. Lokasi Sistem TPC (Teleprimary Care). Laman Web Rasmi Bahagian Pembangunan Kesihatan Keluarga Kementerian Kesihatan Malaysia. Published 2019. http://fh.moh.gov.my/v3/index.php/sistem-tpc/lokasi-tpc.
Ismail NI, Abdullah NH. Malaysia health information exchange: A systematic review. Bus Econ Horizons. 2017;13(5):706-721. doi:10.15208/beh.2017.47.
Pejabat Kesihatan Wilayah Persekutuan Putrajaya. Enhancing Patients ’ Experience in Maternal and Child Health Clinic. Malaysia Productivity Corporation Official Website. Published 2016. http://www.mpc.gov.my/wp-content/uploads/2016/04/Pejabat-Kesihatan-Wilayah-Persekutuan-Putrajaya-Enhancing-patients-experience-in-maternal-and-child-health-clinic.pdf.
Bahagian Pembangunan Kesihatan Keluarga. Pengenalan Sistem TPC-OHCIS. Laman Web Rasmi Bahagian Pembangunan Kesihatan Keluarga Kementerian Kesihatan Malaysia. Published 2019. http://fh.moh.gov.my/v3/index.php/sistem-tpc-ohcis/sistem-tpc-ohcis
Tarhan AK, Garousi V, Turetken O, Söylemez M, Garossi S. Maturity assessment and maturity models in health care: A multivocal literature review. Digit Heal. 2020;6(Jan-Dec 2020):1-17. doi:10.1177/2055207620914772
Gomes J, Romão M. Information System Maturity Models in Healthcare. J Med Syst. 2018;42(235):1-14. doi:10.1007/s10916-018-1097-0
HIMSS Analytics. Electronic Medical Record Adoption Model (EMRAM). Healthcare Information and Management Systems Society (HIMSS) Website. Published 2021. https://www.himss.org/sites/hde/files/media/file/2021/06/04/himss-emram-criteria.pdf.
HIMSS Analytics. HIMSS Analytics Electronic Medical Record Adoption Model (EMRAM). Healthcare Information and Management Systems Society (HIMSS) Website. Published 2021. https://www.himss.org/what-we-do-solutions/digital-health-transformation/maturity-models/electronic-medical-record-adoption-model-emram.
HIMSS Analytics. HIMSS Analytics Continuity of Care Maturity Model (CCMM). Healthcare Information and Management Systems Society (HIMSS) Website.
HIMSS Analytics. Continuity of Care Maturity Model (CCMM). Healthcare Information and Management Systems Society (HIMSS) Website. Published 2021. https://www.himss.org/what-we-do-solutions/digital-health-transformation/maturity-models/continuity-care-maturity-model-ccmm.
Hoonakker PLT, Carayon P, Brown RL, Cartmill RS, Wetterneck TB, Walker JM. Changes in end-user satisfaction with computerised provider order entry over time among nurses and providers in intensive care units. J Am Med Informatics Assoc. 2013;20(2):252-259. doi:10.1136/amiajnl-2012-001114.
Vaezi R, Mills A, Chin W. User satisfaction with information systems: A comprehensive model of attribute-level satisfaction. Commun Assoc Inf Syst. 2019;45(1):165-206. doi:10.17705/1CAIS.04513.
