VALIDITY AND INTER-RATER RELIABILITY OF POSTURAL ANALYSIS AMONG NEW RATERS
Work posture analysis is crucial in observing and reducing work-related musculoskeletal symptoms in the workplace. However, in a developing country, new raters are commonly assigned to conduct postural analysis to save on cost. This study aims to observe the validity and inter-rater reliability (defined as the degree of agreement among different raters) among new raters of three different commonly used work posture analysis methods: Rapid Upper Limb Assessment (RULA), Rapid Entire Body Assessment (REBA), and Ovako Workload Assessment System (OWAS). Fifty industrial engineering students, divided into five groups, who received prior training about the use of the methods, participated voluntarily in this study by observing ten different working postures in five different industries: the tofu, military equipment manufacturing, automotive maintenance and service, cracker, and milk-processing industries. One ergonomics expert also observed the working postures. Validity was observed based on the correlation between new raters’ ratings and the rating of the ergonomics expert. Inter-rater reliability within one group was calculated using the percentage of agreement and kappa value. The result shows high validity of RULA, REBA, and OWAS among new raters. There are insignificant differences in the inter-rater reliability of new raters among RULA, REBA, and OWAS. The implications of the result are discussed.
2. Karwowski W, Marras WS. Occupational ergonomics: principles of work design. Boca Raton, FL, 2003.
3. Yelin EH. Cost of musculoskeletal diseases: impact of work disability and functional decline. J Rheumato 2003; 30: 8-11.
4. Buckle PW, Devereux JJ. The nature of work-related neck and upper limb musculoskeletal disorders. Appl Ergon 2003; 33: 207-217.
5. Kee D, Karwowski W. A comparison of three observational techniques for assessing postural loads in industry. Int J Occup Saf Ergo 2007; 13: 3-14.
6. Phedy P, Gatam L. Prevalence and Associated Factors of Musculoskeletal Disorders among Young Dentists in Indonesia. Malays Orthop J 2016; 10: 1-5.
7. Widyanti A. Ergonomic Checkpoint in Agriculture, Postural Analysis, and Prevalence of Work Musculoskeletal Symptoms among Indonesian Farmers: Road to Safety and Health in Agriculture. Jurnal Teknik Industri 2018; 20: 1- 10.
8. Muslim K, Nussbaum MA. Musculoskeletal symptoms associated with posterior load carriage: An assessment of manual material handling workers in Indonesia. Work 2015; 51: 205-213.
9. Widanarko B, Leg S, Devereux J, et al. Interaction between physical and psychosocial work risk factors for low back symptoms and its consequences amongst Indonesian coal mining workers. App Ergon 2016; 46: 158–167.
10. Juul-Kristensen B, Falletin N, Hansson GA, et al. Physical workload during manual and mechanical deboning of poultry. Int J Ind Ergon 2002; 29: 107–115.
11. Punnett L, Fine LJ, Keyserling WM, et al. Shoulder symptoms and postural stress in automobile assembly work. Scand J Work Environ Health 2002; 26: 283–291.
12. Silverstein BA, Viikari-Juntura E, Fan ZJ, et al. Natural course of nontraumatic rotator cuff tendinitis and shoulder symptoms in a working population. Scand J Work Environ Health 2006; 32: 99–108.
13. Cole DC, Wells RP, Frazer MB, et al. Methodological issues in evaluating workplace interventions to reduce work related musculoskeletal disorders through mechanical exposure reduction. Scand. J Work Environ Health 2003; 29: 396-405.
14. Chiasson M, Imbeau D, Aubry K, Delisle A. Comparing the results of eight methods used to evaluate risk factors associated with musculoskeletal disorders. Int J Ind Ergon 2012; 42: 478-488.
15. Bao S, Howard N, Spielholz P, et al. Interrater Reliability of Posture Observations. Hum Factors 2009; 51: 292 – 309.
16. Hansson GA, Balogh I, Bystrom JU, et al. Questionnaire versus direct technical measurements in assessing postures and movements of the head, upper back, arms and hands. Scand J Work Environ Health 2001; 27: 30–40.
17. Choppin S, Wheat J. The potential of the Microsoft Kinect in sports analysis and biomechanics. Sports Technology 2013; 6: 78-85.
18. Balogh I, Orbaek P, Winkel J, et al. Questionnaire-based mechanical exposure indices for large population studies: Reliability, internal consistency and predictive validity. Scand J Work Environ Health 2001; 27: 41–48.
19. Kourinka I, Jonsson B, Kilbom A, et al. Standardised Nordic Ques¬tion¬nair¬es for the Analysis of Musculoskeletal Symptoms. Appl Ergon 1987; 18: 233-237.
20. Hignett S, McAtamney L. Rapid Entire Body Assessment. Appl Ergon 2000; 31: 201-205.
21. Takala EP, Pehkonen I, Forsman M, et al. Systematic evaluation of observational methods assessing biomechanical exposures at work. Scand J Work Environ Health 2010; 36: 3-24.
22. David GC. Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. Occup Med 2005; 55: 190-199.
23. Roman-Liu D. Comparison of concepts in easy-to-use methods for MSD risk assessment. Appl Ergon 2014; 45: 420-427.
24. Hallgree KA. Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. Tutor Quant Methods Psychol 2012; 8: 23–34.
25. Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. New York: Wiley 2003.
26. Karhu O, Kansi P, Kuorinka I. Correcting working postures in industry: a practical method for analysis. Appl Ergon 1997; 8: 199-201.
27. McAtamney L, Corlett EN. RULA: a survey method for the investigation of work-related upper limb symptoms. Appl Ergon 1993; 24: 91-99.
28. Gomez-Galan M, Perez-Alonso J, Callejon-Ferre A, Lopez-Martinez J. Musculoskeletal symptoms: OWAS review. Ind Health 2017; 55: 314-337.
29. Fleiss JL. Measuring nominal scale agreement among many raters. Psychological Bulletin 1971; 378-382.
30. Dockrell S, O’Grady E, Bennett K, et al. An investigation of the reliability of Rapid Upper Limb Assessment (RULA) as a method of assessment of children’s computing posture. Appl Ergon 2012; 43: 632-636.
31. Plantard P, Shum HPH, Le Pierres A, Multon F. Validation of an ergonomic assessment method using Kinect data in real workplace conditions. Appl Ergon 2017; 65: 562-569.
32. Levanon Y, Lerman Y, Gefen A, Ratzon NZ. Validity of the modified RULA for computer workers and reliability of one observation compared to six. Ergonomics 2014; 57: 1856-63.
33. Chen JD, Falkmer T, Parsons R, et al. Impact of experience when using the Rapid Upper Limb Assessment to assess postural risk in children using information and communication technologies. Appl Ergon 2014; 45: 398-405.
34. Widyanti A, Mahachandra M, Soetisna HR, Sutalaksana IZ. Anthropometry of Indonesian Sundanese children and the development of clothing size system for Indonesian Sundanese children aged 6-10 years. IJIE 2017; 61: 37-46.
35. Barriera-Viruet H, Sobeih TM, Daraiseh N, Salem S. Questionnaires vs observational and direct measurements: a systematic review. TIES 2006; 7: 261-284.