Reliability and Concurrent Validity of the Situational Judgement Test for Evaluation of Strategic Thinking
Article Sidebar
Main Article Content
Abstract
This research aims to study reliability and concurrent validity of the situational judgement test for evaluation of employees’ strategic thinking. The research employed a quantitative method of data collection through situational judgement questionnaires with 540 responders comprised 255 managers and 285 employees in an automotive industry company. The findings revealed that 1) The test-retest results were positively correlated (r=0.945) deriving from a group of 64 responders in the pilot study. The retest was conducted in the period of 2 weeks apart from the test. This indicated that this test was consistent, stable, and highly reliable. 2) In studying the concurrent validity, there were significantly different of strategically thinking situational judgement test scores between managers and employees. Managers had a significantly higher strategic thinking than employees in each aspect and overall, at the 0.1 significant level. 3) Establishing a norm of scores test with using the Stanine Norm from 540 employees, the norm was able to classify the test scores into 3 groups: low, medium, and high strategic thinking groups. The findings indicated that this situational judgement test of strategic thinking can be applied to human resource management such as recruitment of employees and selection of employees and successors.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
1) The content of article in HROD journal is the author’s wholly responsibility to research, analyze, summarize, compile, and reference data. The editorial department will not be responsible in anyway.
2) The submitted articles in HROD journal must be unpublished before and must not be currently under consideration for publication elsewhere. If it is detected for its repetition, the author must be responsible for infringement of copyright.
3) Authors will be asked to transfer copyright of the article to the Publisher. The article is prohibited to reproduce all or part of the text, unless allowed.
References
พิชิต ฤทธิ์จรูญ. (2551). ระเบียบวิธีการวิจัยทางสังคมศาสตร์ (พิมพ์ครั้งที่ 4). เฮ้าส์ ออฟ เคอร์มีสท์.
ภูมิ พระรักษา วนิดา สิมพล และ ศิริเดช สุชีวะ (2562). ทักษะการดำรงชีวิตและการทำงานของนักเรียนประถมศึกษา: การพัฒนาโมเดลและแบบวัดออนไลน์. วารสารครุศาสตร์ จุฬาลงกรณ์มหาวิทยาลัย, 47(1), 337-357.
ล้วน สายยศ และอังคณา สายยศ. (2543). เทคนิคการวิจัยทางการศึกษา (พิมพ์ครั้งที่ 3). สำนักพิมพ์สุวีริยาสาส์น
อิทธิศักดิ์ วรกิจ (2563). ความสัมพันธ์และรูปแบบระบบอุปถัมภ์ในการเมืองท้องถิ่น: กรณีศึกษาขององค์กรปกครองส่วนท้องถิ่น จังหวัดอ่างทอง. วารสารการวิจัยการบริหารการพัฒนา, 10(4), 156-172.
Arthur, W., & Villado, A. J. (2008). The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice. Journal of Applied Psychology, 93(2), 435-442. https://doi.org/10.1037 /0021-9010.93.2.435
Casey, A. J., & Goldman, E. F. (2010). Enhancing the ability to think strategically: A learning model. Management Learning, 41(2), 167-185. https://doi.org/10.1177 /1350507609355497
Christian, M. S., Edwards, B. D., & Bradley, J. C. (2010). Situational judgment tests: Constructs assessed and a meta-analysis of their criterion-related validities. Personnel Psychology, 63(1), 83–117. https://doi.org/10.1111/j.1744-6570.2009.01163.x
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98-104. https://doi.org/10.1037/0021-9010.78.1.98
Corstjen, H. W. Pulakos, E. D., Semedo, C., & Passmore, J. (2017). The Wiley Blackwell handbook of recruitment, selection and employee retention: Situational judgement tests for selection. Wiley-Blackwell.
Dhir, S., Dhir, S., & Samanta, P. (2018). Defining and developing a scale to measure strategic thinking. Foresight, 20(3), 271-288. https://doi.org/10.1108/FS-10-2017-0059
Ebel, R. L. (1991). Essentials of Educational Measurement. Prentice Hall.
Goldman, E. F. (2012). Leadership practices that encourage strategic thinking. Journal of Strategy and Management, 5(1), 25-40. https://doi.org/10.1108/17554251211200437
Holm, A. B. (2014). Institutional context and e-recruitment practices of Danish organizations. Employee Relations, 36(4), 432-455. https://doi.org/10.1108/ER-07-2013-0088
Krejcie, R. V., & Morgan, D. W. (1970). Determining sample size for research activities. Educational and Psychological Measurement, 30, 607-610.
Lievens, F., & Motowidlo. (2015). Situational Judgment Tests: From Measures of Situational Judgment to Measures of General Domain Knowledge. Industrial and Organizational Psychology, 9(1), 3-22. https://doi.org/10.1017/iop.2015.71
Lievens, F., & Patterson, F. (2011). The validity and incremental validity of knowledge tests, low-fidelity simulations and high-fidelity simulations for predicting job in performance advanced-level high-stakes selection. Journal of Applied Psychology, 96(5), 927–940. http://dx.doi.org/10.1037/a0023496
Lievens, F., & Sackett, P. R. (2011). The validity of interpersonal skills assessment via situational judgment tests for predicting academic success and job performance. Journal of Applied Psychology, 97(2), 460-468. http://dx.doi.org /10.1037/a0025741
Martinet, A. C. (2010). Strategic planning, strategic management, strategic foresight: The seminal work of H. Igor Ansoff. Technological Forecasting and Social Change, 77(9), 1485-1487. https://doi.org/10.1016/j.techfore.2010.06.024
McDaniel, M. A., Hartman, N. S., Whetzel, D. L., & Grubb, W. L. III. (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60(1), 63–91. https://doi.org/10.1111/j.1744-6570.2007.00065.x
McDaniel, M. A., Morgeson, F., Bruhn-Finnegan, E., & Campion, M. A. (2001). Use of situational judgment tests to predict job performance: A clarification of the Literature. Journal of Applied Psychology, 86(4). 730-740. https://doi.org/10.1037/0021-9010.86.4.730
McDaniel, M. A., & Whetzel, D. L. (2005). Situational judgment test research: Informing the debate on practical intelligence theory. Intelligence, 33(5), 515–525. https://doi.org/10.1016/j.intell.2005.02.001
Moghaddam, A. Z., Amirkamali, F. (2013). Measuring the relative importance of strategic thinking dimensions in relation to counterproductive behavior. Management Science Letters, 3(1), 2831-2838. http://www.growingscience.com/msl/Vol3/msl_2013_300.pdf
Mondy, R. W., Noe, R. M., & Premeaux, S. R. (2002). Human resource management (8th Ed.). Prentice Hall.
Nuntamanop, P., Kauranen, I., & Igel, B. (2013). A new model of strategic thinking competency. Journal of Strategy and Management, 6(3), 242-264. https://doi.org/10.1108/JSMA-10-2012-0052
Olaniyi, I., & Lucas, E. (2010). Strategic thinking and organization performance: Study of Nigeria firms. Journal of Business Administration Research, 5(1), 23-28. https://doi.org/10.5430/jbar.v5n1p23
Oostrom, J. K., Born, M. Ph., Serlie, A. W., & van der Molen, H. (2012). Implicit trait policies in multimedia situational judgment tests for leadership skills: Can they predict leadership behavior? Human Performance, 25(4), 335–353. https://doi.org/10.1080/08959285.2012.703732
Patterson, F., Rowett, E., & Hale, R. (2016). The predictive validity of situational judgement test and multiple-mini interview for entry into postgraduate training in Australia. BMC Medical Education, 11(5), 142–169. https://doi.org/ 10.1186/s12909-016-0606-4
Potter, W. J. (2005). Becoming a strategic thinker: Developing skills for success. Pearson Education.
Rowe, A. J., Mason, R. O., & Dickel, K.E. (1986). Strategic management – A methodological approach. Addison-Wesley Publishing Company International.
Shaik, A. S., & Dhir, S. (2020). A meta-analytical review of factors affecting the strategic thinking of an organization. Foresight, 22(2), 144-177. https:doi.org/10.1108/FS-08-2019-0076
Smith, K. J., Flaxman, C., Farland, M. Z., Thomas, A., Buring, S. M., Whalen, K., & Patterson, F. (2020) Development and validation of a situational judgement test to assess professionalism. American Journal of Pharmaceutical Education, 84 (7), ajpe7771. https://doi.org/10.5688/ajpe7771
Tavakoli, I., & Lawton, J. (2005). Strategic thinking and knowledge management. Handbook of Business Strategy, 6(1), 155-160.
Weekley, J. A., Ployhart, R. E., & Holtz, B. C. (2006). On the development of situational judgment tests: Issues in item development, scaling, and scoring. In J. A. Weekley & R. E. Ployhart (Eds.), SIOP organizational series. Situational judgment tests: Theory, measurement, and application (p. 157–182). Lawrence Erlbaum Associates Publishers.
การแปลงเอกสารอ้างอิงภาษาไทยเป็นภาษาอังกฤษ (Translated Thai References)
RitJaroon, P. (2008). Rabieb whi te kanwichai tang sangkhom sat [Social Science Research Methods] (4th ed.). House of Kermist.
Praraksa, P., Simphon, W., & Sucheewa, S. (2019). Thaksa kan damrong chiwit læ kanthamngan khong nakrian prathom sưksa: Kanphatthana mo de lo læ bæp wat onlai sat [The life and career skills of primary school students: A tentative model and an online scale]. Journal of Education Studies, 47(1), 337-357.
Saiyot, L., & Saiyot, A. (2000). Technic kanwichai tang kan suksa [Techniques of educational research] (3rd edition). Suveiriyasat Publishing.
Worakij, I. (2020). Khwamsamphan læ rupbæp rabop uppatham nai kanmưang thongthin: Korani sưksa khong ongkon pokkhrong suan thongthin changwat Ang Thong [Relationship and pattern of patronage system in local administrative organizations: A case study of local administrative organizations Ang-Thong province]. The Journal of Development Administration Research. 10(4), 156-172.