Reliability and Concurrent Validity of the Situational Judgement Test for Evaluation of Strategic Thinking

Main Article Content

Nanta Sooraksa

Abstract

This research aims to study reliability and concurrent validity of the situational judgement test for evaluation of employees’ strategic thinking. The research employed a quantitative method of data collection through situational judgement questionnaires with 540 responders comprised 255 managers and 285 employees in an automotive industry company. The findings revealed that 1) The test-retest results were positively correlated (r=0.945) deriving from a group of 64 responders in the pilot study. The retest was conducted in the period of 2 weeks apart from the test. This indicated that this test was consistent, stable, and highly reliable. 2) In studying the concurrent validity, there were significantly different of strategically thinking situational judgement test scores between managers and employees. Managers had a significantly higher strategic thinking than employees in each aspect and overall, at the 0.1 significant level. 3) Establishing a norm of scores test with using the Stanine Norm from 540 employees, the norm was able to classify the test scores into 3 groups: low, medium, and high strategic thinking groups. The findings indicated that this situational judgement test of strategic thinking can be applied to human resource management such as recruitment of employees and selection of employees and successors.

Article Details

Section
Research Articles

References

พิชิต ฤทธิ์จรูญ. (2551). ระเบียบวิธีการวิจัยทางสังคมศาสตร์ (พิมพ์ครั้งที่ 4). เฮ้าส์ ออฟ เคอร์มีสท์.

ภูมิ พระรักษา วนิดา สิมพล และ ศิริเดช สุชีวะ (2562). ทักษะการดำรงชีวิตและการทำงานของนักเรียนประถมศึกษา: การพัฒนาโมเดลและแบบวัดออนไลน์. วารสารครุศาสตร์ จุฬาลงกรณ์มหาวิทยาลัย, 47(1), 337-357.

ล้วน สายยศ และอังคณา สายยศ. (2543). เทคนิคการวิจัยทางการศึกษา (พิมพ์ครั้งที่ 3). สำนักพิมพ์สุวีริยาสาส์น

อิทธิศักดิ์ วรกิจ (2563). ความสัมพันธ์และรูปแบบระบบอุปถัมภ์ในการเมืองท้องถิ่น: กรณีศึกษาขององค์กรปกครองส่วนท้องถิ่น จังหวัดอ่างทอง. วารสารการวิจัยการบริหารการพัฒนา, 10(4), 156-172.

Arthur, W., & Villado, A. J. (2008). The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice. Journal of Applied Psychology, 93(2), 435-442. https://doi.org/10.1037 /0021-9010.93.2.435

Casey, A. J., & Goldman, E. F. (2010). Enhancing the ability to think strategically: A learning model. Management Learning, 41(2), 167-185. https://doi.org/10.1177 /1350507609355497

Christian, M. S., Edwards, B. D., & Bradley, J. C. (2010). Situational judgment tests: Constructs assessed and a meta-analysis of their criterion-related validities. Personnel Psychology, 63(1), 83–117. https://doi.org/10.1111/j.1744-6570.2009.01163.x

Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98-104. https://doi.org/10.1037/0021-9010.78.1.98

Corstjen, H. W. Pulakos, E. D., Semedo, C., & Passmore, J. (2017). The Wiley Blackwell handbook of recruitment, selection and employee retention: Situational judgement tests for selection. Wiley-Blackwell.

Dhir, S., Dhir, S., & Samanta, P. (2018). Defining and developing a scale to measure strategic thinking. Foresight, 20(3), 271-288. https://doi.org/10.1108/FS-10-2017-0059

Ebel, R. L. (1991). Essentials of Educational Measurement. Prentice Hall.

Goldman, E. F. (2012). Leadership practices that encourage strategic thinking. Journal of Strategy and Management, 5(1), 25-40. https://doi.org/10.1108/17554251211200437

Holm, A. B. (2014). Institutional context and e-recruitment practices of Danish organizations. Employee Relations, 36(4), 432-455. https://doi.org/10.1108/ER-07-2013-0088

Krejcie, R. V., & Morgan, D. W. (1970). Determining sample size for research activities. Educational and Psychological Measurement, 30, 607-610.

Lievens, F., & Motowidlo. (2015). Situational Judgment Tests: From Measures of Situational Judgment to Measures of General Domain Knowledge. Industrial and Organizational Psychology, 9(1), 3-22. https://doi.org/10.1017/iop.2015.71

Lievens, F., & Patterson, F. (2011). The validity and incremental validity of knowledge tests, low-fidelity simulations and high-fidelity simulations for predicting job in performance advanced-level high-stakes selection. Journal of Applied Psychology, 96(5), 927–940. http://dx.doi.org/10.1037/a0023496

Lievens, F., & Sackett, P. R. (2011). The validity of interpersonal skills assessment via situational judgment tests for predicting academic success and job performance. Journal of Applied Psychology, 97(2), 460-468. http://dx.doi.org /10.1037/a0025741

Martinet, A. C. (2010). Strategic planning, strategic management, strategic foresight: The seminal work of H. Igor Ansoff. Technological Forecasting and Social Change, 77(9), 1485-1487. https://doi.org/10.1016/j.techfore.2010.06.024

McDaniel, M. A., Hartman, N. S., Whetzel, D. L., & Grubb, W. L. III. (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60(1), 63–91. https://doi.org/10.1111/j.1744-6570.2007.00065.x

McDaniel, M. A., Morgeson, F., Bruhn-Finnegan, E., & Campion, M. A. (2001). Use of situational judgment tests to predict job performance: A clarification of the Literature. Journal of Applied Psychology, 86(4). 730-740. https://doi.org/10.1037/0021-9010.86.4.730

McDaniel, M. A., & Whetzel, D. L. (2005). Situational judgment test research: Informing the debate on practical intelligence theory. Intelligence, 33(5), 515–525. https://doi.org/10.1016/j.intell.2005.02.001

Moghaddam, A. Z., Amirkamali, F. (2013). Measuring the relative importance of strategic thinking dimensions in relation to counterproductive behavior. Management Science Letters, 3(1), 2831-2838. http://www.growingscience.com/msl/Vol3/msl_2013_300.pdf

Mondy, R. W., Noe, R. M., & Premeaux, S. R. (2002). Human resource management (8th Ed.). Prentice Hall.

Nuntamanop, P., Kauranen, I., & Igel, B. (2013). A new model of strategic thinking competency. Journal of Strategy and Management, 6(3), 242-264. https://doi.org/10.1108/JSMA-10-2012-0052

Olaniyi, I., & Lucas, E. (2010). Strategic thinking and organization performance: Study of Nigeria firms. Journal of Business Administration Research, 5(1), 23-28. https://doi.org/10.5430/jbar.v5n1p23

Oostrom, J. K., Born, M. Ph., Serlie, A. W., & van der Molen, H. (2012). Implicit trait policies in multimedia situational judgment tests for leadership skills: Can they predict leadership behavior? Human Performance, 25(4), 335–353. https://doi.org/10.1080/08959285.2012.703732

Patterson, F., Rowett, E., & Hale, R. (2016). The predictive validity of situational judgement test and multiple-mini interview for entry into postgraduate training in Australia. BMC Medical Education, 11(5), 142–169. https://doi.org/ 10.1186/s12909-016-0606-4

Potter, W. J. (2005). Becoming a strategic thinker: Developing skills for success. Pearson Education.

Rowe, A. J., Mason, R. O., & Dickel, K.E. (1986). Strategic management – A methodological approach. Addison-Wesley Publishing Company International.

Shaik, A. S., & Dhir, S. (2020). A meta-analytical review of factors affecting the strategic thinking of an organization. Foresight, 22(2), 144-177. https:doi.org/10.1108/FS-08-2019-0076

Smith, K. J., Flaxman, C., Farland, M. Z., Thomas, A., Buring, S. M., Whalen, K., & Patterson, F. (2020) Development and validation of a situational judgement test to assess professionalism. American Journal of Pharmaceutical Education, 84 (7), ajpe7771. https://doi.org/10.5688/ajpe7771

Tavakoli, I., & Lawton, J. (2005). Strategic thinking and knowledge management. Handbook of Business Strategy, 6(1), 155-160.

Weekley, J. A., Ployhart, R. E., & Holtz, B. C. (2006). On the development of situational judgment tests: Issues in item development, scaling, and scoring. In J. A. Weekley & R. E. Ployhart (Eds.), SIOP organizational series. Situational judgment tests: Theory, measurement, and application (p. 157–182). Lawrence Erlbaum Associates Publishers.

การแปลงเอกสารอ้างอิงภาษาไทยเป็นภาษาอังกฤษ (Translated Thai References)

RitJaroon, P. (2008). Rabieb whi te kanwichai tang sangkhom sat [Social Science Research Methods] (4th ed.). House of Kermist.

Praraksa, P., Simphon, W., & Sucheewa, S. (2019). Thaksa kan damrong chiwit læ kanthamngan khong nakrian prathom sưksa: Kanphatthana mo de lo læ bæp wat onlai sat [The life and career skills of primary school students: A tentative model and an online scale]. Journal of Education Studies, 47(1), 337-357.

Saiyot, L., & Saiyot, A. (2000). Technic kanwichai tang kan suksa [Techniques of educational research] (3rd edition). Suveiriyasat Publishing.

Worakij, I. (2020). Khwamsamphan læ rupbæp rabop uppatham nai kanmưang thongthin: Korani sưksa khong ongkon pokkhrong suan thongthin changwat Ang Thong [Relationship and pattern of patronage system in local administrative organizations: A case study of local administrative organizations Ang-Thong province]. The Journal of Development Administration Research. 10(4), 156-172.