The Development and Psychometric Validation of a Peer-Assessment Instrument for the 15 Military Leadership Attributes During Field Training of Cadets at Chulachomklao Royal Military Academy
Keywords:
Military Leadership Attributes, Field Training, Behavioral Assessment, Chulachomklao Royal Military Academy, Peer AssessmentAbstract
This research aimed to develop and validate a behavioral peer-assessment instrument for the 15 military leadership attributes of cadets during field training at Chulachomklao Royal Military Academy (CRMA). A Research and Development (R&D) methodology was employed across four phases. Phase 1 involved item generation through focus group discussions with 40 cadets. Phase 2 examined content validity using the Item-Objective Congruence Index (IOC) with five subject-matter experts. Internal consistency (Cronbach's Alpha) was assessed with 35 cadets. Phase 3 applied the Delphi technique for selecting contextually appropriate dimensions, which were subsequently piloted with 60 cadets per year group across four year groups. Phase 4 evaluated instrument quality through structured user feedback from 325 cadets. The results demonstrated that all 15 items achieved acceptable content validity and high internal consistency (α = 0.91). Expert consensus identified six dimensions as most appropriate for field training assessment: Dependability, Endurance, Enthusiasm, Loyalty, Tact, and Unselfishness. The six-item instrument yielded acceptable-to-excellent reliability across all year groups (α = 0.72–0.92) and strong inter-rater agreement (ICC = 0.77–0.99). Overall instrument quality as evaluated by end-users was rated at the highest level (M = 4.33, SD = 0.24) on a five-point Likert scale, confirming the instrument's suitability for assessing military leadership attributes in field training contexts and its potential for broader application across military educational institutions under the Ministry of Defence.
References
กรมนักเรียนนายร้อยรักษาพระองค์ โรงเรียนนายร้อยพระจุลจอมเกล้า. (2568). คู่มือนักเรียนนายร้อย พ.ศ. 2568. อรุณการพิมพ์.
กรมยุทธศึกษาทหารบก. (2565). คู่มือการปลูกฝังและพัฒนาคุณลักษณะผู้นำทางทหาร. กองทัพบก.
บุญชม ศรีสะอาด. (2560). การวิจัยเบื้องต้น (พิมพ์ครั้งที่ 10). สุวีริยาสาส์น.
รัตนะ บัวสนธ์. (2564). การวิจัยและพัฒนานวัตกรรมการศึกษา (พิมพ์ครั้งที่ 5). สำนักพิมพ์แห่งจุฬาลงกรณ์มหาวิทยาลัย.
รุ่งอรุณ วัฒยากร. (2565). คุณลักษณะผู้นำที่พึงประสงค์ของนักเรียนนายร้อย โรงเรียนนายร้อยพระจุลจอมเกล้า. วารสารวิชาการมนุษยศาสตร์และสังคมศาสตร์ โรงเรียนนายร้อยพระจุลจอมเกล้า, 9(1), 95-109.
โรงเรียนนายร้อยพระจุลจอมเกล้า. (2566). หลักสูตรโรงเรียนนายร้อยพระจุลจอมเกล้า พุทธศักราช 2566.
โรงเรียนนายร้อยพระจุลจอมเกล้า.
Boud, D., Ajjawi, R., Dawson, P., & Tai, J. (Eds.). (2018). Developing evaluative judgement in higher education: Assessment for knowing and producing quality work. Routledge.
Double, K. S., McGrane, J. A., & Hopfenbeck, T. N. (2020). The impact of peer assessment on academic performance: A meta-analysis of control group studies. Educational Psychology Review, 32(2), 481–509. https://doi.org/10.1007/s10648-019-09510-3
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2018). Multivariate data analysis (8th ed.). Cengage Learning.
Johanson, G. A., & Brooks, G. P. (2010). Initial scale development: Sample size for pilot studies. Educational and Psychological Measurement, 70(3), 394–400. https://doi.org/10.1177/0013164409355692
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Krejcie, R. V., & Morgan, D. W. (1970). Determining sample size for research activities. Educational and Psychological Measurement, 30(3), 607–610. https://doi.org/10.1177/001316447003000308
Lacerenza, C. N., Reyes, D. L., Marlow, S. L., Joseph, D. L., & Salas, E. (2017). Leadership training design, delivery, and implementation: A meta-analysis. Journal of Applied Psychology, 102(12), 1686–1718. https://doi.org/10.1037/apl0000241
Li, H., Xiong, Y., Zang, X., Kornhaber, M. L., Lyu, Y., Chung, K. S., & Suen, H. K. (2016). Peer assessment in the digital age: A meta-analysis comparing peer and teacher ratings. Assessment & Evaluation in Higher Education, 41(2), 245–264. https://doi.org/10.1080/02602938.2014.999746
McKenney, S., & Reeves, T. C. (2019). Conducting educational design research (2nd ed.). Routledge.
Nasa, P., Jain, R., & Juneja, D. (2021). Delphi methodology in healthcare research: How to decide its appropriateness. World Journal of Methodology, 11(4), 116–129. https://doi.org/10.5662/wjm.v11.i4.116
Northouse, P. G. (2021). Leadership: Theory and practice (9th ed.). SAGE Publications.
Panadero, E., & Alqassab, M. (2019). An empirical review of anonymity effects in peer assessment, peer feedback, peer review, peer evaluation and peer grading. Assessment & Evaluation in Higher Education, 44(8), 1253–1278. https://doi.org/10.1080/02602938.2019.1600186
Panadero, E., Alqassab, M., Fernández-Ruiz, J., & Ocampo, J. C. G. (2023). A systematic review on peer assessment: Intrapersonal and interpersonal factors. Assessment & Evaluation in Higher Education, 48(8), 1053–1075. https://doi.org/10.1080/02602938.2023.2164884
Schleicher, D. J., Baumann, H. M., Sullivan, D. W., & Yim, J. (2019). Evaluating the effectiveness of performance management: A 30-year integrative conceptual review. Journal of Applied Psychology, 104(7), 851–887. https://doi.org/10.1037/apl0000368
Taber, K. S. (2018). The use of Cronbach's alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
U.S. Department of the Army. (2019). Army leadership and the profession (Army Doctrine Publication
No. 6-22). Headquarters, Department of the Army.
Yusoff, M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6
Downloads
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2026 CRMA Journal of Humanities and Social Sciences
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The content and information in this journal shall be considered as the individual opinions of the authors. In all cases, the editorial board may not necessarily agree with these opinions or be responsible for them.
The articles and information that are published in the journal are considered to be the copyright of the journal. Any party who wishes to re-publish the journal’s articles must seek permission from the journal’s editor. Articles that receive the agreement for publications must not appear in any other publications prior to their appearance in this journal. The editorial board will send one copy of the journal to each author whose submission was accepted and published.
