Development of Multi-stage Test Item Bank for Measuring Multidimensional Knowledge Competency of Vocational Technical Teacher Students

Article Sidebar

pdf
Published: Apr 9, 2020
Keywords:
Test Items Bank, Knoweledge Competency, Voctional Technical Teacher, Multidimensional Item Response Model

Main Article Content

Sukanya Boonsri
Ph.D. Student in Educational Measurement and Evaluation Department of Educational, Research and Psychology, Faculty of Education Chulalongkorn University
Kamonwan Tangdhanakanond
Associate Professor, Ph.D., Department of Educational Research and Psychology Faculty of Education, Chulalongkorn University
Sirichai Kanjanawasee
Professor, Ph.D., Department of Educational Research and Psychology Faculty of Education, Chulalongkorn University

Abstract

The research aimed to 1) develop and validate the quality of the multidimensional knowledge competency tests for vocational technical teachers, and 2) develop an multi-stage item pool for measuring the multidimensional knowledge competency for vocational technical teachers. The knowledge competency tests were used to collect data from 936 seniors in technical education program of the Rajamangala University. AIC and G2 statistics were employed to validate the model , OUTFIT MNSQ and INFIT MNSQ were also used to validate of items.


     The research findings were as follows: 1) The G2 value and the AIC of a multidimensional model of the four tests were smaller than the unidimensional model. The EAP reliability of the third tests was the highest, followed by the first, the second, and the fourth tests, respectively. The EAP reliability of the first dimension were .835, .797, .794, and .755, whereas the EAP reliability of the second dimension were .815, .807, .696, and .694, respectively. Three hundred and ninety seven test items had OUTFIT MNSQ and INFIT MNSQ within the criteria. 2) There were 234 items in the item pools for the first dimension. Among these numbers of items, there were 42, 148, and 44 items in the easy, moderate, and difficult modules, respectively. There were 163 items in the item pools for the second dimension. Among these numbers of items, there were 28, 107, and 28 items in the easy, moderate, and difficult modules, respectively.

Article Details

How to Cite
Boonsri, S. . ., Tangdhanakanond, K. ., & Kanjanawasee, S. . . (2020). Development of Multi-stage Test Item Bank for Measuring Multidimensional Knowledge Competency of Vocational Technical Teacher Students. Dusit Thani College Journal, 12(3), 600–615. Retrieved from https://so01.tci-thaijo.org/index.php/journaldtc/article/view/240991
Issue
Vol. 12 No. 3 (2018): Dusit Thani College Journal Vol.12 No.3 September-December 2018
Section
Research Article

Article Screening Policy

  1. All research and academic articles to be published must be considered and screened by three peer reviews in the relevant field / article.
  2. All articles, texts, illustrations and tables published in the journal are the personal opinions of the authors. Editors don't always have to agree. And no responsibility whatsoever is the sole responsibility of the author.
  3. The articles to be published must never be published. Where did you first publish? And not in the consideration of other journals If the audit found that there has been a duplicate publication It is the sole responsibility of the author.
  4. Any article that the reader sees as being plagiarized or impersonated without reference. Or mislead the work of the author Please let the journal editor know it will be your greatest blessing.

References

1. Arphaadul, A., Poolkrajang, A. & Siriphan, R. (2011). The vocational teachers’ professional standard. The Secretariat of The Teachers Council of Thailand: Thailand.
2. Briggs, D. C., and Wilson, M. (2003). An introduction to multidimensional measurement using Rasch models. Journal of Applied Measurement, 4(1), 87-100.
3. Brossman, B.G. and Guille, R.A. (2014). A comparison of multi-stage and linear test designs for medium-size licensure and certification examinations. Journal of Computerized Adaptive Testing, 2(2), 18-36.
4. Diep, P.C. & Hartmann, M. (2016). Green Skills in Vocational Teacher Education - a model of pedagogical competence for a world of sustainable development. In: TVET@Asia, issue 6, 1-19.
5. Hair, J.F., Black, W.C., Babin, B.J., Anderson, R.E., and Tatham, R.L. (2010). Multivariate Data Analysis. 7th ed. New Jersey: Pearson Education.
6. Kanjanawasee, S. (2012). Modern Test Theories. 4. Bangkok: Chulalongkron University Press.
7. Lunz, M., Wright, B. D., & Linacre, J. M. (1990). Measuring the impact of judge severity on examination scores. Applied Measurement in Education, 3, 331-345.
8. Nunnally, J.C., and Bernstein, I.H. (1994). Psychometric theory. 3rd ed. New York:
McGraw-Hill
9. Office of Vocational Education Commission. (2013). Vocational Certificate Curriculum 2013. Bangkok: Ministry of Education.
10. Oluwasola. A. J. (2014). Professional competence of technical teachers: A factor analysis of the training needs of technical college teachers. American Journal of Science and Technology. 2(1), 22-26.
11. Osera, F., Salzmannb, P., and Heinzerc, S. (2009). Measuring the competence-quality of vocational teachers: An advocatory approach. Empirical Research in Vocational Education and Training, 65-83.
12. Royal Gazette. (2013). Regulations of the Teachers Council on Professional Standards. Vol. 130. Special part 130.67.
13. Robertson, I. (2008). VET Teachers’ Knowledge and Expertise. International Journal of Training Research. 6(1), 1-22.
14. Thongnak, S. (2013). Development of a Competency Test for Student Teachers Based on Teaching Professional Standards Using Polytomously Scored Item. SDU Research Journal. 9(1), 169-187.
15. Wu, M., Adams, R., Wilson, M., & Haldane, S. (2007). ACER ConQuest version 2.0: Generalized item response modeling software [Computer software and manual]. Camberwell: ACER Press.
16. Zenisky, A., Hambleton, R.K., and Luecht, R.M. (2010). Multistage testing: issues, designs, and research. in W. J. van der Linden & C. A. W. Class (Eds.), Elements of adaptive testing (pp. 77-101). New York, NY: Springer.