|
Validity and Reliability Assessment of Cross-Culturally Adapted Bebras Test for Evaluating Computational Thinking in Junior High School Students |
|---|---|
| รหัสดีโอไอ | |
| Creator | Jarupa Kitcharoenpanya |
| Title | Validity and Reliability Assessment of Cross-Culturally Adapted Bebras Test for Evaluating Computational Thinking in Junior High School Students |
| Contributor | Pongprapan Pongsophon, Ekarat Tanak |
| Publisher | Centre for Education Innovation, Print and Online Media |
| Publication Year | 2568 |
| Journal Title | Journal of Education Studies, Chulalongkorn University |
| Journal Vol. | 53 |
| Journal No. | 3 |
| Page no. | JESCU5303001(16pages) |
| Keyword | computational thinking, cross-cultural adaptation, Rasch model, Bebras |
| URL Website | https://so02.tci-thaijo.org/index.php/EDUCU |
| Website title | Journal of Education Studies, Chulalongkorn University |
| ISSN | 3057-1642 (Online) |
| Abstract | This study aimed to examine the validity and reliability of the Bebras test, which was cross-culturally adapted and adjusted to fit the Thai context. Both Classical Test Theory (CTT) and Modern Test Theory (MTT) were employed to analyze the data. The sample comprised of 115 grade 9 students. The research instrument was the Bebras test, a standardized assessment developed by Vilnius University in Lithuania. Data analysis employed CTT, yielding an average difficulty index of 0.57 and an average discrimination index of 0.42. Additionally, the Rasch model was applied to assess the students’ abilities and item difficulties. The findings revealed that the median student ability and item difficulty were closely aligned, indicating that the test was well-suited to the students’ ability levels. The weighted likelihood estimation reliability (WLE Reliability) was 0.659, with infit and outfit values falling within an acceptable range, demonstrating high validity. The ability levels ranged from -2.5 to 3.5 logits, and the fit indices were consistent with empirical data. Furthermore, the distribution of item difficulty and student ability, as illustrated by the Wright map, suggested that the test could effectively assess students with a wide range of abilities. Based on these findings, the study recommends that if the test is to be used with students from other educational settings, a preliminary pilot test should be conducted to evaluate whether the test is suitable for those students and to adjust test that is better aligned with their ability levels. |