Investigating Differential Item Functioning (DIF) in Geometry Test Scores: Holistic vs. Analytical Scoring Rubrics Raoda Ismail, Okky Riswandha Imawan, Heri Retnawati, Haryanto Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia, 2026 The use of polytomous data in test instruments enables more detailed assessment of test-takers' abilities, but group differences, such as gender, class, and ethnicity, are often overlooked. Differential Item Functioning (DIF) analysis helps determine whether these identities influence test performance. This descriptive quantitative study examines DIF in geometry tests using Holistic and Analytical Scoring Rubrics across gender, class, and ethnic groups. The study involved 102 undergraduate students from Cenderawasih University, Papua, who completed a geometry test with 10 descriptive questions. Two scoring rubrics were used: the Holistic Scoring Rubric with three categories and the Analytical Scoring Rubric with five. Results were analyzed with the difR package in the R Program. The criterion for detecting DIF is a p-value less than 0.05. Findings show that some test items exhibit DIF concerning gender, class, and ethnicity. The DIF detected for the holistic scoring rubric is items 1, 6, 7, and 10 for the gender group; items 1, 4, 5, and 8 for the class group; and items 1, 2, and 6 for the ethnic group. Meanwhile, the DIF detected for the analytic scoring rubric is item 10 for the gender group; items 9 and 10 for the class group; and item 10 for the ethnic group. However, not all DIF items are flawed; some assess fundamental skills. The Analytical Rubric demonstrated slightly higher reliability (alpha 0.903) than the Holistic Rubric (alpha 0.804). These insights support the development of more equitable and sustainable assessment practices, ensuring fairness and inclusivity in educational evaluations.
Predictive model of mathematical literacy ability, specifically university students' critical thinking skills: A case study on the inappropriateness of multilevel regression Pitriana Tandililing, Bettisari Napitupulu, Okky Riswandha Imawan, Raoda Ismail Journal of Education and E Learning Research, 2025 This study aims to analyze the influence of Project-Based Learning (PjBL) and Guided Discovery Learning (GDL) on students' critical thinking skills in geometry focusing on mathematical literacy within geometry content. Specifically, it examines the effects of self-confidence, mathematical literacy scores, and gender on critical thinking skills and compares the predictive accuracy of multiple linear regression and multilevel regression models. A quantitative approach with regression analysis was used. Multiple linear regression and multilevel regression models were applied to assess the relationships among variables. Model accuracy was evaluated using intraclass correlation coefficients (ICC) to determine the impact of class-level grouping. Self-confidence and mathematical literacy in geometry significantly influenced students' critical thinking skills. Gender showed no significant effect. The multiple linear regression model outperformed the multilevel model as reflected by lower ICC values, indicating that class grouping did not substantially affect critical thinking outcomes. Internal factors, such as confidence and subject mastery are more critical to students’ critical thinking development than external factors like gender or class grouping. Teachers should prioritize enhancing students’ confidence and content mastery through well-designed instructional strategies to foster critical thinking in mathematics learning.
The challenges of implementing computerized adaptive testing in Indonesia Okky Riswandha Imawan, Heri Retnawati, Haryanto Haryanto, Raoda Ismail Journal of Education and E Learning Research, 2025 This study explores the challenges of implementing computerized adaptive testing (CAT) for mathematics assessment among prospective elementary school teachers in Indonesia. It aims to describe (1) assessment practices of mathematics lecturers and (2) challenges in adopting CAT. Using a qualitative phenomenological approach, data were collected from 17 mathematics lecturers across Indonesia through questionnaires followed by in-depth interviews with four lecturers unfamiliar with or struggling to use CAT. Findings indicate that paper-and-pencil tests and computer- based testing (CBT) dominate university assessments. Key barriers to CAT adoption include limited lecturer knowledge and skills, technical constraints, inadequate infrastructure, and incompatibility with essay-based assessments. Despite these challenges, lecturers express interest in a more accessible and cost-effective CAT. The study concludes that lecturers acknowledge CAT’s potential to enhance fairness and accuracy in testing while they face difficulties in its implementation. A targeted CAT development program aligned with lecturers' needs with institutional support is essential for successful integration. CAT has the potential to improve assessment effectiveness and efficiency in Indonesian universities aligning with technological advancements and 21st-century education trends.
Contexts proposed by teachers in Papua for developing mathematics hots assessment instruments: A phenomenological study Raoda Ismail, Heri Retnawati, Sugiman, Novita Intan Arovah, Okky Riswandha Imawan Journal of Education and E Learning Research, 2024 The success of a school centers on teachers' ability to create well-aligned educational tools. The Merdeka Belajar curriculum requires adapting assessments, including Higher-Order Thinking Skills (HOTS) questions for real-world problem-solving scenarios. This study explored contexts proposed by teachers in Papua for developing Mathematics HOTS questions. A phenomenological approach within a qualitative framework was employed involving 24 mathematics teachers from public and private schools in focus group discussions. Participants included twenty teachers from Papua, two from Central Indonesia and two from Western Indonesia. Additionally, five teachers from Papua participated in in-depth interviews. Data was analyzed using Creswell’s model with Atlas.ti software. Teachers developed HOTS assessment instruments based on daily life, scientific and social contexts. However, no cultural contexts were incorporated into these instruments by the interviewed teachers. This study highlights the importance of teacher preparedness in aligning contextual learning with the Merdeka Belajar curriculum and reveals a significant gap in using cultural contexts for HOTS assessments among teachers in Papua. These insights contribute to the discourse on math education in Indonesia advocating for the integration of cultural elements into the freedom to learn initiative.
Optimal Scale Points for Reliable Measurements: Exploring the Impact of Scale Point Variation Raoda Ismail, Heri Retnawati, Sugiman Sugiman, Farida Agus Setiawati, Okky Riswandha Imawan, Purwoko Haryadi Santoso Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia, 2024 Ensuring reliable measurements is crucial for minimising errors in assessments. The assessmentcommunity commonly employs the evaluation of reliability coefficients to estimate the dependability oftest scores. Despite its significance, limited research has explored the relationship between the estimated reliability coefficient and the number of scale points utilised. This study aims to provide valuable insights to practitioners by investigating the optimal number of scale points required for the most accurate reliability coefficient estimation. Using simulated data, the research scrutinises scales with varying points, ranging from 2 to 11. The results reveal a substantial impact of the number of scale points on reliability estimation. The most accurate estimate of reliability is obtained for scales with 8 points. This study helps us understand the optimal number of scale points for reliable measurements and guides future assessment improvements.
Comparing IRT properties among different category numbers: a case from attitudinal measurement on physics education research Purwoko Haryadi Santoso, Farida Agus Setiawati, Raoda Ismail, Suhariyono Suhariyono Discover Psychology, 2023 Collapsing different category numbers within attitudinal measurement on learning and instruction can be an option of physics education research (PER) scholars while interpreting categorical responses from participants. Psychometric evaluation of the different category numbers, however, has inconclusive results to date. Item response theory (IRT) offers psychometric framework at the item level that has been approached in this study to explore psychometric properties of five different number of categories. One thousand artificial data within five number of categories were generated based on the underlying marginal distribution and the inter item correlation matrix. Statistical parameters [item estimates and test information functions (TIFs)] from Graded Response Model (GRM) were employed to describe the psychometric behaviors of the studied category numbers. Our findings demonstrated that the discrimination index among the five category numbers remained constant. Global fit indices had no distinguishable information to differentiate the varying category numbers. Based on the item location and TIF, our results confirmed previous works that more information will be raised by the greater number of categories. The implication intended by this study should offer a key recommendation for a case from attitudinal measurement on the PER community or even beyond the psychometric field.
Investigating Differential Item Functioning (DIF) in Geometry Test Scores: Holistic vs. Analytical Scoring Rubrics R Ismail, OR Imawan, H Retnawati, Haryanto JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) 15 (1), 1-21 , 2026 2026
TRANSFORMASI ALAT PERAGA SEKOLAH DASAR DI ERA MODERN: Inovasi Media Pembelajaran Interaktif untuk Sains, Sosial, Bahasa, Karakter, dan Numerasi SM Ohee, ST Handoko, R Ismail, OR Imawan, AD Yonggom, R Efendi, ... EDUPEDIA Publisher, 1-184 , 2026 2026
Dialektika Alat Peraga Matematika: Kolaborasi Alat Peraga Konvensional dan Digital dalam Ekosistem Pembelajaran Abad 21 OR Imawan, R Ismail EDUPEDIA Publisher, 1-289 , 2026 2026
Transformasi Alat Peraga Sekolah Dasar di Era Modern: Inovasi Media Pembelajaran Interaktif untuk Sains, Soial, Bahasa, Karakter, dan Numerasi STH ara Marlina Ohee, Suwita, Dian Septikasari, Maya Pujowati, Mamberuman M ... 2026
Dinamika Belajar di Sekolah Dasar: Panduan Teori Klasik, Praktik Moderna, dan Wawasan Internasional untuk Guru Masa Depan RNS Rispah Purba, Aisyah Ali, Ria Ristiani, Lidwina C. Maniboey, Tiffany ... 2026
Guided Discovery Learning Dalam Pembelajaran Matematika: Teori, Implementasi, dan Integrasi GeoGebra BP Awiyadi, B Napitupulu, R Ismail 2026
Peningkatan Hasil Belajar pada Materi Refleksi Berbantuan Geogebra BP Awiyadi, B Napitupulu, R Ismail Jurnal Pendidikan Matematika: Judika Education 9 (1), 48-57 , 2026 2026
Penerapan Model Auditory Intellectually Repetition (AIR) pada Materi Menentukan Penyelesaian Persamaan Kuadrat dengan Cara Memfaktorkan E Sirampun, H Lumbantobing, YR Hadiyanti, B Napitupulu, P Tandililing, ... Science and Technology: Jurnal Pengabdian Masyarakat 2 (4), 483-499 , 2025 2025
Asesmen dan Pengklasteran Kemampuan Literasi Matematika Calon Guru SD OR Imawan, H Retnawati, H Haryanto, R Ismail EDUPEDIA Publisher, 1-182 , 2025 2025
Menjembatani Matematika dan Budaya Papua: Kerangka Pengukuran HOTS untuk Siswa SMP R Ismail, H Retnawati, Sugiman 2025
Model Pengukuran HOTS Matematika SMP Berkonteks Budaya Papua R Ismail, H Retnawati, Sugiman 2025
Psikologi Pendidikan: Sebuah pengantar S Inayah, R Ismail, E Supriyadi, S Muzekki, OM Lambonan, I Puspita, ... EDUPEDIA Publisher, 1-241 , 2025 2025 Citations: 1
Teknologi dalam Pendidikan Tinggi: Strategi Pengajaran Modern MI Dacholfany, F Muhdar, S Prabandari, R Ismail, G Tarmon, OR Imawan, ... EDUPEDIA Publisher, 1-177 , 2025 2025
Predictive Model of Mathematical Literacy Ability, Specifically University Students' Critical Thinking Skills: A Case Study on the Inappropriateness of Multilevel Regression. P Tandililing, B Napitupulu, OR Imawan, R Ismail Journal of Education and e-Learning Research 12 (3), 507-519 , 2025 2025 Citations: 3
The Challenges of Implementing Computerized Adaptive Testing in Indonesia. OR Imawan, H Retnawati, R Ismail Journal of Education and E-Learning Research 12 (2), 124-144 , 2025 2025 Citations: 2
Innovations in Assessment Methods: Computerized Adaptive Testing (CAT) for Sustainable Energy Efficiency OR Imawan, H Retnawati, H Haryanto, R Ismail Lecture Notes in Civil Engineering 557 (2), 161-168 , 2025 2025 Citations: 2
A Sustainable Development Approach to Math Higher-Order Thinking Skills: Culture and Green Technology R Ismail, H Retnawati, Sugiman, OR Imawan Lecture Notes in Civil Engineering 557 (2), 137-143 , 2025 2025
Pembelajaran dengan Problem Based Learning: Strategi dan Implementasi R Ismail, A Anas, A Nasrullah, A Arianto, Y Sulfiati, E Ernawati, MS Kau, ... Edupedia Publisher, 1-206 , 2024 2024 Citations: 8
Construct validity of mathematics high order thinking skills instrument with cultural context: Confirmatory factor analysis R Ismail, H Retnawati, Sugiman, OR Imawan AIP Conference Proceedings 3150 (1), 080008 , 2024 2024 Citations: 7
Confirmatory factor analysis and differential item functioning analysis on mathematical literacy instruments for prospective Indonesian elementary school teachers OR Imawan, H Retnawati, Haryanto, R Ismail AIP Conference Proceedings 3150 (1), 080009 , 2024 2024
MOST CITED SCHOLAR PUBLICATIONS
Perbandingan keefektifan pembelajaran berbasis proyek dan pembelajaran berbasis masalah ditinjau dari ketercapaian tujuan pembelajaran R Ismail PYTHAGORAS: Jurnal Matematika dan Pendidikan Matematika 13 (2), 181-188 , 2018 2018 Citations: 90
Peningkatan Kemampuan Analisa dan Interpretasi Data Mahasiswa Melalui Pelatihan Program SPSS R Ismail, F Safitri JMM (Jurnal Masyarakat Mandiri) 3 (2), 148-155 , 2019 2019 Citations: 52
Meningkatkan penguasaan TPACK guru di papua melalui pelatihan pembuatan video pembelajaran pada masa pandemi covid-19 R Ismail, OR Imawan JMM (Jurnal Masyarakat Mandiri) 5 (1), 277-288 , 2021 2021 Citations: 38
Analysis of character education values on the learning achievement of elementary school teacher candidates OR Imawan, R Ismail International Journal of Mathematics and Mathematics Education (IJMME) 1 (2 … , 2023 2023 Citations: 32
Meningkatkan kompetensi guru matematika dalam mengembangkan media pembelajaran 4.0 melalui pelatihan aplikasi geogebra OR Imawan, R Ismail Jurnal Masyarakat Mandiri 4 (6), 1230-1239 , 2020 2020 Citations: 21
Five priority character values: Content analysis in the independent curriculum mathematics textbook in Indonesia R Ismail, OR Imawan International Journal of Mathematics and Mathematics Education (IJMME) 1 (2 … , 2023 2023 Citations: 14
The Effectiveness of Problem-based Learning in Terms of Learning Achievement, Problem-Solving, and Self-Confidence R Ismail, OR Imawan 5th International Conference on Current Issues in Education (ICCIE 2021 … , 2022 2022 Citations: 13
Model Pembelajaran Project-Based Learning dan Probem-Based Learning Untuk Ketercapaian Tujuan Pembelajaran Siswa SMP R Ismail, H Retnawati, OR Imawan Thesis Commons , 2021 2021 Citations: 13
Employing Higher Order Thinking Skills-based Instruction in History Course: A history high school teacher’s perspective ST Handoko, Y Mardiati, R Ismail, OR Imawan AIP Conference Proceedings 2679 (1), 070004 , 2023 2023 Citations: 12
Student’s self-confidence change through the application of the guided discovery learning model OR Imawan, R Ismail 5th International Conference on Current Issues in Education (ICCIE 2021 … , 2022 2022 Citations: 12
The comparison of effectiveness of project-based learning and problem-based learnin g in terms of achievement of student R Ismail PYTHAGORAS: Jurnal Pendidikan Matematika 13 (2), 181-188 , 2018 2018 Citations: 10
Pembelajaran dengan Problem Based Learning: Strategi dan Implementasi R Ismail, A Anas, A Nasrullah, A Arianto, Y Sulfiati, E Ernawati, MS Kau, ... Edupedia Publisher, 1-206 , 2024 2024 Citations: 8
Construct validity of mathematics high order thinking skills instrument with cultural context: Confirmatory factor analysis R Ismail, H Retnawati, Sugiman, OR Imawan AIP Conference Proceedings 3150 (1), 080008 , 2024 2024 Citations: 7
Cluster analysis of the national examination: School grouping to maintain the sustainability of high school quality R Ismail, H Retnawati, OR Imawan REID (Research and Evaluation in Education) 8 (1), 13-23 , 2022 2022 Citations: 7
Instrument test development of mathematics skill on elementary school SWD Pomalato, R Ismail, AO Harefa, OR Imawan, BA Ningsi, D Wulandari Turkish Journal of Computer and Mathematics Education 12 (6), 2447-2455 , 2021 2021 Citations: 7
Pembelajaran Berbasis Proyek di Perguruan Tinggi: Teori dan Praktik L Mariya, DD Djoa, OR Imawan, R Ismail, DC Ningrum, AE Kusuma, ... EDUPEDIA Publisher, 1-183 , 2024 2024 Citations: 6
Contexts proposed by teachers in Papua for developing mathematics hots assessment instruments: A phenomenological study R Ismail, H Retnawati, Sugiman, NI Arovah, OR Imawan Journal of Education and e-Learning Research 11 (3), 548-556 , 2024 2024 Citations: 6
The influence of interest in learning mathematics on mathematics learning achievement of junior high school students in Papua R Ismail, OR Imawan, A Nadhifah AIP Conference Proceedings 2811 (1), 020013 , 2023 2023 Citations: 6
Application of cooperative learning model type of teams games tournament using question card learning media on sine and cosine rules OR Imawan, R Ismail, P Tandililing, FN Aisyah AIP Conference Proceedings 2811 (1), 020012 , 2023 2023 Citations: 6
Meningkatkan kompetisi guru matematika dalam mengembangkan media pembelajaran 4.0 melalui pelatihan aplikasi geogebra. JMM (Jurnal Masyarakat Mandiri), 4 (6), 1230-1239 OR Imawan, R Ismail 2020 Citations: 6