Roles of Digital Technology in Assessment Within Context of STEAM Education: A Visualized Literature Review Based on Cluster Analysis

 ADDIN EN.REFLIST Abd Majid, M. Z., Norman, M. H., Zaini, M. H., Zulnaidi, H., & Mohamad Nasir, M. K. (2025). Technological empowerment in education: A systematic review. SAGE Open, 15(1), 21582440251325077. https://doi.org/10.1177/21582440251325077

Adedoyin, O. B., & Soykan, E. (2020). Covid-19 pandemic and online learning: The challenges and opportunities. Interactive Learning Environments, 31(2), 863-875. https://doi.org/10.1080/10494820.2020.1813180

Al-Balushi, S. M., & Al-Aamri, S. S. (2014). The effect of environmental science projects on students’ environmental knowledge and science attitudes. International Research in Geographical and Environmental Education, 23(3), 213-227. https://doi.org/10.1080/10382046.2014.927167

Amabile, T. M. (1983). The social psychology of creativity. Springer New York, NY. https://doi.org/https://doi.org/10.1007/978-1-4612-5533-8

American Federation of Teachers, N. C. o. M. i. E., & National Education Association (AFT, NCME, & NEA). (1990). Standards for teacher competence in educational assessment of students. Educational Measurement: Issues and Practice, 9(4), 30-30. https://doi.org/doi:10.1111/j.1745-3992.1990.tb00391.x

Anastasopoulou, E., Angeliki, T., Eleni, A., Konstantina, L., Evangelia, M., Danai, T., & Ioannis, K. (2024). The impact of ICT on education. Technium Social Sciences Journal, 58, 48-55. https://doi.org/10.47577/tssj.v58i1.11144

Anastasopoulou, E., Konstantina, G., Tsagri, A., Schoina, I., Travlou, C., Mitroyanni, E., & Lyrintzi, T. (2024). The impact of digital technologies on formative assessment and the learning experience. Technium Education and Humanities, 10, 115-126. https://doi.org/10.47577/teh.v10i.12113

Asselin, M., Early, M., & Filipenko, M. (2005). Accountability, assessment, and the literacies of information and communication technologies. Canadian Journal of Education, 28(4), 802-826. https://doi.org/10.2307/4126456

Auttawutikul, S., Wiwitkunkasem, K., & Smith, D. R. (2014). Use of weblogs to enhance group learning and design creativity amongst students at a Thai University. Innovations in Education and Teaching International, 51(4), 378-388. https://doi.org/10.1080/14703297.2013.796723

Awang, M. I. (2022, 01/05). The digitalization of learning assessment. Proceedings of International Conference on Multidisciplinary Research, Dubai.

Basilotta Gómez-Pablos, V., Martín Del Pozo, M., & García-Valcárcel Muñoz-Repiso, A. (2017). Project-based learning (PBL) through the incorporation of digital technologies: An evaluation based on the experience of serving teachers. Computers in Human Behavior, 68, 501-512. https://doi.org/10.1016/j.chb.2016.11.056

Bauer, R. M., Iverson, I. G., Cernich, A. N., Binder, L. M., Ruff, R. M., & and Naugle, R. I. (2012). Computerized neuropsychological assessment devices: Joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology. The Clinical Neuropsychologist, 26(2), 177-196. https://doi.org/10.1080/13854046.2012.663001

Behrens, J., & Dicerbo, K. (2014). Technological implications for assessment ecosystems: Opportunities for digital technology to advance assessment. Teachers College Record, 116(11), 1.

Bennett, R. E. (2015). The changing nature of educational assessment. Review of Research in Education, 39(1), 370-407.

Bibic, A. (2023). The role of digital competence in carrying out STEAM projects. Inter/transdisciplinary approaches in the teaching of the real sciences.

Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012). Defining twenty-first century skills. In Assessment and teaching of 21st century skills (pp. 17-66). Springer.

Blumenfeld, P. C., Soloway, E., Marx, R. W., Krajcik, J. S., Guzdial, M., & Palincsar, A. (1991). Motivating project-based learning - sustaining the doing, supporting the learning. Educational Psychologist, 26(3-4), 369-398. https://doi.org/DOI 10.1207/s15326985ep2603&4_8

Bocanet, V. I., Brown, K., Uukkivi, A., Soares, F., Lopes, A. P., Cellmer, A., Serrat, C., Feniser, C., Serdean, F. M., Safiulina, E., Kelly, G., Cymerman, J., Kierkosz, I., Sushch, V., Latõnina, M., Labanova, O., Bruguera, M. M., Pantazi, C., & Estela, M. R. (2021). Change in gap perception within current practices in assessing students learning mathematics. Sustainability, 13(8), 4495. https://www.mdpi.com/2071-1050/13/8/4495

Bozkurt, A., & Sharma, R. C. (2020). Emergency remote teaching in a time of global crisis due to CoronaVirus pandemic. Asian Journal of Distance Education, 15(1), i-vi. https://www.asianjde.com/ojs/index.php/AsianJDE/article/view/447

Brighton, C. M., Hock, M., & Moon, T. R. (2022). Project-based assessments: Tasks and rubrics. In Handbook on Assessments for Gifted Learners (pp. 175-194).

Capraro, R. M., & Corlu, M. S. (2013). Changing views on assessment for STEM project-based learning. In STEM Project-Based Learning (pp. 109-118). Springer.

Chen, C.-M., & Chen, M.-C. (2009). Mobile formative assessment tool based on data mining techniques for supporting web-based learning. Computers & Education, 52(1), 256-273. https://doi.org/https://doi.org/10.1016/j.compedu.2008.08.005

Chen, F., Cui, Y., & Chu, M.-W. (2020). Utilizing game analytics to inform and validate digital game-based assessment with evidence-centered game design: A case study. International Journal of Artificial Intelligence in Education, 30(3), 481-503. https://doi.org/10.1007/s40593-020-00202-6

Chen, L., Zhen, W., & Peng, D. (2023). Research on digital tool in cognitive assessment: A bibliometric analysis. Frontiers in Psychiatry, 14, 1227261-1227261. https://doi.org/10.3389/fpsyt.2023.1227261

Chen, S., Wenbin, S., & Tan, X. (2024). Entrepreneurial education model based on interactive technology and cognitive psychology. International Journal of Human–Computer Interaction, 40(13), 3494-3506. https://doi.org/10.1080/10447318.2023.2189816

Council, N. R. (2011). The need to improve STEM learning (0309213002). Washington, DC: National Academies Press.

Demetroulis, E. A., Papadogiannis, I., Wallace, M., Poulopoulos, V., Theodoropoulos, A., Vasilopoulos, N., Antoniou, A., & Dasakli, F. (2024). Collaboration skills and puzzles: Development of a performance-based assessment—Results from 12 primary schools in Greece. Education Sciences, 14(10), 1056. https://www.mdpi.com/2227-7102/14/10/1056

Doise, W., Mugny, G., & Perret-Clermont, A.-N. (1975). Social interaction and the development of cognitive operations. European Journal of Social Psychology, 5(3), 367-383. https://doi.org/https://doi.org/10.1002/ejsp.2420050309

Dunn, L. (2013). Teaching in higher education: can social media enhance the learning experience? http://www.gla.ac.uk/media/media_276225_en.pdf

Fan, Y.-C., Wang, T.-H., & Wang, K.-H. (2011). A web-based model for developing assessment literacy of secondary in-service teachers. Computers & Education, 57(2), 1727-1740. https://doi.org/10.1016/j.compedu.2011.03.006

Gates, N. J., & Kochan, N. A. (2015). Computerized and on-line neuropsychological testing for late-life cognition and neurocognitive disorders: Are we there yet? Current Opinion in Psychiatry, 28(2), 165-172. https://doi.org/10.1097/yco.0000000000000141

Gee, J. P. (2003). What video games have to teach us about learning and literacy. Palgrave Macmillan.

Griffin, P., & Care, E. (2015). Assessment and teaching of 21st century skills: Methods and approach (2015 ed.). Dordrecht: Springer Netherlands. https://doi.org/10.1007/978-94-017-9395-7

Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable operations and computers, 3, 275-285.

Han, S., & Bhattacharya, K. (2001). Constructionism, learning by design, and project-based learning. In Emerging perspectives on learning, teaching, and technology (pp. 127-141).

Hepp, P., Hinostroza, J. E., Laval, E., & Rehbein, L. (2004). Technology in schools: Education, ICT and the knowledge society (pp. 30-47). World Bank, Distance & Open Learning and ICT in Education Thematic Group, Human Development Network, Education.   

Hilmiyati, F., Guilin, X., & Jiao, D. (2024). Integration of cognitive technology in learning assessment and evaluation. Al-Hijr: Journal of Adulearn World, 3(2), 323-334. https://doi.org/https://doi.org/10.55849/alhijr.v3i2.668

Hurek, R. K. K. (2018). Cognitive assessment in learning midwife care (ASKEB I) by midwifery students of STIKES Maranatha Kupang. Health, 2(1), 60-68.

Hwang, G.-J., Hung, C.-M., & Chen, N.-S. (2014). Improving learning achievements, motivations and problem-solving skills through a peer assessment-based game development approach. Education Tech Research Dev, 62(2), 129-145. https://doi.org/10.1007/s11423-013-9320-7

Irvin, R. K., & Alexius Smith, M. (2007). Information and communication technology (ICT) literacy: Integration and assessment in higher education. Journal of Systemics, Cybernetics and Informatics, 5(4), 50-55.

Islami, S., Ambiyar, A., Sukardi, S., Zaus, A. A., Zaus, A. A., & Zaus, M. A. (2024). Innovative Tech-savvy education: Designing a smart assessment system. Journal of Applied Engineering and Technological Science (Online), 6(1), 537-549. https://doi.org/10.37385/jaets.v6i1.5861

Kalogeratos, G., Anastasopoulou, E., & Pierrakeas, C. (2024). Myschool: The key role of the information system in the Greek public school. A case study on the prefecture of Achaia. 18th International Technology, Education and Development Conference, Valencia, Spain.

Khan, A., Zeb, I., Zhang, Y., & Tahir. (2023). Impact of emerging technologies on cognitive development: the mediating role of digital social support among higher education students. IJERI: International Journal of Educational Research and Innovation, (20), 1-15. https://doi.org/10.46661/ijeri.8362

Kikis-Papadakis, K., & Chaimala, F. (2019). Assessing competences for digital creativity. Proceedings of the First Symposium on Psychology-Based Technologies. https://ceur-ws.org/Vol-2524/paper5.pdf

Kim, Y. J., & Shute, V. J. (2015). The interplay of game elements with psychometric qualities, learning, and enjoyment in game-based assessment. Computers & Education, 87, 340-356. https://doi.org/https://doi.org/10.1016/j.compedu.2015.07.009

Koo, B. M., & Vizer, L. M. (2019). Mobile technology for cognitive assessment of older adults: A scoping review. Innovation in Aging, 3(1). https://doi.org/10.1093/geroni/igy038

Kryukov, V., & Gorin, A. (2017). Digital technologies as education innovation at universities. Australian Educational Computing, 32(1), 1-16.

Kuo-Hung, C., Kuo-En, C., Chung-Hsien, L., Kinshuk, & Yao-Ting, S. (2016). Integration of mobile AR technology in performance assessment. Educational Technology & Society, 19(4), 239-251.

Lin, J.-W., Tsai, C.-W., & Hsu, C.-C. (2023). A comparison of computer-based and game-based formative assessments: A long-term experiment. Interactive Learning Environments, 31(2), 938-954. https://doi.org/10.1080/10494820.2020.1815219

Liu, O. L., Brew, C., Blackmore, J., Gerard, L., Madhok, J., & Linn, M. C. (2014). Automated scoring of constructed-response science items: Prospects and obstacles. Educational Measurement, Issues and Practice, 33(2), 19-28. https://doi.org/10.1111/emip.12028

Loukina, A., & Cahill, A. (2016). Automated scoring across different modalities. In J. Tetreault, J. Burstein, C. Leacock, & H. Yannakoudakis, Proceedings of the 11th Workshop on Innovative Use of NLP for Building Educational Applications San Diego, CA.

Loveless, A. (2008). Creative learning and new technology?: A provocation paper. In J. Sefton-Green (Ed.), Creative learning (pp. 61-72). Arts Council England.

Markula, A., & Aksela, M. (2022). The key characteristics of project-based learning: How teachers implement projects in K-12 science education. Disciplinary and Interdisciplinary Science Education Research, 4(1), 1-17. https://doi.org/10.1186/s43031-021-00042-x

Maros, M., Marcela, K., Milan, F., Michal, L., & and Schoberova, M. (2023). Project-based learning and its effectiveness: Evidence from Slovakia. Interactive Learning Environments, 31(7), 4147-4155. https://doi.org/10.1080/10494820.2021.1954036

McLoughlin, C., & Lee, M. J. W. (2008). The three p’s of pedagogy for the networked society: Personalization, participation, and productivity. International Journal of Teaching and Learning in Higher Education, 20(1), 10-27.

Meijer, K., Baartman, L., Vermeulen, M., & de Bruijn, E. (2023). Teachers’ conceptions of assessment literacy. Teachers and Teaching, Theory and Practice, 29(7-8), 695-709. https://doi.org/10.1080/13540602.2023.2190091

Miller, E. C., & Krajcik, J. S. (2019). Promoting deep learning through project-based learning: A design problem. Disciplinary and Interdisciplinary Science Education Research, 1(1), 1-10. https://doi.org/10.1186/s43031-019-0009-6

Mok, J. C. H. (2012). Facebook and learning: Students’ perspectives on a course. Journal of the NUS Teaching Academy, 2(3),. 131-143.

Morgan, J. R., Moon, A. M., & Barroso, L. R. (2013). Engineering better projects. In STEM Project-Based Learning (pp. 29-39). Springer.

Mphahlele, R. S. (2022). Digital assessment literacy in online courses (formative/summative): Rethinking assessment strategies in the open distance and e-learning institutions. In G. Durak & S. Çankaya (Eds.), Handbook of Research on Managing and Designing Online Courses in Synchronous and Asynchronous Environments (pp. 404-417). IGI Global. https://doi.org/10.4018/978-1-7998-8701-0.ch020

Mulenga, R., & Mwenya, A. (2024). Examining Accessibility, credibility, and accountability in digital assessment: A systematic literature review. American Journal of Interdisciplinary Research and Innovation, 3(3), 11-20. https://doi.org/10.54536/ajiri.v3i3.2908

Murov, S. (2001). Exploring chemistry resources on the Internet. Journal of Chemical Education, 78(10), 1429. https://doi.org/10.1021/ed078p1429

Newton, P. E. (2012). Clarifying the consensus definition of validity. Measurement: Interdisciplinary Research & Perspective, 10(1-2), 1-29.

Ng, W. (2015). New digital technology in education: Conceptualizing professional learning for educators (2015 ed.). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-05822-1

Nikou, S. A., & Economides, A. A. (2018). Mobile-based assessment: A literature review of publications in major referred journals from 2009 to 2018. Computers & Education, 125, 101-119. https://doi.org/10.1016/j.compedu.2018.06.006

O' Leary, M., Scully, D., Karakolidis, A., & Pitsia, V. (2018). The state‐of‐the‐art in digital technology‐based assessment. European Journal of Education, 53(2), 160-175. https://doi.org/10.1111/ejed.12271

O’Leary, M., Scully, D., Karakolidis, A., & Pitsia, V. (2018). The state-of-the-art in digital technology-based assessment. European Journal of Education, 53(2), 160-175. https://doi.org/10.1111/ejed.12271

OECD. (2008). 21st century learning: Research, innovation and policy. http://www.oecd.org/site/educeri21st/40554299.pdf

OECD. (2016). Skills for a Digital World. O. Publishing. https://www.oecd.org/content/dam/oecd/en/topics/policy-issues/future-of-work/skills-for-a-digital-world.pdf

Öhman, F., Hassenstab, J., Berron, D., Schöll, M., & Papp, K. V. (2021). Current advances in digital cognitive assessment for preclinical Alzheimer’s disease. Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring, 13(1), e12217. https://doi.org/https://doi.org/10.1002/dad2.12217

Pastore, S., & Andrade, H. L. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128-138. https://doi.org/https://doi.org/10.1016/j.tate.2019.05.003

Penprase, B. E. (2018). The fourth industrial revolution and higher education. Higher Education in the Era of the Fourth Industrial Revolution, 10(1), 978-981.

Pintrich, P., Smith, D., Duncan, T., & McKeachie, W. (1993). Reliability and predictive validity of the motivated strategies for learning questionnaire (MSLQ). Educational and Psychological Measurement - EDUC PSYCHOL MEAS, 53, 801-813. https://doi.org/10.1177/0013164493053003024

Pinzón, M. D. R., Álvarez, W. O., & Romero, A. F. (2024). Barriers and challenges in the implementation of the STEAM approach in educational practice. Evolutionary Studies in Imaginative Culture, 1849-1863.

Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory Into Practice, 48(1), 4-11. https://doi.org/10.1080/00405840802577536

Riley, S. M. (2014). what is s.t.e.a.m.? In No Permission Required: Bringing S.T.E.A.M. to Life in K-12 Schools (pp. 12-35). Visionyst Press; Illustrated edition.

Russell, M. (2018). Recent advances in the accessibility of digitally delivered educational assessments. In S. N. Elliott, R. J. Kettler, P. A. Beddow, & A. Kurz (Eds.), Handbook of accessible instruction and testing practices: Issues, innovations, and applications (pp. 247-262). Springer International Publishing. https://doi.org/10.1007/978-3-319-71126-3_16

Ryall, T., Judd, B. K., & Gordon, C. J. (2016). Simulation-based assessments in health professional education: A systematic review. Journal of Multidisciplinary Healthcare, 9(1), 69. https://doi.org/10.2147/JMDH.S92695

Schwartz, D. L., & Arena, D. (2009). Choice-based assessments for the digital age. MacArthur 21st century learning and assessment project.

See, B. H., Gorard, S., Lu, B., Dong, L., & Siddiqui, N. (2022). Is technology always helpful?: A critical review of the impact on learning outcomes of education technology in supporting formative assessment in schools. Research Papers in Education, 37(6), 1064-1096. https://doi.org/10.1080/02671522.2021.1907778

See, B. H., Gorard, S., & Siddiqui, N. (2016). Teachers’ use of research evidence in practice: A pilot study of feedback to enhance learning. Educational Research (Windsor), 58(1), 56-72. https://doi.org/10.1080/00131881.2015.1117798

Shermis, M. D., & Burstein, J. C. (2003). Automated scoring and annotation of essays with the intelligent essay assessor. Routledge. https://doi.org/10.4324/9781410606860-15

Shute, V., Leighton, J. P., Jang, E. E., & Chu, M.-W. (2015). Advances in the science of assessment. Educational Assessment, 21(1), 34-59. https://doi.org/10.1080/10627197.2015.1127752

Shute, V. J. (2011). Stealth assessment in computer-based games to support learning. In Computer games and instruction (pp. 503-524). IAP Information Age Publishing.

Shute, V. J., Ventura, M., Bauer, M. I., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning. In U. Ritterfeld, M. J. Cody, & P. Vorderer (Eds.), Serious games: Mechanisms and effects (pp. 295-321). Philadelphia, PA: Routledge/LEA.

Silvestri, R., Holmes, A., & Rahemtulla, R. (2022). The interaction of cognitive profiles and text-to-speech software on reading comprehension of adolescents with reading challenges. Journal of Special Education Technology, 37(4), 498-509. https://doi.org/10.1177/01626434211033577

Stiggins, R. J. J. P. D. K. (1991). Assessment literacy. Phi Delta Kappan, 72(7), 534-539.

Sung, Y.-T., Chang, K.-E., & Lee, M.-D. (2008). Designing multimedia games for young children’s taxonomic concept development. Computers & Education, 50(3), 1037-1051. https://doi.org/10.1016/j.compedu.2006.07.011

Sykes, J. (2006). Affective gaming: Advancing the argument for game-based learning. In M. Pivec (Ed.), Affective and emotional aspects of human-computer interaction: Game-based and innovative learning approaches (pp. 3-7).

Taskiran, A. (2022). Effective, efficient, and attractive instructional design for online learning. In G. Durak & S. Çankaya (Eds.), Handbook of research on managing and designing online courses in synchronous and asynchronous environments (pp. 140-158). IGI Global. https://doi.org/10.4018/978-1-7998-8701-0.ch007

Thibaut, L., Knipprath, H., Dehaene, W., & Depaepe, F. (2018). The influence of teachers’ attitudes and school context on instructional practices in integrated STEM education. Teaching and Teacher Education, 71, 190-205. https://doi.org/10.1016/j.tate.2017.12.014

Wang, D., Liu, H., & Hau, K.-T. (2022). Automated and interactive game-based assessment of critical thinking. Education and Information Technologies, 27(4), 4553-4575. https://doi.org/10.1007/s10639-021-10777-9

Wang, Q. (2008). A generic model for guiding the integration of ICT into teaching and learning. Innovations in Education and Teaching International, 45(4), 411-419. https://doi.org/10.1080/14703290802377307

Wang, Z.-y., Liu, L., & Liu, Y. (2023). A multi-source behavioral and physiological recording system for cognitive assessment. Scientific Reports, 13(1), 8149. https://doi.org/10.1038/s41598-023-35289-z

Williamson, D. M. (2012). The conceptual and scientific basis for automated scoring of performance items. Computers and Their Impact on State Assessment: Recent History and Predictions for the Future, 10, Oct, 2010, University of Maryland, College Park, MD, US; Portions of this research were presented at the aforementioned conference.,

Wu, Y.-T., Shen, P.-D., & Lin, C.-H. (2022). The effects of cognitive apprenticeship and co-regulated learning on improving student computer problem-solving skills and learning motivation: A quasi-experiment in an “Applied Information Technology: Office Software” course. International Journal of Technology and Human Interaction (IJTHI), 18(1), 1-16. https://doi.org/10.4018/IJTHI.299355

Wurdinger, S., Haar, J., Hugg, R., & Bezon, J. (2007). A qualitative study using project-based learning in a mainstream middle school. Improving Schools, 10(2), 150-161. https://doi.org/10.1177/1365480207078048

Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149-162. https://doi.org/10.1016/j.tate.2016.05.010

Yalcinalp, S., & Avci, Ü. (2019). Creativity and emerging digital educational technologies: A systematic review. Turkish Online Journal of Educational Technology-TOJET, 18(3), 25-45.

Yang, Y.-T. C. (2012). Building virtual cities, inspiring intelligent citizens: Digital games for developing students’ problem solving and learning motivation. Computers & Education, 59(2), 365-377. https://doi.org/10.1016/j.compedu.2012.01.012

Yu, A. (2024). Empowering learning: A systematic review of technology use and motivation in education. Proceedings of the International Conference on Global Politics and Socio-Humanities, UK & USA.

Zhanjun, Z., Jianping, J., Jianjun, J., Xiaochun, C., & Ying, G. (2023). Chinese clinical practice guidelines for digital memory clinic. Zhonghua Yi Xue Za Zhi, 103(1), 1-9. https://doi.org/10.3760/cma.j.cn112137-20221024-02218