Taipa Central Secondary School, Macao Special Administrative Region, China

Abstract: This paper presents the development and evaluation of an innovative assessment framework called the AI-Enhanced Multidimensional Assessment Ecosystem (AI-MAE), designed to transform Chinese language assessment practices in Macao's junior secondary schools. Moving beyond traditional summative assessment approaches, the AI-MAE model integrates artificial intelligence as an intelligent hub connecting multiple assessment agents and dimensions, creating a dynamic ecosystem that supports assessment for learning, assessment as learning, and assessment of learning. Developed through reflective practice at Taipa Central Secondary School, the model addresses specific challenges in Macao's Chinese language education context, including large class sizes, diverse student backgrounds, and the need to align with the Basic Academic Competence Requirements. The AI-MAE model features four interconnected assessment dimensions—cognitive, thinking, metacognitive, and affective—supported by four complementary assessment agents: teachers, peers, students themselves, and AI tools. A fourteen-week empirical study was conducted with two Form 2 classes (n=78) to evaluate the model's effectiveness. Results indicate that the AI-MAE approach significantly improved students' Chinese language achievement (t=3.87, p<.001, d=0.88), enhanced their metacognitive skills and assessment literacy (t=4.12, p<.001, d=0.94), and increased learning motivation and self-efficacy (t=3.45, p<.01, d=0.79). Qualitative data further revealed that students and teachers appreciated the multidimensional nature of the assessment ecosystem and the way AI freed up time for deeper, more humanistic forms of assessment. This study contributes to the growing field of AI-enhanced educational assessment in Chinese language education and offers practical insights for educators in Macao and similar contexts seeking to transform assessment practices through thoughtful integration of technology.

Keywords: AI in education, educational assessment, multidimensional assessment, Chinese language education, junior secondary school, assessment as learning, Macao education