Automated Scoring of Arabic Text Using Large Language Models: A Literature Review
Quick Answer
This paper shows that This literature review explores LLM-based approaches for Automated Text Scoring (ATS) of Arabic texts, focusing on short answer grading and essay scoring.
Quick Take
It introduces a five-dimensional taxonomy for comparative analysis of methodologies, datasets, and performance metrics, emphasizing the need for ongoing research to enhance educational quality in Arabic-speaking communities.
Key Points
- Automated Text Scoring (ATS) enables scalable evaluation of learner responses without human input.
- The study introduces a taxonomy with five dimensions for analyzing ATS methodologies.
- Focus areas include short answer grading (ASAG) and essay scoring (AES) for Arabic texts.
- Findings stress the importance of pedagogically grounded research in Arabic ATS.
- Increased accessibility of has revitalized interest in Arabic text evaluation.
Paper Resources
Article Excerpt
From source RSS / original summaryarXiv:2606. 09830v1 Announce Type: new Abstract: In modern educational systems, Automatic Text Scoring (ATS) plays a central role by enabling scalable and consistent evaluation of learner responses without human intervention. Recently, the increased accessibility of and Arabic-specific datasets has sparked renewed interest in this area. In this work, we investigate LLM-Based approaches for the automated evaluation of Arabic texts, focusing on both short answer grading (ASAG) and essay scoring (AES).
We further introduce a structured taxonomy comprising five dimensions: application domain, feedback generation capability, LLM architecture deployed, alignment with competency referential frameworks, and prompt engineering strategy. By applying this taxonomy, we conduct a comparative analysis of existing studies, examining their methodological approaches, datasets, evaluation metrics, and reported performance.
The findings highlight the need for sustained and pedagogically grounded research efforts in Arabic ATS, given its significance for improving educational quality across Arabic-speaking communities.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CL
See more →TriAgent: Divergence-Aware Committees for Cost-Efficient Financial Sentiment Analysis
TriAgent introduces a cost-efficient multi-agent system for financial sentiment analysis, combining VADER, FinBERT, and Qwen2.5. It achieves an F1 score of ~0.87 with significant savings of $9.3M/year at a 10M-user scale compared to GPT-4o-mini, while also detecting hallucinations with an AUC of 0.90.