A Comparative study on part-of-speech taggers’ performance on examination questions classification according to bloom’s taxonomy

Goh, Thing Thing and Jamaludin, Nur Azliana Akmal and Mohamed, Hassan and Ismail, Mohd Nazri and Chua, Huang Shen (2021) A Comparative study on part-of-speech taggers’ performance on examination questions classification according to bloom’s taxonomy. In: 2021 2nd International Symposium on Automation, Information and Computing (ISAIC 2021), 2 December 2021, via virtual conference. (Submitted)

[thumbnail of Artikel] Text (Artikel)
AComparativeStudyOnPart.pdf - Full text
Restricted to Registered users only until 31 January 2099.

Download (580kB)

Abstract

Examination questions classification according to Bloom’s Taxonomy uses Natural Language Processing (NLP) approach, a series of text processing approach that generally can
divided into the keywords identification stage and then the identified keywords classification to Bloom’s Taxonomy levels stage. Since this NLP approach is a pipeline processes, the keywords identification stage’s performance in term of accuracy is affecting the subsequent stage - the
identified keywords classification and subsequently limits the final accuracy performance of the questions classification. The keywords identification stage’s performance is mainly dependingon the effectiveness of Part-Of-Speech (POS) tagging. Thus, this paper aims to identify the best performing POS tagger in keywords identification stage and enhance the tagger's performance with rule-based approach to achieve high accuracy performance and benefit the subsequent keyword classification and then the questions classification accuracy. The Perceptron tagger and the Stanford POS tagger are selected to be evaluated their performance in identifying the keywords of the randomly selected 200 examination questions from STEM subjects. This paper has observed the Stanford POS tagger is the best performing tagger in POS tagging with accuracy of 80.5%. Some rules are applied to the POS tagging to improve the accuracy further to 91.5%.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Bloom’s Taxonomy, NLP, Verb Identification, POS
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
T Technology > T Technology (General)
T Technology > TA Engineering (General). Civil engineering (General)
Divisions: Faculty of Defence Science &Technology > Computer Science
Depositing User: Mr Shahrim Daud
Date Deposited: 05 Sep 2023 03:18
Last Modified: 05 Sep 2023 03:18
URI: http://ir.upnm.edu.my/id/eprint/287

Actions (login required)

View Item
View Item