Amharic Text Chunker Using Conditional Random Fields

Birhan Hailu Getaneh, Birchiko Achamyeleh, Gebeyehu Belay

Abstract


This paper introduces Amharic text chunker using conditional random fields. To get the optimal feature set of the chunker; the researchers’ conduct different experiments using different scenarios until a promising result obtained. In this study different sentences are collected from Amharic grammar books, new articles, magazines and news of Walta Information Center (WIC) for the training and testing datasets. Thus, these datasets were analyzed and tagged manually and used as a corpus for our model training and testing. The entire datasets were chunk tagged manually for the training dataset and approved by linguistic professionals. For the identification of the boundary of the phrases IOB2 chunk specification is selected and used in this study. The result of all experiments is reported with the maximum overall accuracy off 97.26%, with a window size of two on both sides, with their corresponding POS tag of each token and the worst performance achieved is 84.57%, with only the window size of one word on both the left and right sides.


Keywords


Amharic text chunker, base phrase chunker, conditional random fields, clause boundary identification

Full Text:

PDF

References


} A. Ibrahim, “A Hybrid Approach to Amharic Base Phrase Chunking and Parsing,” Addis Abeba University, 2013.

N. Khoufi, C. Aloulou, and L. H. Belguith, “Chunking Arabic Texts Using Conditional Random,” IEEE, pp. 428–432, 2014.

K. Sarkar and V. Gayen, “Bengali Noun Phrase Chunking Based on Conditional Random Fields,” IEEE, pp. 148–153, 2014.

K. H. AMARE and A, “Tigrigna question answering system for factoid questions,” Addis Abeba University, 2016.

D. Abebaw, “LETEYEQ (ሌጠየቅ)-A Web Based Amharic Question Answering System for Factoid Questions Using Machine Learning Approach,” Addis Abeba University, 2013.

Muhe Seid, “TETEYEQ: Amharic Question Answering System for Factoid Questions,” Addis Abeba University, 2009.

Y. Zhao and T. Zhao, “Exploiting clause boundary information as features for Chinese functional chunk parsing,” IEEE, pp. 874–878, 2016.

A. Ibrahim and Y. Assabie, “Hierarchical Amharic Base Phrase Chunking Using HMM with Error Pruning,” Springer Int. Publ. Switz., vol. 8387, pp. 126–135, 2014.30

X. Vwhp, “shallow parsing natural language processing implementation for intelligent automatic customer service,” IEEE, pp. 274–279, 2014.

W. Ali, M. K. Malik, S. Hussain, S. Shahid, and A. Ali, “urdu noun phrase chunking,” IEEE, pp. 494–497, 2010.

“CSA (Central Statistics Agency), Addis Ababa, Ethiopia: Central Statistics Agency,” http://www.csa.gov.et, 2007. .

G. B. Kumar, “UCSG Shallow Parser : A Hybrid Architecture for a Wide Coverage Natural Language Parsing System,” 2007.

K. Roman and T. Katrin, “Classical Probabilistic Models and Conditional Random Fields,” Dortmund, 2007.




DOI: https://doi.org/10.24114/cess.v7i1.26935

Article Metrics

Abstract view : 144 times
PDF - 148 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

CESS (Journal of Computer Engineering, System and Science)

Creative Commons License
CESS (Journal of Computer Engineering, System and Science) is licensed under a Creative Commons Attribution 4.0 International License