BRAC University Institutional Repository

A proposed automated extraction procedure of Bangla text for corpus creation in unicode

Show simple item record Pavel, Dewan Shahriar Hossain Sarkar, Asif Iqbal Khan, Mumit 2010-12-08T04:07:37Z 2010-12-08T04:07:37Z 2006 2006
dc.description Includes bibliographical references (page 5).
dc.description.abstract This paper addresses the issue of automated Bangla corpus creation, which will significantly help the processes of lexicon development, morphological analysis, automatic parts of speech detection and automatic grammar extraction and machine translation. The plan is to collect all free Bangla documents on the world wide web and offline documents available and extract all the words in them to make a huge repository of text. This body of text or corpus will be used for several purposes of Bangla language processing after it is converted to Unicode text. The conversion process is also one of the associated and equally important research and development issue. Among several procedures our research focuses on a combination of font and language detection and Unicode conversion of retrieved Bangla text as a solution for automatic Bangla corpus creation and the methodology has been described in the paper. en_US
dc.description.statementofresponsibility Dewan Shahriar Hossain Pavel
dc.description.statementofresponsibility Asif Iqbal Sarkar
dc.description.statementofresponsibility Mumit Khan
dc.language.iso en en_US
dc.publisher BRAC University en_US
dc.subject Corpus en_US
dc.subject TTF (true type font) en_US
dc.subject OTF (open type font) en_US
dc.subject Unicode en_US
dc.subject Converter en_US
dc.subject Crawler en_US
dc.subject Search engine en_US
dc.subject N-gram en_US
dc.title A proposed automated extraction procedure of Bangla text for corpus creation in unicode en_US
dc.type Article en_US
dc.contributor.department Center for Research on Bangla Language Processing (CRBLP), BRAC University

Files in this item

This item appears in the following Collection(s)

Show simple item record

Policy Guidelines

Search BRACU Repository

Advanced Search


My Account