dc.contributor.author | Pavel, Dewan Shahriar Hossain | |
dc.contributor.author | Sarkar, Asif Iqbal | |
dc.contributor.author | Khan, Mumit | |
dc.date.accessioned | 2010-12-08T04:07:37Z | |
dc.date.available | 2010-12-08T04:07:37Z | |
dc.date.copyright | 2006 | |
dc.date.issued | 2006 | |
dc.identifier.uri | http://hdl.handle.net/10361/672 | |
dc.description | Includes bibliographical references (page 5). | |
dc.description.abstract | This paper addresses the issue of automated Bangla corpus creation, which will significantly help the processes of lexicon development, morphological analysis, automatic parts of speech detection and automatic grammar extraction and machine translation. The plan is to collect all free Bangla documents on the world wide web and offline documents available and extract all the words in them to make a huge repository of text. This body of text or corpus
will be used for several purposes of Bangla language processing after it is converted to Unicode text. The conversion process is also one of the associated and equally important research and development issue. Among several
procedures our research focuses on a combination of font and language detection and Unicode conversion of retrieved
Bangla text as a solution for automatic Bangla corpus creation and the methodology has been described in the paper. | en_US |
dc.description.statementofresponsibility | Dewan Shahriar Hossain Pavel | |
dc.description.statementofresponsibility | Asif Iqbal Sarkar | |
dc.description.statementofresponsibility | Mumit Khan | |
dc.language.iso | en | en_US |
dc.publisher | BRAC University | en_US |
dc.subject | Corpus | en_US |
dc.subject | TTF (true type font) | en_US |
dc.subject | OTF (open type font) | en_US |
dc.subject | Unicode | en_US |
dc.subject | Converter | en_US |
dc.subject | Crawler | en_US |
dc.subject | Search engine | en_US |
dc.subject | N-gram | en_US |
dc.title | A proposed automated extraction procedure of Bangla text for corpus creation in unicode | en_US |
dc.type | Article | en_US |
dc.contributor.department | Center for Research on Bangla Language Processing (CRBLP), BRAC University | |