<abstract xmlns="http://www.w3.org/1999/xhtml"><p>Named Entity Recognition (NER) is an important task in many NLP pipelines. It has become especially important for knowledge bases that power many of the nowadays information retrieval systems. In order to cope with the high demand for annotated training corpora for supervised NER systems, automatic generation approaches have been proposed. In this paper we report on the first automatically generated NE annotated corpus for Albanian. News articles from Albanian news media were used as a document source. They were automatically tagged using a custom generated gazetteer from the Albanian Wikipedia. Our evaluation results show that this corpus can be used as a baseline corpus for human annotated ones or as a training corpus where no other is available.</p></abstract>

Named Entity Recognition (NER) is an important task in many NLP pipelines. It has become especially important for knowledge bases that power many of the nowadays information retrieval systems. In order to cope with the high demand for annotated training corpora for supervised NER systems, automatic generation approaches have been proposed. In this paper we report on the first automatically generated NE annotated corpus for Albanian. News articles from Albanian news media were used as a document source. They were automatically tagged using a custom generated gazetteer from the Albanian Wikipedia. Our evaluation results show that this corpus can be used as a baseline corpus for human annotated ones or as a training corpus where no other is available.

An Automatically Generated Annotated Corpus for Albanian Named Entity Recognition

Cybernetics and Information Technologies

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Named Entity Recognition (NER) is an important task in many NLP pipelines. It has become especially important for knowledge bases that power many of the...

An Automatically Generated Annotated Corpus for Albanian Named Entity Recognition

Publié en ligne: 30 mars 2018

Pages: 95 - 108

Reçu: 30 juin 2017

Accepté: 01 déc. 2017

DOI: https://doi.org/10.2478/cait-2018-0009

Mots clés
Named entity recognition, natural language processing, language corpora, semi-automatic annotation, information extraction

© 2018 Klesti Hoxha et al., published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

An Automatically Generated Annotated Corpus for Albanian Named Entity Recognition

Publié en ligne: 30 mars 2018

Pages: 95 - 108

Reçu: 30 juin 2017

Accepté: 01 déc. 2017

DOI: https://doi.org/10.2478/cait-2018-0009

Mots clésNamed entity recognition, natural language processing, language corpora, semi-automatic annotation, information extraction

© 2018 Klesti Hoxha et al., published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Mots clés
Named entity recognition, natural language processing, language corpora, semi-automatic annotation, information extraction