<abstract xmlns="http://www.w3.org/1999/xhtml"><p>The present article describes a novel phrasing model which can be used for segmenting sentences of unconstrained text into syntactically-defined phrases. This model is based on the notion of attraction and repulsion forces between adjacent words. Each of these forces is weighed appropriately by system parameters, the values of which are optimised via particle swarm optimisation. This approach is designed to be language-independent and is tested here for different languages.</p><p>The phrasing model’s performance is assessed per se, by calculating the segmentation accuracy against a golden segmentation. Operational testing also involves integrating the model to a phrase-based Machine Translation (MT) system and measuring the translation quality when the phrasing model is used to segment input text into phrases. Experiments show that the performance of this approach is comparable to other leading segmentation methods and that it exceeds that of baseline systems.</p></abstract>

The present article describes a novel phrasing model which can be used for segmenting sentences of unconstrained text into syntactically-defined phrases. This model is based on the notion of attraction and repulsion forces between adjacent words. Each of these forces is weighed appropriately by system parameters, the values of which are optimised via particle swarm optimisation. This approach is designed to be language-independent and is tested here for different languages.The phrasing model’s performance is assessed per se, by calculating the segmentation accuracy against a golden segmentation. Operational testing also involves integrating the model to a phrase-based Machine Translation (MT) system and measuring the translation quality when the phrasing model is used to segment input text into phrases. Experiments show that the performance of this approach is comparable to other leading segmentation methods and that it exceeds that of baseline systems.

Swarm Algorithms for NLP - The Case of Limited Training Data

Institute of Language & Speech Processing

Journal of Artificial Intelligence and Soft Computing Research

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

{"article-title":"Swarm Algorithms for NLP - The Case of Limited Training Data"}

The present article describes a novel phrasing model which can be used for segmenting sentences of unconstrained text into syntactically-defined phrases. This...

Swarm Algorithms for NLP - The Case of Limited Training Data

Publié en ligne: 09 mai 2019

Pages: 219 - 234

Reçu: 07 déc. 2018

Accepté: 30 janv. 2019

DOI: https://doi.org/10.2478/jaiscr-2019-0005

Mots clés
particle swarm optimisation, natural language processing, text phrasing, machine translation

© 2019 George Tambouratzis et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Swarm Algorithms for NLP - The Case of Limited Training Data

Publié en ligne: 09 mai 2019

Pages: 219 - 234

Reçu: 07 déc. 2018

Accepté: 30 janv. 2019

DOI: https://doi.org/10.2478/jaiscr-2019-0005

Mots clésparticle swarm optimisation, natural language processing, text phrasing, machine translation

© 2019 George Tambouratzis et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Mots clés
particle swarm optimisation, natural language processing, text phrasing, machine translation