Neo-Fuzzy Encoder and Its Adaptive Learning for Big Data Processing

Open access

Abstract

In the paper a two-layer encoder is proposed. The nodes of encoder under consideration are neo-fuzzy neurons, which are characterised by high speed of learning process and effective approximation properties. The proposed architecture of neo-fuzzy encoder has a two-layer bottle neck” structure and its learning algorithm is based on error backpropagation. The learning algorithm is characterised by a high rate of convergence because the output signals of encoder’s nodes (neo-fuzzy neurons) are linearly dependent on the tuning parameters. The proposed learning algorithm can tune both the synaptic weights and centres of membership functions. Thus, in the paper the hybrid neo-fuzzy system-encoder is proposed that has essential advantages over conventional neurocompressors.

References

  • [1] J. Han and M. Kamber, Data Mining: Concepts and Techniques. Amsterdam: Morgan Kaufman Publ., 2006.

  • [2] C. C. Aggarwal, Data Mining. N.Y.: Springer, 2015.

  • [3] А. Cichocki and R. Unbehauen, Neural networks for optimization and signal processing. Stuttgart: Teubner, 1993.

  • [4] S. Haykin, Neural Networks and Learning Machines. Upper Saddle River, New Jersey: Pearson, Prentice Hall, 2009.

  • [5] Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436-444, May 2015. https://doi.org/10.1038/nature14539

  • [6] J. Schmidhuber, “Deep learning in neural networks: An overview,” Neural Networks, vol. 61, pp. 85-117, Jan. 2015. https://doi.org/10.1016/j.neunet.2014.09.003

  • [7] I. Goodfellow, Y. Bengio and A. Courville, Deep learning. MIT Press, 2016.

  • [8] A. Bifet, Adaptive Stream Mining: Pattern Learning and Mining from Evolving Data Streams. Amsterdam: IOS Press, 2010.

  • [9] C. C. Aggarwal, Data Streams: Models and Algorithms. Kluwer Academic Publishers Boston/Dordrecht/London, 2007.

  • [10] V. Kolodyazhniy and Y. Bodyanskiy, “Fuzzy Kolmogorov’s Network,” Knowledge-Based Intelligent Information and Engineering Systems, pp. 764-771, 2004. https://doi.org/10.1007/978-3-540-30133-2_100

  • [11] Y. Bodyanskiy, V. Kolodyazhniy, and P. Otto, “Neuro-Fuzzy Kolmogorov’s Network for Time Series Prediction and Pattern Classification,” Lecture Notes in Computer Science, pp. 191-202, 2005. https://doi.org/10.1007/11551263_16

  • [12] V. Kolodyazhniy, Y. Bodyanskiy, and P. Otto, “Universal Approximator Employing Neo-Fuzzy Neurons,” Computational Intelligence, Theory and Applications, pp. 631-640. https://doi.org/10.1007/3-540-31182-3_58

  • [13] V. Kolodyazhniy, Ye. Bodyanskiy, V. Poyedyntseva, and A. Stephan, “Neuro-fuzzy Kolmogorov’s network with a modified perceptron learning rule for classification problems,” Computational Intelligence, Theory and Applications, pp. 41-49. https://doi.org/10.1007/3-540-34783-6_6

  • [14] Ye. Bodyanskiy, Ye. Gorshkov, V. Kolodyazhniy, and V. Poyedyntseva “Neuro-fuzzy Kolmogorov's network,” in Lecture Notes in Computer Science, vol. 3697, W. Duch, J. Kacprzyk, E. Oja, and S. Zadrozny, Eds., Berlin-Heidelberg: Springer-Verlag, pp. 1-6, 2005.

  • [15] T. Yamakawa, “A novel nonlinear synapse neuron model guaranteeing a global minimum-Wavelet Neuron,” Proceedings. 1998 28th IEEE International Symposium on Multiple- Valued Logic (Cat. No. 98CB36138). https://doi.org/10.1109/ismvl.1998.679510

  • [16] E. Uchino and T. Yamakawa, “Soft Computing Based Signal Prediction, Restoration, and Filtering,” Intelligent Hybrid Systems, pp. 331-351, 1997. https://doi.org/10.1007/978-1-4615-6191-0_14

  • [17] T. Yamakawa, E. Uchino, T. Miki and H. Kusanagi, “A neo-fuzzy neuron and its applications to system iden-tification and prediction of the system behavior,” in Proc. of 2-nd Int. Conf. on Fuzzy Logic and Neural Networks “IIZUKA-92”, Iizuka, Japan, pp. 477-483, 1992.

  • [18] J. -S. R. Jang, C. T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. N.J.: Prentice Hall, 1997.

  • [19] Y. Yam, H. T. Nguyen, and V. Kreinovich, “Multi-resolution techniques in the rules-based intelligent control systems: a universal approximation result,” Proceedings of the 1999 IEEE International Symposium on Intelligent Control Intelligent Systems and Semiotics (Cat. No. 99CH37014), 1999. https://doi.org/10.1109/isic.1999.796657

  • [20] UCI Repository of machine learning databases. CA: University of California, Department of Information and Computer Science. [Online]. Available: http://www.ics.uci.edu/~mlearn/MLRepository.html

Information Technology and Management Science

The Journal of Riga Technical University

Journal Information

Metrics

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 36 36 25
PDF Downloads 7 7 5