Evolution of the Concept Map Based Adaptive Knowledge Assessment System: Implementation and Evaluation Results
The paper represents the concept map based adaptive knowledge assessment system. Advantages of concept maps are analyzed emphasizing that the approach offers a reasonable balance between requirements to assess higher levels of knowledge according to Bloom's taxonomy and complexity of a system. Concept maps allow revealing of student's knowledge structure, promote system thinking and support process oriented learning where a study course is divided into stages in each of which knowledge assessment is carried out. The developed knowledge assessment system consists from a teacher's, learner's and administrator's modules and is implemented as a multiagent system. Four prototypes of the system developed within four projects are described. The first prototype supports only fill-in-the-map tasks where a learner must put given concepts in correct places. The second prototype provides changing the degree of task difficulty, thus, performing adaptation to a learner's knowledge level. The set of tasks are also extended by construct-the-map tasks. Improvements implemented in the third prototype allow using of directed arcs and standard relationships in concept maps. The three-tier architecture used in the fourth prototype is chosen to rise the security level of the system. Besides that learner's support is considerably expanded giving help and tutoring to a learner. Results of evaluation of the developed system's prototypes in different study courses are presented. The paper concludes with the comparison of all four prototypes using all main characteristics of the developed knowledge assessment system.
If the inline PDF is not rendering correctly, you can download the PDF file here.
Waterhouse S. The Power of e-Learning: the Essential Guide for Teaching in the Digital Age. - Allyn&Bacon, 2004. - P.288.
da Rocha F. E. L., da Costa Jr. J. V., Favero E. L. An Approach to Computer-Aided Learning Assessment // Proceedings of the Third International Conference on Concept Mapping. - 2008. - P.170-177.
Bloom B. S. Taxonomy of Education Objectives. Handbook I: the Cognitive Domain. - New York: David McKay Co Inc., 1956. - P.207.
Ausubel D. P. Educational Psychology: A Cognitive View. - New York: Holt, Rinehart and Winston, 1968. - P.685.
Ausubel D. P. The Acquisition and Retention of Knowledge. - New York: Kluwer Academic Publishers, 2000. - P.232.
Novak J. D., Gowin D. B. Learning How to Learn. - New York: Cornell University Press, 1984. - P.150.
Novak J. D. Learning, Creating, and Using Knowledge: Concept Maps as Facilitative Tools in Schools and Corporations. - New Jersey: Lawrence Erlbaum Associates, 1998. - P.272.
Ahlberg M. Varieties of Concept Mapping // Proceedings of the First International Conference on Concept Mapping, Pamplona, Spain, 2004.
Cañas A. J. A Summary of Literature Pertaining to the Use of Concept Mapping Techniques and Technologies for Education and Performance Support // Technical Report Submitted to the Chief of Naval Education and Training. - 2003. - P.108.
da Rocha F. E. L., Favero E. L. CMTool: A Supporting Tool for Conceptual Map Analysis // Proceedings of World Congress on Engineering and Technology Education. - 2004.
Grundspenkis J. Development of Concept Map Based Adaptive Knowledge Assessment System // Proceedings of IADIS International Conference on e-Learning. - 2008. - P.295-402.
Ruiz-Primo M. A. Examining Concept Maps as an Assessment Tool // Proceedings of the First International Conference on Concept Mapping. - 2004.
Anohina A., Grundspenkis J. A Concept Map Based Intelligent System for Adaptive Knowledge Assessment // Frontiers in Artificial Intelligence and Applications, Vol. 155, Databases and Information Systems IV. - Amsterdam: IOS Press, 2007. - P.263-276.
Graudina V. OWL Ontology Transformation into Concept Map // Scientific Proceedings of Riga Technical University. 5th series. Computer Science. Applied Computer Systems. - Vol. 34 (2008), P.81-90.
Anohina A., Grundspenkis J. Prototype of Multiagent Knowledge Assessment System for Support of Process Oriented Learning // Proceedings of the 7th International Baltic Conference on Databases and Information Systems. - 2006. - P.211-219.
Anohina A., Graudina V., Grundspenkis J. Using Concept Maps in Adaptive Knowledge Assessment // Advances in Information Systems Development, New Methods and Practice for the Networked Society. - Springer, 2006. - P.469-480.
Anohina A. Development of an Intelligent Supporting System for Adaptive Tutoring and Knowledge Assessment. Doctoral Thesis, Riga, 2007.
Anohina A., Lavendelis E., Grundspenkis J. Concept Map Based Assessment System with Reduction of Task Difficulty // Proceedings of the 16th International Conference on Information Systems Development. - 2007. - P.853-866.
Anohina A., Pozdnakovs D., Grundspenkis J. Changing the Degree of Task Difficulty in Concept Map Based Assessment System // Proceedings of the IADIS International Conference "e-Learning 2007". - 2007. - P.443-450.
Lukashenko R., Vilkelis M., Anohina A. Deciding on the Architecture of the Concept Map Based Knowledge Assessment System // Proceedings of the International Conference on Computer Systems and Technologies. - 2008. - P. V.3-1-V.3-6.
Anohina A., Grundspenkis J. Learner's Support in the Concept Map Based Knowledge Assessment System // Proceedings of the 7th International Conference on e-Learning. - 2008. - P.38-45.
Grundspenkis J., Strautmane M. Usage of Graph Patterns for Knowledge Assessment Based on Concept Maps (in this issue).