Evaluation of Business Intelligence Projects Success – a Case Study

Open access


Background: Many studies found in literature only focus on specific aspects of the evaluation of the success of projects, such as the criteria for evaluation; and just a few are focused on the activities for evaluating success. Objectives: The goal of the paper is to present the process for evaluating the success of Business Intelligence (BI) projects in a large company. Methods/Approach: An exploratory case study was carried out at Tintas Robbialac, SA, a Portuguese company of the paint industry. Results: The specific company approach for evaluating the success of BI projects is presented and discussed. Conclusions: The process for evaluating the success of BI, as well as the evaluation criteria, should be formally defined; and the success should be evaluated and monitored along all the project lifecycle.

If the inline PDF is not rendering correctly, you can download the PDF file here.

  • 1. Ardimento P. Convertini V. N. Visaggio G. (2013) “Building a knowledge experience base for facilitating innovation” International Journal of E-Services and Mobile Applications (IJESMA) Vol. 5 No. 4 pp. 40-49.

  • 2. Besteiro É. N. C. de Souza Pinto J. Novaski O. (2015) “Success Factors in Project Management” Business and Management Dynamics Vol. 4 No. 9 pp. 19-34.

  • 3. Bosilj Vukšić V. Pejić-Bach M. Popovič A. (2013) “Supporting performance management with business process management and business intelligence: A case analysis of integration and orchestration” International journal of information management Vol. 33 No. 4 pp. 613-619.

  • 4. Chaudhuri S. Dayal U. Narasayya V. (2011) “An overview of business intelligence technology” Communications of the ACM Vol. 54 No. 8 pp. 88-98.

  • 5. Cheng J. L. C. McKinley W. (1983) “Toward an Integration of Organization Research and Practice: A Contingency Study of Bureaucratic Control and Performance in Scientific Settings” Administrative Science Quarterly Vol. 28 No. 1 pp. 85-100.

  • 6. Collins A. Baccarini D. (2004) “Project Success – A survey” Journal of Construction Research Vol. 5 No. 2 pp. 211-231.

  • 7. de Carvalho M. M. Patah L. A. de Souza Bido D. (2015) “Project management and its effects on project success: Cross-country and cross-industry comparisons” International Journal of Project Management Vol. 33 No. 7 pp. 1509-1522.

  • 8. Dobrev K. Hart M. (2015) “Benefits Justification and Implementation Planning of Real-Time Business Intelligence Systems” Electronic Journal of Information Systems Evaluation Vol. 18 No. 2 pp. 104-118.

  • 9. Evans J. R. (2015) “Modern Analytics and the Future of Quality and Performance Excellence” Quality Management Journal Vol. 22 No. 4 pp. 6-17.

  • 10. Fourati-Jamoussi F. Niamba C. N. (2016) “An evaluation of business intelligence tools: a cluster analysis of users’ perceptions” Journal of Intelligence Studies in Business Vol. 6 No. 1 pp. 37-47.

  • 11. Foster K. Smith G. Ariyachandra T. Frolick M. N. (2015) “Business Intelligence Competency Center: Improving Data and Decisions” Information Systems Management Vol. 32 No. 3 pp. 229-233.

  • 12. Gable G. G. Sedera D. Chan T. (2008) “Re-conceptualizing Information System Success: The IS-Impact Measurement Model” Journal of the Association for Information Systems Vol. 9 No. 7 pp. 377-408.

  • 13. Gemünden H. D. (2015) “Success Factors of Global New Product Development Programs the Definition of Project Success Knowledge Sharing and Special Issues of Project Management Journal” Project Management Journal Vol. 46 No. 1 pp. 2-11.

  • 14. Greco M. Grimaldi M. Hanandi M. (2013) “How to select knowledge management systems: a framework to support managers” International Journal of Engineering Business Management Vol. 5 available at: http://journals.sagepub.com/doi/full/10.5772/56003 (28 May 2018).

  • 15. Grenci R. (2015) “Incorporating Business Intelligence into Marketing and Management-related coursework” Academic of Educational Leadership Journal Vol. 19 No. 1 pp. 217-226.

  • 16. Ika L. A. (2009) “Project Success as a Topic in Project Management Journals” Project Management Journal Vol. 40 No. 4 pp. 6–19.

  • 17. Istrat V. Starvisavljev S. Markoski B. (2015) “The Role of Business Intelligence in Decision-making” The European Journal of Applied Economics Vol. 12 No. 2 pp. 44–52.

  • 18. Ivan M. L. (2014) “Characteristics of In-Memory Business Intelligence” Informatica Economică Journal Vol. 18 No. 3 pp. 17-25.

  • 19. Khan R. A. Quadri S. M. K. (2012) “Business intelligence: an integrated approach” Business Intelligence Journal Vol. 5 No. 1 pp. 64-70.

  • 20. Khang D. B. Moe T. L. (2008) “Success Criteria and Factors for International Development Projects: A Life-Cycle-Based Framework” Project Management Journal Vol. 39 No. 1 pp. 72-84.

  • 21. Loebbecke C. Thomas B. (2016) “Developing and enforcing internal information systems standards: InduMaker’s standards management process” International Journal of Information Systems and Project Management Vol. 4 No. 1 pp. 5-24.

  • 22. Morio J. (2014) “Linking Business Intelligence to Strategy” Financial Executive Vol. 30 No. 4 pp. 66-70.

  • 23. Nenni M. E. Arnone V. Boccardelli P. Napolitano I. (2014) “How to increase the value of the project management maturity model as a business-oriented framework” International Journal of Engineering Business Management Vol. 6 No. 8 pp. 1-7.

  • 24. Nyblom M. Behrami J. Nikkilä T. Søilen K. S. (2012) “An evaluation of Business Intelligence Software systems in SMEs – a case study” Journal of Intelligence Studies in Business Vol. 2 No. 2 pp. 51-57.

  • 25. Obeidat M. North M. Richardson R. Rattanak V. North S. (2015) “Business Intelligence Technology Applications and Trends” International Management Review Vol. 11 No. 2 pp. 47-56.

  • 26. Pejić-Bach M. Zoroja J. Čeljo A. (2017) “An extension of the technology acceptance model for business intelligence systems: project management maturity perspective” International Journal of Information Systems and Project Management Vol. 5 No. 2 pp. 5-21.

  • 27. Pejić-Bach M. Jaklič J. Vugec D. S. (2018) “Understanding impact of business intelligence to organizational performance using cluster analysis: does culture matter?” International Journal of Information Systems and Project Management Vol. 6 No. 3 pp. 63-86.

  • 28. Pelegrini F. G. Jordão R. V. D. Jeunon E. E. Jordão A. C. T. (2015) “Fatores Críticos Na Gestão De Projetos: Um Estudo De Caso Numa Empresa De Grande Porte” Gestão & Produção Vol. 22 No. 2 pp. 280-294.

  • 29. Petter S. DeLone W. McLean E. R. (2012) “The Past Present and Future “IS Success”” Journal of the Association for Information Systems Vol. 13 pp. 341-362.

  • 30. Rechenthin D. (2013) Project Intelligence Project Management Institute Newtown Square Pennsylvania.

  • 31. Rusaneanu A. (2013) “Comparative Analysis of the Main Business Intelligence Solutions” Informatica Economică Journal Vol. 17 No. 2 pp. 148-156.

  • 32. Schlegelmilch J. Albanese J. (2014) “Applying business intelligence innovations to emergency management” Journal of Business Continuity & Emergency Planning Vol. 8 No. 1 pp. 31-40.

  • 33. Schlesinger P. A. Rahman N. (2015) “Self-Service Business Intelligence Resulting in Disruptive Technology” Journal of Computer Information Systems Vol. 56 No. 1 pp. 11-21.

  • 34. Serra C. E. M. Kunc M. (2015) “Benefits Realization Management and its influence on project success and on the execution of business strategies” International Journal of Project Management Vol. 33 No. 1 pp. 53-66.

  • 35. Tavallaei R. Shokohyar S. Moosvi S. M. Sarfi Z. (2015) “Assessing the Evaluation Models of Business Intelligence Maturity and Presenting an Optimized Model” International Journal of Management Accounting and Economics Vol. 2 No. 9 pp. 1005-1019.

  • 36. Terzieva M. Morabito V. (2016) “Learning from experience: the project team is the key” Business Systems Research Journal Vol. 7 No. 1 pp. 1-15.

  • 37. Thamir A. Poulis E. (2015) “Business Intelligence Capabilities and Implementation Strategies” International Journal of Global Business Vol. 8 No. 1 pp. 34–35.

  • 38. Teixeira A. Oliveira T. Varajão J. (2018) “Evaluation of Business Intelligence Project Success in Tintas Robbialac: work-in-progress” ENTRENOVA 6-8 September Croatia.

  • 39. Todorović M. L. Petrović D. Č. Mihić M. M. Obradović V. L. Bushuyev S. D. (2015) “Project success analysis framework: A knowledge-based approach in project management” International Journal of Project Management Vol. 33 No. 4 pp. 772-783.

  • 40. Tomasura M. (2015) “Business Intelligence Design Using an Interdisciplinary Approach” Business Intelligence Journal Vol. 20 No. 1 pp. 44-50.

  • 41. Varajão J. (2016) “Success Management as a PM knowledge area – work-in-progress” Procedia Computer Science Vol. 100 pp. 1095-1102.

  • 42. Varajão J. (2018) “A new process for success management – bringing order to a typically ad-hoc area” Journal of Modern Project Management Vol. 5 No. 3 pp. 94-99.

  • 43. Varajão J. Magalhães L. Freitas L. Ribeiro P. Ramos J. (2018) “Implementing Success Management in an IT project” Procedia Computer Science Vol. 138 pp. 891-898.

  • 44. Varajão J. Trigo A. (2016) “Evaluation of IS project success in InfSysMakers: an exploratory case study” in Proceedings of 37th International Conference on Information Systems Dublin Ireland Association for Information Systems pp. 1-10.

  • 45. Westfall R. D. (2012) “An Employment-Oriented Definition of the Information Systems Field: An Educator’s View” Journal of Information Systems Education Vol. 23 No. 1 pp. 63-70.

Journal information
Impact Factor

CiteScore 2018: 0.57

SCImago Journal Rank (SJR) 2018: 0.165
Source Normalized Impact per Paper (SNIP) 2018: 0.388

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 334 334 73
PDF Downloads 316 316 61