Business Data Collection: Toward Electronic Data Interchange. Experiences in Portugal, Canada, Sweden, and the Netherlands with EDI

Open access

Abstract

This article discusses the experience and the ideas of National Statistical Institutes from four countries – Portugal, Sweden, Canada, and the Netherlands – in order to build a fully automated data collection system, to provide a system-to-system (S2S) data exchange or Electronic Data Interchange (EDI) between all stakeholders in the production chain. This joint work is a summary of an invited session at the Fifth International Conference on Establishment Surveys, which was devoted to ‘the future of business data collection’. Taken together, the four presentations provide an overview of recent experiences with S2S/EDI data collection for financial business data. The basis for such a system is an integrated unbroken digital information chain that runs from the recording of financial data in computerised administrative systems of individual businesses all the way to publishing economic statistics – the Business Information Chain. This chain can be ‘closed’ and made into a cycle by including a feedback loop, for example by providing benchmark data to businesses. However, to make it happen, technical standardisation, vertical and horizontal conceptual harmonisation between all partners in the chain, and positive business cases for all partners are needed. The article starts by putting EDI developments in historical perspective.

Baker, R., J.M. Brick, N.A. Bates, M. Battaglia, M.P. Couper, J.A. Dever, K.J. Gile, and R. Tourangeau 2013. “Summary Report of the AAPOR Task Force on Non-probability Sampling.” Journal of Survey Statistics and Methodology 2013(I): 90–143. Doi: https://doi.org/10.1093/jssam/smt008

Bakker, B.F.M. and P.J.H. Daas 2012. “Methodological Challenges in Register-Based Research.” Statistica Neerlandica (special issue) 66(1): 2–7. Doi: http://dx.doi.org/10.1111/j.1467-9574.2011.00505.x

Bavdaz, M. 2010. “Sources of Measurement Errors in Business Surveys.” Journal of Official Statistics 16(1): 25–42.

Bharosa N., R. van Wijk, N. de Winne, and M. Janssen (eds) 2015. Challenging the Chain. Governing the automated exchange and processing of business information. Amsterdam: IOS Press, Available at: www.iospress.nl/book/challenging-the-chain/ (accessed 19 April 2018).

Biemer, P.P. and L.E. Lyberg. 2003. Introduction to Survey Quality. Hoboken, NJ: Wiley.

Born, A. 2016. “Harmonizing Financial Information from Businesses at Statistics Canada.” In Proceedings of the Fifth International Conference of Establishment Surveys: Statistics (ICESV) Switzerland, 20-23 June 2016, Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/146_ices15Final00226.pdf (accessed 19 April 2018).

Buiten, G., R. Boom, M. Roos, and G. Snijkers 2016. “Issues in Automated Financial Data Collection in The Netherlands”. In Proceedings of the Fifth International Conference of Establishment Surveys: Statistics (ICESV) Switzerland, 20-23 June 2016, Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/148_ices15Final00209.pdf (accessed 19 April 2018).

Clayton, R.L., M.A. Searson, and Ch. D. Manning. 2000. “Electronic Data Collection in Selected BLS Establishment Programs.” In Proceedings of the Second International Conference of Establishment Surveys (ICESII), Montreal, 18-21 June 2000, 439–448. Alexandria, VA: American Statistical Association. Available at: http://ww2.amstat.org/meetings/ices/2000/proceedings/S08.pdf (accessed 19 April 2018).

Couper, M.P., R.P. Baker, J. Bethlehem, C.Z.F. Clark, J. Martin, W.L. Nicholls II, and J.M. O’Reilly. 1998. Computer Assisted Survey Information Collection. New York: Wiley.

Couper, M.P. and W.L. Nicholls II. 1998. The History and Development of Computer Assisted Survey Information Collection Methods. Computer Assisted Survey Information Collection, edited by M.P. Couper, R.P. Baker, J. Bethlehem, C.Z.F. Clarck, J. Martin, W.L. Nicholls II, and J.M. O’Reilly, 1–21. New York: Wiley.

Daas, P., M. Puts, B. Buelens, and P. van den Hurk. 2015. “Big Data as a Source for Official Statistics.” Journal of Official Statistics 31(2): 249–262. Doi: https://doi.org/10.1515/jos-2015-0016.

Daas, P., S. Ossen, M. Tennekes, L.-C. Zhang, C. Hendriks, K. Foldal Haugen, A. Bernardi, F. Cerroni, T. Laitila, A. Wallgren, and B. Wallgren 2011. List of Quality Groups and Indicators Identified for Administrative Data Sources. Luxembourg: Eurostat (BLUE-ETS deliverable 4.1).

De Bolster, G.W. and K.J. Metz. 1997. The TELER-EDISENT project. Netherlands Official Statistics (Special issue on EDI: The State of the Dutch Art): 12 (autumn), 51–59. Voorburg/Heerlen: Statistics Netherlands.

Di Consiglio, L., M. Karlberg, M. Skaliotis, and I. Xirouchakis. 2016. “Overview of Big-Data Research in European Statistics Agencies.” In Proceedings of the Fifth International Conference of Establishment Surveys: Statistics (ICESV) Switzerland, 20-23 June 2016, Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/187_ices15Final00346.pdf (accessed 19 April 2018).

Erikson, A.-G., J. Erikson, and C. Hertzman 2016. “Automated Data Collection and Reuse of Concepts in Order to Minimise the Burden.” In Proceedings of the Fifth International Conference of Establishment Surveys: Statistics (ICESV) Switzerland, 20-23 June, Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/147_ices15Final00184.pdf (accessed 19 April 2018).

Erikson, J. and L. Nordberg. 2000. “Use of Administrative Data as Substitutes for Survey Data for Small Enterprises in the Swedish Annual Structural Business Statistics.” In Proceedings of the Second International Conference of Establishment Surveys (ICESII), Buffalo, NY, 17-21 June 2000, 813–820. Alexandria, VA: American Statistical Association. Available at: http://ww2.amstat.org/meetings/ices/2000/proceedings/S28.pdf (accessed 19 April 2018).

European Commission 2016. European Standards for the 21st Century. Brussels: European Commission. Available at: http://ec.europa.eu/DocsRoom/documents/16980 (accessed 19 April 2018).

Eurostat. 2010. Business registers: Recommendations manual. Luxembourg: Eurostat. Available at: http://ec.europa.eu/eurostat/ramon/statmanuals/files/KS-32-10-216-EN-C-EN.pdf.

Eurostat, 2017. Smart Statistics. Paper discussed at the Joint Dime/ITDG plenary sessions, 14-15 February 2017. Luxembourg: Eurostat.

Groves, R.M. 2011. “Three Eras of Survey Research.” Public Opinion Quarterly, 75(5): 861–871. Doi: https://doi.org/10.1093/poq/nfr057.

Groves, R.M. 2013. Official Statistics and “Big Data”. Paper presented at the 2013 European Conference for New Techniques and Technologies for Statistics (NTTS), Brussels, 5-7 March 2013. Luxembourg: Eurostat.

Groves, R.M., F.J. Fowler, M.P. Couper, J.M. Lepkowski, E. Singer, and R. Tourangeau. 2009. Survey Methodology, 2nd edition. Hoboken, NJ: Wiley.

Hansen, J.V. and N.C. Hill. 1989. “Control and Audit of Electronic Data Interchange.” MIS Quarterly 13(4): 403–414. Available at: http://aisel.aisnet.org/misq/vol13/iss4/2/ (accessed 19 April 2018).

Haraldsen, G. 2013. “Quality Issues in Business Surveys.” In Designing and Conducting Business Surveys, edited by G. Snijkers, G. Haraldsen, J. Jones, and D.K. Willimack, 83–125. Hoboken, NJ: Wiley.

Haraldsen, G., J. Jones, D. Giesen, and L.-Ch. Zhang 2013. “Understanding and Coping with Response Burden.” In Designing and Conducting Business Surveys, edited by G. Snijkers, G. Haraldsen, J. Jones, and D.K. Willimack, 219–252. Hoboken, NJ: Wiley.

Haraldsen, G., G. Snijkers, M. Roos, A. Sundvoll, T. Vik, and H.-P. Stax. 2011. Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch and Danish Experiences, Paper presented at the 2011 European Conference for New Techniques and Technologies for Statistics (NTTS), Brussels, 22-24 February 2011. Luxembourg: Eurostat.

Johnson, N. 2016. “One hundred years of Current Employment Statistics Data collection.” Monthly Labor Review: January 2016. Washington DC: US Bureau of Labor Statistics.

Lunter. L. 1997. EDIsent after the pilot phase (in Dutch: EDIsent na de pilot fase). Report. Voorburg: Statistics Netherlands.

Martineau, P. 2012. Use of the Chart of Accounts in determining the content of Statistics Canada business surveys. Internal document. Ottawa: Statistics Canada.

Pereira, H.J. 2011. “Simplified Business Information (IES) – Is coordination between public entities really possible.” In Proceedings of the International BLUE-ETS Conference on Burden and Motivation in Official Business Surveys Heerlen, 22-23 March 2011, 177–188. Heerlen: Statistics Netherlands. Available at: https://www.blue-ets.istat.it/index.php?id=78&tx_ttnews%5Btt_news%5D=25&cHash=75a34e2a1c989b918ff346a3911c90fc (accessed 19 April 2018).

Ravindra, D. 2016. “Challenges and Benefits of Producing Business Statistics within a Highly Centralized Model.” In Proceedings of the Fifth International Conference of Establishment Surveys (ICESV), 20-23 June 2016. Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/153_ices15Final00050.pdf (accessed 19 April 2018).

Reid, G., F. Zabala, and A. Holmberg 2017. “Extending TSE to Administrative Data: A Quality Framework and Case Study from Stats NZ.” Journal of Official Statistics 33(2): 477–511, Doi: https://doi.org/10.1515/jos-2017-0023

Saraiva, P. 2016a. Integrated Survey Management System: Statistics Portugal Experience. Presentation at the Fifth International Conference of Establishment Surveys (ICESV), 20-23 June 2016, Geneva, Switzerland. Statistics Switzerland.

Saraiva, P. 2016b. The Experience of Statistics Portugal in the Appropriation of Administrative Data for Statistical Purposes. Invited presentation (in Portuguese) at the 3rd National Conference of Producers and users of Statistics, Geographical and Environmental Information (INFOPLAN). IBGE, December 5-9, 2016, Rio de Janeiro, Brazil.

Saraiva, P. 2016c. Integrating Data Collection: Wins and Challenges. Presentation at the UNECE Workshop on Statistical Data Collection, ‘Visions on Future Surveying’, Statistics Netherlands, The Hague, 1-5 October 2016. Geneva: United Nations Economic Commission for Europe (UNECE).

Saraiva, P. and A. Moreira. 2016. Motivating Respondents: the Importance of Personalised Feedback. Presentation at the UNECE Workshop on Statistical Data Collection, ‘Visions on Future Surveying’, Statistics Netherlands, The Hague, 1-5 October 2016. Geneva: United Nations Economic Commission for Europe (UNECE).

Smith, P. and P. Phipps. 2014. Preface. Journal of Official Statistics (Special Issue on Establishment Surveys) 30(4): 575–577. Doi: https://doi.org/10.2478/jos-2014-0038

Snijkers, G. 2016. “Achieving Quality in Organizational Surveys: An Holistic Approach.” In Methodische Probleme in der empirischen Organisationsforschung, edited by S. Liebig and W. Matiaske, 33–59. Wiesbaden: Springer.

Snijkers, G., R. Göttgens, and H. Hermans. 2011. Data Collection and Data Sharing at Statistics Netherlands: Yesterday, Today, Tomorrow, Paper presented at the 59th Plenary Session of the Conference of European Statisticians (CES): United Nations Economic Commission for Europe (UNECE), Geneva, June 14–16. Geneva: UNECE Available at: www.unece.org/fileadmin/DAM/stats/documents/ece/ces/2011/20.e.pdf.

Snijkers, G., G. Haraldsen, J. Jones, and D.K. Willimack. 2013. Designing and Conducting Business Surveys. Hoboken, NJ: Wiley.

Snijkers, G. and J. Jones. 2013. “Business Survey Communication.” Designing and Conducting Business Surveys, edited by G. Snijkers, G. Haraldsen, J. Jones, and D.K. Willimack, 359–430. Hoboken, NJ: Wiley.

Snijkers, G., M. Roos, T. Hooijmans, Th. van Kasteren, M. Storms, V. de Haan, and G. Buiten. 2014. Reference Chart of Accounts (RCSFI): a case study – toward a quality framework (in Dutch: Referentie Grootboekschema (RGS): een casestudie – aanzet tot een kwaliteitskader). Report. Heerlen: Statistics Netherlands.

Srinivasan, V. 2017. The Intelligent Enterprise in the Era of Big Data. Hoboken, NJ: Wiley.

Statistics Canada 2015. Integrated Business Statistics Program Overview. Catalogue No. 68-515-X. Ottawa: Statistics Canada, Available at: http://www.statcan.gc.ca/pub/68-515-x/2015001/mi-rs-eng.htm.

Thomas, R. and P. McSharry 2015. Big Data Revolution: What Farmers, Doctors and Insurance Agents Tell Us about Discovering Big Data Patterns. Hoboken, NJ: Wiley.

Torres van Grinsven, V., I. Bolko, and M. Bavdaz. 2014. “In Search of Motivation for Business Survey Response Task.” Journal of Official Statistics, 30(4): 579–606. Doi: https://doi.org/10.2478/jos-2014-0039

UNECE 1995. Guidelines for the Modelling of Statistical Data and Metadata. Geneva: United Nations Economic Commission for Europe (UNECE), Available at: https://www.unece.org/fileadmin/DAM/stats/publications/metadatamodeling.pdf (accessed 19 April 2018).

UNECE. 2000. Terminology on Statistical Metadata. Geneva: United Nations Economic Commission for Europe (UNECE). Available at: http://ec.europa.eu/eurostat/ramon/coded_files/UNECE_TERMINOLOGY_STAT_METADATA_2000_EN.pdf

UNECE. 2007. Register-based statistics in the Nordic countries: review of best practices with focus on population and social statistics. Geneva: United Nations Economic Commission for Europe (UNECE). Available at: http://www.unece.org/fileadmin/DAM/stats/publications/Register_based_statistics_in_Nordic_countries.pdf.

UNECE. 2011. Using Administrative and Secondary Sources for Official Statistics: A Handbook of Principles and Practices. Geneva: United Nations Economic Commission for Europe. Available at: https://www.unece.org/fileadmin/DAM/stats/publications/Using_Administrative_Sources_Final_for_web.pdf (accessed 19 April 2018).

Wallgren, A. and B. Wallgren 2007. Register-Based Statistics – Administrative Data for Statistical Purposes. Hoboken, NJ: Wiley.

Willimack, D.K. and G. Snijkers. 2013. “The Business Context and its Implications for the Business Response Process.” In Designing and Conducting Business Surveys, edited by G. Snijkers, G. Haraldsen, J. Jones, and D.K. Willimack, 39–82. Hoboken, NJ: Wiley.

Ypma, W.F.H., A.J. Willeboordse, and W.J. Keller. 1997, EDI in the collection of statistical data: an introduction. Netherlands Official Statistics (Special issue on EDI: The State of the Dutch Art) 12 (autumn): 7–15. Voorburg/Heerlen: Statistics Netherlands.

Zhang. L.-C. 2012. “Topics of Statistical Theory for Register-Based Statistics and Data Integration.” Statistica Neerlandica, 66(1): 41–63. Doi: http://dx.doi.org/10.1111/j.1467-9574.2011.00508.x

Journal of Official Statistics

The Journal of Statistics Sweden

Journal Information


IMPACT FACTOR 2017: 0.662
5-year IMPACT FACTOR: 1.113

CiteScore 2017: 0.74

SCImago Journal Rank (SJR) 2017: 1.158
Source Normalized Impact per Paper (SNIP) 2017: 0.860

Metrics

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 496 496 75
PDF Downloads 299 299 57