Affiliations: Institute for Statistics and Mathematics, Vienna University of Economics and Business, Building D4, Level 4, Welthandelsplatz 1, 1020 Vienna, Austria. Löfflerweg 9, 7100 Neusiedl/See, Austria. Tel.: +43 676 9379337; E-mail: peter.g.hackl@gmail.com
Abstract: New data sources are becoming available, in particular as
a consequence of the enormously growing use of electronic media. These new
data sources, often called the Big Data, open new opportunities for official
statistics: Statistical products may be delivered in shorter time, with more
detailed breakdowns, at lesser costs, and with reduced response burden. The
paper gives a short overview of Big Data pilots and projects conducted in
official statistics at national and international levels. The experiences
from these projects in using the new data sources indicate that there is no
uniform methodological approach for using the new data in the various
statistical domains nor to take advantage of the new opportunities. Official
statistics cannot expect that Big Data will substitute actual data sources
like data from surveys and administration, but they may play a role as
supplements for existing data in the production of certain statistics. A
number of challenges are involved in using Big Data in official statistics:
Solutions for methodological and technological issues are needed, a quality
framework must be developed, and the staff has to get acquainted with new
skills. Further issues concern the statistical environment such as
legislative requirements, costs of sourcing of Big Data, and privacy, and
have only indirectly to do with the statistical production. Finding
solutions for these issues and developing standards that will be accepted
internationally may require substantial efforts and take some time.
Keywords: Big Data, official statistics, international initiatives, Big Data pilots, challenges
