Big data implementation for price statistics in Indonesia: Past, current, and future developments

Article type: Research Article

Authors: Pramana, Setia^{a; b; *} | Mariyah, Siti^a | Takdir, ^a

Affiliations: [a] Politeknik Statistika STIS Jakarta Indonesia | [b] BPS Statistics Indonesia

Correspondence: [*] Corresponding author: Setia Pramana, Politeknik Statistika STIS Jakarta Indonesia. E-mail: setia.pramana@stis.ac.id.

Abstract: The rapid development of Big Data as result of increasing interactivity with online systems between humans (e.g., online shopping, marketplace) and machine (internet of things, mobile phone, etc.) has led to a measurement revolution. This massive data if being mined and analyzed correctly can provide valuable alternative data sources for official statistics, especially price statistics. Several studies for using diverse Big Data as new sources of price statistics in Indonesia have been initiated. This article would provide a comprehensive review of experiences in exploiting various Big Data sources for price statistics, followed by the current development and the near future plans. The development of system and IT infrastructure is also discussed. Based on this experience, limitations, challenges, and advances for each approach would be presented.

Keywords: Price statistics, Big Data, web scraping, crowdsourcing

DOI: 10.3233/SJI-200740

Journal: Statistical Journal of the IAOS, vol. 37, no. 1, pp. 415-427, 2021