Making Big Data Small

CategoryPublications 207

Authors: Wenfei Fan

Published in: Royal Society A: Mathematical, physical and engineering sciences

Date of Publication: May 8, 2019


Big data analytics is often prohibitively costly and is typically conducted by parallel processing with a cluster of machines. Is big data analytics beyond the reach of small companies that can only afford limited resources? This paper tackles this question by presenting Boundedly EvAlable SQL (BEAS), a system for querying big relations with constrained resources. The idea is to make big data small. To answer a query posed on a dataset, it often suffices to access a small fraction of the data no matter how big the dataset is. In the light of this, BEAS answers queries on big data by identifying and fetching a small set of the data needed. Under available resources, it computes exact answers whenever possible and otherwise approximate answers with accuracy guarantees. Underlying BEAS are principled approaches of bounded evaluation and data-driven approximation, the focus of this paper.

View Full Text

Keywords2019Big data analytics under constrained resourcesRoyal Society AWenfei Fan Previous: Next: