Automatic Incremental Calculation
The dynamics of big data reflects in the continuous update. Bounded incremental calculation thus needs to meet the new requirement. That is to say, when the data changes, there is no need to restart the calculation. The last calculation result and the data updates produce the new calculation result. Because the calculation result and data updates are usually much smaller than the original data, the improvement of computational efficiency should be significant. At present, the incremental programs specially designed for a specific problem face high barriers to entry. We are working on an effective and universal incremental method, using program language, compilers, and algorithm skills to build an incremental program.
Research Areas
Focusing on big data incremental computing models and algorithms:
1) Characterize the effectiveness of an incremental algorithm and whether a general method exists to allow such characterization;
2) Use the boundedness of the incremental algorithm, to characterize the cost of incremental calculation through the variation between input and output flow;
3) Develop a general incremental method based on the boundedness of different incremental algorithms.
Related Publications
-
Incrementalizing Graph Algorithms
WenfeiFan, ChaoTian, RuiqiXu, QiangYin, WenyuanYu, JingrenZhou
"ACM Conference on Management of Data (SIGMOD 2021),June 20-25,2021, Xi'an, Shanxi, China"
-
Incrementalization of Graph Partitioning Algorithms
Wenfei Fan, Muyang Liu, Chao Tian, Ruiqi Xu, Jingren Zhou
International Conference on Very Large Data Bases (VLDB 2020), Aug 31- Sept 4, 2020, Tokyo, Japan
-
Effective and Efficient Relational Community Detection and Search in Large Dynamic Heterogeneous Information Networks
Xun Jian, Yue Wang, Lei Chen
International Conference on Very Large Data Bases (VLDB 2020), Aug 31- Sept 4, 2020, Tokyo, Japan
-
Fast and Accurate SimRank Computation via Forward Local Push and Its Parallelization
Yue Wang, Yulin Che, Xiang Lian, Lei Chen, Qiong Luo
IEEE Transactions on Knowledge and Data Engineering(TKDE 2020)