ERC Advanced Grant
Resource Bounded Graph Query Answering
The ERC project investigates querying big graphs with bounded
resources. The problem is challenging: real-life graphs are typically big,
with billions of vertices and trillions of edges; and graph computations
are expensive, even intractable. Add to these that we often have
constrained resources, such as available time and computing facilities.
It demands a departure from the traditional query evaluation techniques
and even from the classical computational complexity theory. Indeed,
a linear scan of 1PB of data takes days, no longer a tractable query.
The project is to tackle these challenges, from fundamental problems to
practical techniques. We will propose graph query languages to unify
Web search and social search, and to support graph pattern association
rules for social media marketing. We will revise the conventional theory
of tractability and parallel scalability to cope with big data. We will develop
new algorithmic foundations and resource-constrained techniques for
querying big graphs, by ``making big data small''. When exact answers
are beyond reach in big data, we will develop data-driven and query-driven
approximation schemes to strike a balance between the accuracy and cost.
As a proof of the theory, we will develop GRACE, a system to query big
GRAphs within bounded resourCEs, based on the techniques proposed,
to support emerging applications such as social media marketing, social
search and knowledge bases. A breakthrough in this subject will advance
several fields, including big data, theory of computation, parallel computation,
and social network analysis.
Fundamental Research
-
Incremental Graph Computations: Doable and Undoable
ACM Transactions on Database Systems (TODS) ,
2022.
Wenfei Fan, Chao Tian
-
Incrementalizing Graph Algorithms
ACM SIGMOD Conference on Management of Data (SIGMOD),
2021.
Wenfei Fan,
Chao Tian, Qiang Yin, Ruiqi Xu, Wenyuan Yu, and
Jingren Zhou.
-
Graph Algorithms with Partition Transparency
IEEE Transactions on Knowledge and Data Engineering
(TKDE) , 2021.
Wenfei Fan,
Muyang Liu, Ping Lu, and
Qiang Yin
-
Unifying Logic Rules and Machine Learning for Entity Enhancing
SCIENCE CHINA Information Sciences (SCIS),
(invited), 2020.
Wenfei Fan,
Ping Lu, and
Chao Tian
-
Graph Algorithms: Parallelization and Scalability
SCIENCE CHINA Information Sciences (SCIS)
(invited), 2020.
Wenfei Fan,
Kun He, Qian Li, and Yue Wang.
-
Dependencies for Graphs
ACM Transactions on Database Systems (TODS) 44(2): 5:1-5:40
(invited), 2019.
Wenfei Fan,
and
Ping Lu.
-
Bounded Query Rewriting Using Views
ACM Transactions on Database Systems (TODS) 2018
(invited).
Yang Cao,
Wenfei Fan,
Floris Geerts,
and
Ping Lu.
-
Dependencies for Graphs
ACM Symposium on Principles of Database Systems (PODS), 2017
Wenfei Fan
and
Ping Lu.
-
Bounded Query Rewriting Using Views
ACM Symposium on Principles of Database Systems (PODS), 2016
Yang Cao,
Wenfei Fan,
Floris Geerts,
and
Ping Lu.
-
Querying Big Data by Accessing Small Data
ACM Symposium on Principles of Database Systems
(PODS), 2015
Wenfei Fan,
Floris Geerts,
Yang Cao,
Ting Deng,
and Ping Lu.
-
On Scale Independence for Querying Big Data
ACM Symposium on Principles of Database Systems
(PODS), 2014
Wenfei Fan,
Floris Geerts, and
Leonid Libkin
-
Making Queries Tractable on Big Data with Preprocessing.
The 39th International Conference on Very Large Data Bases (VLDB),
2013.
Wenfei Fan,
Floris Geerts,
Frank Neven,
Practical Techniques
-
Making Graphs Compact by Lossless Contraction
ACM SIGMOD Conference on Management of Data (SIGMOD),
2021.
Wenfei Fan,
Yuanhao Li, Muyang Liu, Can Lu.
-
Discrepancy Detection and Incremental Detection
The 47th International Conference on Very Large Data Bases (VLDB),
2021.
Wenfei Fan,
Chao Tian,
Yanghao Wang, Qiang Yin
-
Adaptive Asynchronous Parallelization of Graph Algorithms
ACM Transactions on Database Systems (TODS),
(invited), 2020.
Wenfei Fan,
Ping Lu,
Jingbo Xu, Wenyuan Yu,
Qiang Yin, Xiaojian Luo,
Jingren Zhou,
and Ruochun Jin.
-
Application Driven Graph Partitioning
ACM SIGMOD Conference on Management of Data (SIGMOD),
2020.
Wenfei Fan,
Ruochun Jin, Muyang Liu, Ping Lu, Xiaojian Luo,
Ruiqi Xu, Qiang Yin, Wenyuan Yu, and
Jingren Zhou
-
Querying Shared Data with Security Heterogeneity
ACM SIGMOD Conference on Management of Data (SIGMOD),
2020.
Yang Cao,
Wenfei Fan,
Yanghao Wang, and Ke Yi.
-
Extending Graph Patterns with Conditions
ACM SIGMOD Conference on Management of Data (SIGMOD),
2020.
Grace Fan,
Wenfei Fan,
Yuanhao Li, Ping Lu,
Chao Tian, and
Jingren Zhou
-
Discovering Graph Functional Dependencies
ACM Transactions on Database Systems (TODS),
2020.
Wenfei Fan,
Chunming Hu ,
Xueli Liu, and
Ping Lu.
-
Bounded Evaluation: Querying Big Data with Bounded Resources
International Journal of Automation and Computing (IJAC),
(invited), 2020.
Yang Cao,
Wenfei Fan,
Tengfei Yuan.
-
Incrementalization of Graph Partitioning Algorithms
The 46th International Conference on Very Large Data Bases (VLDB
),
2020.
Wenfei Fan,
Muyang Liu,
Chao Tian,
Ruiqi Xu, and
Jingren Zhou
-
Capturing Associations in Graphs
The 46th International Conference on Very Large Data Bases (VLDB),
2020.
Wenfei Fan, Ruochun Jin,
Muyang Liu, Ping Lu,
Chao Tian,
Jingren Zhou
-
Dynamic Scaling for Parallel Graph Computations
The 45th International Conference on Very Large Data Bases (VLDB) ,
2019.
Wenfei Fan,
Chunming Hu, Muyang Liu,
Ping Lu,
Qiang Yin,
Jingren Zhou
-
Block as a Value for SQL over NoSQL
The 45th International Conference on Very Large Data Bases
(VLDB),
2019.
Yang Cao,
Wenfei Fan,
and Tengfei Yuan,
-
Adaptive Asynchronous Parallelization of Graph Algorithms
ACM SIGMOD Conference on Management of Data (SIGMOD),
2018.
Wenfei Fan,
Ping Lu, Xiaojian Luo, Jingbo Xu, Qiang Yin,
Wenyuan Yu, and Ruiqi Xu.
-
Parallelizing Sequential Graph Computations
ACM Transactions on Database Systems (TODS) 43(4): 18:1-18:39, 2018
(invited).
Wenfei Fan,
Jingbo Xu ,
Wenyuan Yu ,
Jingren Zhou,
Xiaojian Luo, Ping Lu, Qiang Yin,
Yang Cao,
and Ruiqi Xu
-
From Think Parallel to Think Sequential
SIGMOD Record 47(1): 15-22,
2018 (SIGMOD 2017 Research Highlight Award
).
Wenfei Fan,
Yang Cao,
Jingbo Xu ,
Wenyuan Yu,
Yinghui Wu,
Chao Tian,
Jiaxin Jiang,
and
Bohan Zhang,
-
Think Sequential, Run Parallel
Symposium on Real-Time and Hybrid Systems,
LNCS 11180, Springer, 2018.
Wenfei
Fan, Muyang Liu, Ruiqi Xu, Lei Hou,
Dongze Li, Zizhong Meng.
-
Parallelizing Sequential Graph Computations
ACM SIGMOD Conference on Management of Data (SIGMOD),
2017 (the Best Paper Award)
Wenfei Fan,
Jingbo Xu ,
Yinghui Wu,
Wenyuan Yu,
Jiaxin Jiang,
Zeyu Zheng,
Bohan Zhang,
Yang Cao, and
Chao Tian.
-
Incremental Graph Computations: Doable and Undoable
ACM SIGMOD Conference on Management of Data (SIGMOD),
2017.
Wenfei Fan,
Chunming Hu,
and
Chao Tian.
-
Data Driven Approximation with Bounded Resources
The 43rd International Conference on Very Large Data Bases (VLDB),
2017.
Yang Cao,
Wenfei Fan,
Chunming Hu
-
GRAPE: Conducting Parallel Graph Computations without Developing Parallel Algorithms
IEEE Data Eng. Bull. 40(3): 30-41,
2017 ( invited ).
Wenfei Fan,
Jingbo Xu , Xiaojian Luo,
Yinghui Wu,
Wenyuan Yu, and
Ruiqi Xu
-
An Effective Syntax for Bounded Relational
Queries
ACM SIGMOD Conference on Management of Data (SIGMOD),
2016.
Yang Cao,
Wenfei Fan
-
Answering Graph Pattern Queries Using Views
IEEE Transactions on Knowledge and Data Engineering
(TKDE),
28(2): 326-341,2016 (invited).
Wenfei Fan,
Xin Wang, and
Yinghui Wu
-
Making Pattern Queries Bounded in Big Graphs
The 31st International Conference on Database Engineering
(ICDE),
2015.
Yang Cao,
Wenfei Fan,
and Ruizhe Huang.
-
Querying Big Graphs within Bounded Resources
ACM SIGMOD Conference on Management of Data
(SIGMOD),
2014.
Wenfei Fan,
Xin Wang, and
Yinghui Wu
-
Bounded Conjunctive Queries
The 40th International Conference on Very Large Data Bases (VLDB),
2014.
Yang Cao,
Wenfei Fan,
Tianyu Wo,
and
Wenyuan Yu
Systems
GraphScope: A unified engine for big graph processing
The 47th International Conference on Very Large Data
Bases (VLDB), industry,
2021.
Wenfei Fan, Longbin Lai, Xue Li, Yong Li, Zhao Li, Zhengping Qian,
Chao Tian, Lei Wang, Jingbo Xu, Youyang Yao, Qiang Yin,
Wenyuan Yu, Kai Zeng, Kun Zhao, Jingren Zhou, Diwen Zhu, and Rong Zhu
-
GraphScope: A One-Stop Large Graph Processing System
The 47th International Conference on Very Large Data
Bases (VLDB), demo,
2021.
Zhanning Bai,
Wenfei Fan, Longbin Lai, Xue Li, Zhao Li,
Zhengping Qian, Lei Wang, Yanyan Wang,
Jingbo Xu, Wenyuan Yu,
Kai Zeng,
Jingren Zhou
-
BEAS: Bounded Evaluation of SQL Queries
ACM SIGMOD Conference on Management of Data (SIGMOD),
demo, 2017.
Yang Cao,
Wenfei Fan,
Yanghao Wang, Tengfei Yuan, Yanchao Li
and Laura Yu Chen.
-
GRAPE: Parallelizing Sequential Graph Computations
The 43rd International Conference on Very Large Data Bases (VLDB),
demo,
2017 (the Best Demo Award).
Wenfei Fan,
Jingbo Xu ,
Yinghui Wu,
Wenyuan Yu,
Jiaxin Jiang
Applications
-
Catching Numeric
Inconsistencies in Graphs
ACM Transactions on Database Systems (TODS) , 2020.
Wenfei Fan,
Ping Lu,
Chao Tian, and
Jingren Zhou
-
Deducing Certain Fixes to Graphs
The 45th International Conference on Very Large Data Bases (VLDB),
2019.
Wenfei Fan,
Ping Lu,
Chao Tian,
Jingren Zhou
-
Catching Numeric Inconsistencies in Graphs
ACM SIGMOD Conference on Management of Data (SIGMOD),
2018.
Wenfei Fan,
Xueli Liu,
Ping Lu,
and
Chao Tian.
-
Discovering Graph Functional Dependencies
ACM SIGMOD Conference on Management of Data (SIGMOD),
2018.
Wenfei Fan,
Xueli Liu,
Ping Lu,
Chunming Hu
and Yingjie Cao
-
Parallel Reasoning of Graph Functional Dependencies
The 34th International Conference on Database Engineering
(ICDE),
2018.
Wenfei Fan,
Xueli Liu,
and Yingjie Cao
-
Virtual Network Mapping in Cloud Computing: A Graph
Pattern Matching Approach
The Computer Journal 60(3): 287-307, 2017
(invited).
Yang Cao,
Wenfei Fan, and
Shuai Ma
-
Functional Dependencies for Graphs
ACM SIGMOD Conference on Management of Data (SIGMOD),
2016.
Wenfei Fan,
Yinghui Wu and
Jingbo Xu
-
Adding Counting Quantifiers to Graph Patterns
ACM SIGMOD Conference on Management of Data (SIGMOD),
2016.
Wenfei Fan,
Yinghui Wu and
Jingbo Xu
-
Association Rules with Graph Patterns
The 41st International Conference on Very Large Data Bases (VLDB),
2015.
Wenfei Fan,
Xin Wang,
Yinghui Wu
and
Jingbo Xu.
-
Keys for Graphs
The 41st International Conference on Very Large Data Bases (VLDB),
2015.
Wenfei Fan,
Chao Tian,
Zhe Fan,
and
Xin Luna Dong
Survey