TY - GEN
T1 - Divide and conquer approach for efficient PageRank computation
AU - Desikan, Prasanna
AU - Pathak, Nishith
AU - Srivastava, Jaideep
AU - Kumar, Vipin
PY - 2006/12/1
Y1 - 2006/12/1
N2 - PageRank is a popular ranking metric for large graphs such as the World Wide Web. Current research techniques for improving computational efficiency of PageRank have focussed on improving the I/O cost, convergence and parallelizing the computation process. In this paper, we propose a "divide and conquer" strategy for efficient computation of PageRank. The strategy is different from contemporary improvements in that it can be combined with any existing enhancements to PageRank, giving way to an entire class of more efficient algorithms. We present a novel graph-partitioning technique for dividing the graph into subgraphs, on which computation can be performed independently. This approach has two significant benefits. Firstly, since the approach focuses on work-reduction, it can be combined with any existing enhancements to PageRank. Secondly, the proposed approach leads naturally into developing an incremental approach for computation of such ranking metrics given that these large graphs evolve over a period of time. The partitioning technique is both lossless and independent of the type (variant) of PageRank computation algorithm used. The experimental results for a static single graph (graph at a single time instance) as well as for the incremental computation in case of evolving graphs, illustrate the utility of our novel partitioning approach. The proposed approach can also be applied for the computation of any other metric based on first order Markov chain model.
AB - PageRank is a popular ranking metric for large graphs such as the World Wide Web. Current research techniques for improving computational efficiency of PageRank have focussed on improving the I/O cost, convergence and parallelizing the computation process. In this paper, we propose a "divide and conquer" strategy for efficient computation of PageRank. The strategy is different from contemporary improvements in that it can be combined with any existing enhancements to PageRank, giving way to an entire class of more efficient algorithms. We present a novel graph-partitioning technique for dividing the graph into subgraphs, on which computation can be performed independently. This approach has two significant benefits. Firstly, since the approach focuses on work-reduction, it can be combined with any existing enhancements to PageRank. Secondly, the proposed approach leads naturally into developing an incremental approach for computation of such ranking metrics given that these large graphs evolve over a period of time. The partitioning technique is both lossless and independent of the type (variant) of PageRank computation algorithm used. The experimental results for a static single graph (graph at a single time instance) as well as for the incremental computation in case of evolving graphs, illustrate the utility of our novel partitioning approach. The proposed approach can also be applied for the computation of any other metric based on first order Markov chain model.
KW - Efficient computation
KW - Graph partitioning
KW - PageRank
KW - Ranking measures
UR - http://www.scopus.com/inward/record.url?scp=34250625683&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34250625683&partnerID=8YFLogxK
U2 - 10.1145/1145581.1145629
DO - 10.1145/1145581.1145629
M3 - Conference contribution
AN - SCOPUS:34250625683
SN - 1595933522
SN - 9781595933522
T3 - ICWE'06: The Sixth International Conference on Web Engineering
SP - 233
EP - 240
BT - ICWE'06
T2 - ICWE'06: 6th International Conference on Web Engineering
Y2 - 11 July 2006 through 14 July 2006
ER -