Aggregation Algorithms for Very Large Compressed Data Warehouses

Jianzhong Li; Doron Rotem; Jaideep Srivastava

Aggregation Algorithms for Very Large Compressed Data Warehouses

Jianzhong Li
, Doron Rotem
, Jaideep Srivastava

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

31 Scopus citations

Abstract

Many efficient algorithms to compute multidimensional aggregation and Cube for relational OLAP have been developed. However, to our knowledge, there is nothing to date in the literature on aggregation algorithms on compressed data warehouses for multidimensional OLAP. This paper presents a set of aggregation algorithms on very large compressed data warehouses for multidimensional OLAP. These algorithms operate directly on compressed datasets without the need to first decompress them. They are applicable to data warehouses that are compressed using variety of data compression methods. The algorithms have different performance behavior as a function of dataset parameters, sizes of outputs and main memory availability. The analysis and experimental results show that the algorithms have better performance than the traditional aggregation algorithms.

Original language	English (US)
Title of host publication	VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases
Editors	Malcolm P. Atkinson, Maria E. Orlowska, Patrick Valduriez, Stanley B. Zdonik, Michael L. Brodie
Publisher	Morgan Kaufmann Publishers, Inc.
Pages	651-662
Number of pages	12
ISBN (Electronic)	1558606157, 9781558606159
State	Published - 1999
Event	25th International Conference on Very Large Data Bases, VLDB 1999 - Edinburgh, United Kingdom Duration: Sep 7 1999 → Sep 10 1999

Publication series

Name	VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases

Conference

Conference	25th International Conference on Very Large Data Bases, VLDB 1999
Country/Territory	United Kingdom
City	Edinburgh
Period	9/7/99 → 9/10/99

Bibliographical note

Publisher Copyright:
© 1999 VLDB. All Rights Reserved.

Find It

Find It at U of M Libraries

Cite this

Li, J., Rotem, D., & Srivastava, J. (1999). Aggregation Algorithms for Very Large Compressed Data Warehouses. In M. P. Atkinson, M. E. Orlowska, P. Valduriez, S. B. Zdonik, & M. L. Brodie (Eds.), VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases (pp. 651-662). (VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases). Morgan Kaufmann Publishers, Inc..

Aggregation Algorithms for Very Large Compressed Data Warehouses. / Li, Jianzhong; Rotem, Doron; Srivastava, Jaideep.
VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases. ed. / Malcolm P. Atkinson; Maria E. Orlowska; Patrick Valduriez; Stanley B. Zdonik; Michael L. Brodie. Morgan Kaufmann Publishers, Inc., 1999. p. 651-662 (VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Li, J, Rotem, D & Srivastava, J 1999, Aggregation Algorithms for Very Large Compressed Data Warehouses. in MP Atkinson, ME Orlowska, P Valduriez, SB Zdonik & ML Brodie (eds), VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases. VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases, Morgan Kaufmann Publishers, Inc., pp. 651-662, 25th International Conference on Very Large Data Bases, VLDB 1999, Edinburgh, United Kingdom, 9/7/99.

Li J, Rotem D, Srivastava J. Aggregation Algorithms for Very Large Compressed Data Warehouses. In Atkinson MP, Orlowska ME, Valduriez P, Zdonik SB, Brodie ML, editors, VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases. Morgan Kaufmann Publishers, Inc. 1999. p. 651-662. (VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases).

Li, Jianzhong ; Rotem, Doron ; Srivastava, Jaideep. / Aggregation Algorithms for Very Large Compressed Data Warehouses. VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases. editor / Malcolm P. Atkinson ; Maria E. Orlowska ; Patrick Valduriez ; Stanley B. Zdonik ; Michael L. Brodie. Morgan Kaufmann Publishers, Inc., 1999. pp. 651-662 (VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases).

@inproceedings{997819eaa813405c8f21f04e76b035b6,

title = "Aggregation Algorithms for Very Large Compressed Data Warehouses",

abstract = "Many efficient algorithms to compute multidimensional aggregation and Cube for relational OLAP have been developed. However, to our knowledge, there is nothing to date in the literature on aggregation algorithms on compressed data warehouses for multidimensional OLAP. This paper presents a set of aggregation algorithms on very large compressed data warehouses for multidimensional OLAP. These algorithms operate directly on compressed datasets without the need to first decompress them. They are applicable to data warehouses that are compressed using variety of data compression methods. The algorithms have different performance behavior as a function of dataset parameters, sizes of outputs and main memory availability. The analysis and experimental results show that the algorithms have better performance than the traditional aggregation algorithms.",

author = "Jianzhong Li and Doron Rotem and Jaideep Srivastava",

year = "1999",

language = "English (US)",

series = "VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases",

publisher = "Morgan Kaufmann Publishers, Inc.",

pages = "651--662",

editor = "Atkinson, \{Malcolm P.\} and Orlowska, \{Maria E.\} and Patrick Valduriez and Zdonik, \{Stanley B.\} and Brodie, \{Michael L.\}",

booktitle = "VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases",

address = "United States",

}

TY - GEN

T1 - Aggregation Algorithms for Very Large Compressed Data Warehouses

AU - Li, Jianzhong

AU - Rotem, Doron

AU - Srivastava, Jaideep

PY - 1999

Y1 - 1999

N2 - Many efficient algorithms to compute multidimensional aggregation and Cube for relational OLAP have been developed. However, to our knowledge, there is nothing to date in the literature on aggregation algorithms on compressed data warehouses for multidimensional OLAP. This paper presents a set of aggregation algorithms on very large compressed data warehouses for multidimensional OLAP. These algorithms operate directly on compressed datasets without the need to first decompress them. They are applicable to data warehouses that are compressed using variety of data compression methods. The algorithms have different performance behavior as a function of dataset parameters, sizes of outputs and main memory availability. The analysis and experimental results show that the algorithms have better performance than the traditional aggregation algorithms.

AB - Many efficient algorithms to compute multidimensional aggregation and Cube for relational OLAP have been developed. However, to our knowledge, there is nothing to date in the literature on aggregation algorithms on compressed data warehouses for multidimensional OLAP. This paper presents a set of aggregation algorithms on very large compressed data warehouses for multidimensional OLAP. These algorithms operate directly on compressed datasets without the need to first decompress them. They are applicable to data warehouses that are compressed using variety of data compression methods. The algorithms have different performance behavior as a function of dataset parameters, sizes of outputs and main memory availability. The analysis and experimental results show that the algorithms have better performance than the traditional aggregation algorithms.

UR - https://www.scopus.com/pages/publications/105030253116

UR - https://www.scopus.com/pages/publications/105030253116#tab=citedBy

M3 - Conference contribution

AN - SCOPUS:105030253116

T3 - VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases

SP - 651

EP - 662

BT - VLDB 1999 - Proceedings of the 25th International Conference on Very Large Data Bases

A2 - Atkinson, Malcolm P.

A2 - Orlowska, Maria E.

A2 - Valduriez, Patrick

A2 - Zdonik, Stanley B.

A2 - Brodie, Michael L.

PB - Morgan Kaufmann Publishers, Inc.

T2 - 25th International Conference on Very Large Data Bases, VLDB 1999

Y2 - 7 September 1999 through 10 September 1999

ER -

Aggregation Algorithms for Very Large Compressed Data Warehouses

Abstract

Publication series

Conference

Bibliographical note

Find It

Other files and links

Fingerprint

Cite this