article

MiTexCube: MicroTextCluster Cube for online analysis of text cells and its applications

Authors:

ChengXiang Zhai,

Jiawei HanAuthors Info & Claims

Statistical Analysis and Data Mining, Volume 6, Issue 3

Pages 243 - 259

https://doi.org/10.1002/sam.11159

Published: 01 June 2013 Publication History

Abstract

A fundamental problem of multidimensional text database analysis is efficient and effective support of various kinds of online applications, such as summarizing the content of a text cell or comparing the contents across multiple text cells. In this paper, we propose a new infrastructure called MicroTextCluster Cube or MiTexCube to support efficient online text analysis on multidimensional text databases by introducing micro-clusters of text documents as a compact representation of text content. Experimental results on real multidimensional text databases show that i MiTexCube can be materialized efficiently with reasonable overhead in space, and ii applications based on the proposed materialized MiTexCube are more efficient than the baseline method of direct analysis based on document units in each cell, without sacrificing much quality of analysis, and MiTexCube naturally accommodates flexible trade-off between efficiency and quality of analysis. © 2012 Wiley Periodicals, Inc. Statistical Analysis and Data Mining 6: 243-259, 2013

References

[1]

<label>1</label> Aviation safety reporting system, "http://asrs.arc.nasa.gov/", 2012.

[2]

<label>2</label> C. X.Lin, B.Ding, J.Han, F.Zhu, and B.Zhao, Text cube: computing IR measures for multidimensional text database analysis, ICDM, 2008, pp.905-910.

[3]

<label>3</label> D.Zhang, C.Zhai, and J.Han, Topic cube: topic modeling for OLAP on multidimensional text databases, SDM 2009.

[4]

<label>4</label> T.Zhang, R.Ramakrishnan, and M.Livny, Birch: an efficient data clustering method for very large databases, SIGMOD Rec Volume 25 2 1996, pp.103-114.

Digital Library

[5]

<label>5</label> D. L.Davies and D. W.Bouldin, A cluster separation measure, IEEE Trans Pattern Anal Mach Intell Volume 1 1979, pp.224-227.

Digital Library

[6]

<label>6</label> The dblp computer science bibliography, "http://www.informatik.uni-trier.de/~ley/db/", 2012.

[7]

<label>7</label> S.Agarwal, R.Agrawal, P.Deshpande, A.Gupta, J. F.Naughton, R.Ramakrishnan, and S.Sarawagi, On the computation of multidimensional aggregates, VLDB'96, pp.506-521.

[8]

<label>8</label> S.Chaudhuri and U.Dayal, An overview of data warehousing and olap technology, SIGMOD Rec Volume 26 1 1997, pp.65-74.

Digital Library

[9]

<label>9</label> J.Gray, S.<?givenNamesStart ?>Chaudhuri<?givenNamesEnd ?>, A.Bosworth, A.Layman, D. Reichart, M.Venkatrao, F.Pellow, and H.Pirahesh, Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals, Data Mining and Knowledge Discovery, Vol. 1, pp.29-53, Kluwer Academic Publishers, Hingham, MA, USA, 1997.

Digital Library

[10]

<label>10</label> F. M.fei Jiang, J.Pei, and A. W.chee Fu, Ix-cubes: iceberg cubes for data warehousing and olap on xml data, CIKM'07, Lisbon, Portugal, 2007, pp.905-908.

Digital Library

[11]

<label>11</label> E.Lo, B.Kao, W.-S.Ho, S. D.Lee, C. K.Chui, and D. W.Cheung, Olap on sequence data, SIGMOD'08, Vancouver, Canada, 2008, pp.649-660.

Digital Library

[12]

<label>12</label> Y.Tian, R. A.Hankins, and J. M.Patel, Efficient aggregation for graph summarization, SIGMOD'08, Vancouver, Canada, 2008, pp.567-580.

Digital Library

[13]

<label>13</label> W. F.Cody, J. T.Kreulen, V.Krishna, and W. S.Spangler, The integration of business intelligence and knowledge management, IBM Syst J Volume 41 4 2002, pp.697-713.

Digital Library

[14]

<label>14</label> Megaputer's polyanalyst, "http://www.megaputer.com/", 2011.

[15]

<label>15</label> A.Simitsis, A.Baid, Y.Sismanis, and B.Reinwald, Multidimensional content exploration, Proc VLDB Endow Volume 1 1 2008, pp.660-671.

Digital Library

[16]

<label>16</label> J.Han and M.Kamber, Data Mining: Concepts and Techniques, San Francisco, CA, Morgan Kaufmann, 2000.

[17]

<label>17</label> G.Salton and M.McGill, Introduction to Modern Information Retrieval, New York, McGraw-Hill, 1983.

[18]

<label>18</label> J.Carbonell and J.Goldstein, The use of mmr, diversity-based reranking for reordering documents and producing summaries, SIGIR '98, Melbourne, Australia, 1998, pp.335-336.

Digital Library

[19]

<label>19</label> E.Rendón, I. M.Abundez, C.Gutierrez, S. D.Zagal, A.Arizmendi, E. M.Quiroz, and H. E.Arzate, A comparison of internal and external cluster validation indexes, In Proceedings of the 2011 American Conference on Applied Mathematics and the 5th WSEAS International Conference on Computer Engineering And Applications, AMERICAN-MATH'11/CEA'11, 2011, pp.158-163.

Digital Library

[20]

<label>20</label> J.Lafferty and C.Zhai, Document language models, query models, and risk minimization for information retrieval, SIGIR '01, New Orleans, Louisiana, 2001, pp.111-119.

Cited By

Truică CApostol EDarmont JAssent I(2021)TextBenDS: a Generic Textual Data Benchmark for Distributed SystemsInformation Systems Frontiers10.1007/s10796-020-09999-y23:1(81-100)Online publication date: 1-Feb-2021
https://dl.acm.org/doi/10.1007/s10796-020-09999-y
Oukid LBenblidia NBentayeb FBoussaid O(2018)TLabelInternational Journal of Data Warehousing and Mining10.4018/IJDWM.201610010312:4(54-74)Online publication date: 19-Dec-2018
https://dl.acm.org/doi/10.4018/IJDWM.2016100103
Wang FZhang H(2015)Matchings extend to Hamiltonian cycles in k-ary n-cubesInformation Sciences: an International Journal10.1016/j.ins.2015.02.005305:C(1-13)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1016/j.ins.2015.02.005

MiTexCube: MicroTextCluster Cube for online analysis of text cells and its applications
1. Information systems
  1. Data management systems

Recommendations

Topic modeling for OLAP on multidimensional text databases: topic cube and its applications
Best of SDM'09

As the amount of textual information grows explosively in various kinds of business systems, it becomes more and more desirable to analyze both structured data records and unstructured text data simultaneously. Although online analytical processing (...
Cube index for unstructured text analysis and mining
ICCCS '11: Proceedings of the 2011 International Conference on Communication, Computing & Security

A Cube Index Model on multidimensional text database and effective study of Online Analytical Processing (OLAP) over such data had been experimented and found to provide good results. We had proposed a cube index model for unstructured text database ...
Domain-specific keyphrase extraction
CIKM '05: Proceedings of the 14th ACM international conference on Information and knowledge management

Document keyphrases provide semantic metadata characterizing documents and producing an overview of the content of a document. They can be used in many text-mining and knowledge management related applications. This paper describes a Keyphrase ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Statistical Analysis and Data Mining

Statistical Analysis and Data Mining Volume 6, Issue 3

June 2013

114 pages

ISSN:1932-1864

EISSN:1932-1872

Issue’s Table of Contents

Publisher

John Wiley & Sons, Inc.

United States

Publication History

Published: 01 June 2013

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Truică CApostol EDarmont JAssent I(2021)TextBenDS: a Generic Textual Data Benchmark for Distributed SystemsInformation Systems Frontiers10.1007/s10796-020-09999-y23:1(81-100)Online publication date: 1-Feb-2021
https://dl.acm.org/doi/10.1007/s10796-020-09999-y
Oukid LBenblidia NBentayeb FBoussaid O(2018)TLabelInternational Journal of Data Warehousing and Mining10.4018/IJDWM.201610010312:4(54-74)Online publication date: 19-Dec-2018
https://dl.acm.org/doi/10.4018/IJDWM.2016100103
Wang FZhang H(2015)Matchings extend to Hamiltonian cycles in k-ary n-cubesInformation Sciences: an International Journal10.1016/j.ins.2015.02.005305:C(1-13)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1016/j.ins.2015.02.005

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents