Article

Indexing web access-logs for pattern queries

Authors:

Alexandros Nanopoulos,

Yannis Manolopoulos,

Maciej Zakrzewicz,

Tadeusz MorzyAuthors Info & Claims

WIDM '02: Proceedings of the 4th international workshop on Web information and data management

Pages 63 - 68

https://doi.org/10.1145/584931.584945

Published: 08 November 2002 Publication History

Abstract

In this paper, we develop a new indexing method for large web access-logs. We are concerned with pattern queries, which advocate the search for access sequences that contain certain query patterns. This kind of queries find applications in processing web-log mining results (e.g., finding typical/atypical access-sequences). The proposed method focuses on scalability to web-logs' sizes. For this reason, we examine the gains due to signature-trees, which can further improve the scalability to very large web-logs. Experimental results illustrate the superiority of the proposed method.

References

[1]

R. Agrawal, R. Srikant. "Mining Sequential Patterns". Proc. IEEE Int. Conf. on Data Engineering (ICDE'01), pp.3--14, 1995.]]

Digital Library

[2]

M.S. Chen, J.S. Park, P.S. Yu. "Efficient Data Mining for Path Traversal Patterns". IEEE Transactions on Knowledge and Data Engineering, Vol.10, No.2, pp.209--221, 1998.]]

Digital Library

[3]

R. Cooley, B. Mobasher, J. Srivastava. "Data Preparation for Mining World Wide Web Browsing Patterns". Knowledge and Information Systems, Vol.1, No.1, pp.5--32, 1999.]]

Digital Library

[4]

U. Deppish. "S-tree: a Dynamic Balanced Signature Index for Office Retrieval". Proc. ACM Int. Conference on Information Retrieval (SIGIR'86), pp. 77--87, 1986.]]

Digital Library

[5]

S. Helmer, G. Moerkotte. "A Study of Four Index Structures for Set-Valued Attributes of Low Cardinality". Reihe Informatik 2/1999, University of Mannheim, p.20, 1999.]]

[6]

M. Kitagawa, Y. Ishikawa, N. Obho. "Evaluation of Signature Files as Set Access Facility in OODBs". Proc. of the ACM SIGMOD Conference on Management of Data, pp.247-256, Santa Barbara, CA, 1993.]]

Digital Library

[7]

M. Garofalakis, R. Rastogi, S. Seshadri, K. Shim. "Data Mining and the Web: Past, Present and Future". Workshop on Web Information and Data Management (WIDM'99), pp. 43--47, 1999.]]

Digital Library

[8]

T. Imielinski, A. Virmani. "MSQL: A Query Language for Database Mining. Data Mining and Knowledge Discovery". Vol. 3, No. 4, 373--408, 1999.]]

Digital Library

[9]

C.-C. Liu, J.-L. Hsu, A. Chen. "Efficient Theme and Non-Trivial Repeating Pattern Discovering in Music Databases". Proc. of IEEE Int. Conf. on Data Engineering (ICDE'99), pp. 14--21, 1999.]]

Digital Library

[10]

T. Morzy, M. Zakrzewicz. "Group Bitmap Index: a Structure for Association Rules Retrieval". Proc. Int. Conf. on Knowledge Discovery in Databases and Data Mining (KDD'98), pp.284--288, 1998.]]

[11]

A. Nanopoulos, D. Katsaros, Y. Manolopoulos. "A Data Mining Algorithm for Generalized Web Prefetching". IEEE Transactions on Knowledge and Data Engineering, to appear, 2002.]]

Digital Library

[12]

A. Nanopoulos, Y. Manolopoulos. "Finding Generalized Path Patterns for Web Log Data Mining". Proc. of East-European Conf. on Advances in Databases and Information Systems (ADBIS-DASFAA'2000), pp.215-228, 2000.]]

Digital Library

[13]

A. Nanopoulos, Y. Manolopoulos. "Efficient Similarity Search for Market Basket Data". The VLDB Journal, accepted, 2002.]]

Digital Library

[14]

J. Pei, J. Han, B. Mortazavi-Asl, H. Zhu, Mining "Access Patterns Efficiently from Web Logs". Proc. of Pacific-Asia Conf. on Knowledge Discovery and Data Mining (PAKDD'00), 2000.]]

Digital Library

[15]

M. Perkowitz, O. Etzioni. "Adaptive Web Sites; an AI Challenge". Proc. of the 15th Int. Joint Conf. AI, 1997.]]

[16]

J. Pitkow. "In Search of Reliable Usage Data on the WWW". Proc. of the 6th Int. WWW Conference, 1997.]]

Digital Library

[17]

M. Spiliopoulou, L. Faulstich. "WUM - A Tool for WWW Ulitization Analysis". The World Wide Web and Databases, International Workshop (WebDB'98), pp. 184--103, 1998.]]

Digital Library

[18]

E. Tousidou, A. Nanopoulos, Y. Manolopoulos. "Improved Methods for Signature-Tree Construction". The Computer Journal, Vol.43, No.4, pp.301-314, 2000.]]

Digital Library

[19]

A. Whitney, D. Shasha. "Lots o' Ticks: Real-Time High Performance Time Series Queries on Billions of Trades and Quotes". Proc. of the ACM SIGMOD Conference on Management of Data, 2001.]]

Digital Library

[20]

T.W. Yan, M. Jacobsen, H. Garcia-Molina and U. Dayal: "From User Access Patterns to Dynamic Hypertext Linking", Computer Networks, Vol.28, No.7-11, pp.1007--1014, May 1996.]]

Digital Library

[21]

M. Zakrzewicz. "Sequential Index Structure for Content-Based Retrieval". Proc. Pacific-Asia Conf. on Knowledge Discovery and Data Mining (PAKDD'01), pp.306--311, 2001.]]

Digital Library

Cited By

Mavroudopoulos IGounaris A(2023)SIESTA: A Scalable Infrastructure of Sequential Pattern AnalysisIEEE Transactions on Big Data10.1109/TBDATA.2022.32290929:3(975-990)Online publication date: 1-Jun-2023
https://doi.org/10.1109/TBDATA.2022.3229092
Facca FLanzi P(2019)Mining interesting knowledge from weblogsData & Knowledge Engineering10.1016/j.datak.2004.08.00153:3(225-241)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1016/j.datak.2004.08.001
Sharma NShamkuwar M(2018)Big Data Analysis in Cloud and Machine LearningBig Data Processing Using Spark in Cloud10.1007/978-981-13-0550-4_3(51-85)Online publication date: 17-Jun-2018
https://doi.org/10.1007/978-981-13-0550-4_3
Show More Cited By

Index Terms

Indexing web access-logs for pattern queries
1. Information systems
  1. Information systems applications
    1. Data mining

Recommendations

Optimizing Pattern Queries for Web Access Logs
ADBIS '01: Proceedings of the 5th East European Conference on Advances in Databases and Information Systems

Web access logs, usually stored in relational databases, are commonly used for various data mining and data analysis tasks. The tasks typically consist in searching the web access logs for event sequences that support a given sequential pattern. For ...
Efficient indexing structure to handle durable queries through web crawling

This paper studies efficient processing of durable top-k queries on historical time series databases. Durable top-k queries, obtained as an extension of snapshot top-k queries during a certain time period, play a key role in finding objects with durable ...
Complex queries over web repositories
VLDB '03: Proceedings of the 29th international conference on Very large data bases - Volume 29

Web repositories, such as the Stanford WebBase repository, manage large heterogeneous collections of Web pages and associated indexes. For effective analysis and mining, these repositories must provide a declarative query interface that supports complex ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

WIDM '02: Proceedings of the 4th international workshop on Web information and data management

November 2002

116 pages

ISBN:1581135939

DOI:10.1145/584931

Program Chairs:
Roger Chiang
University of Cincinnati, USA
,
Ee-Peng Lim
Chinese University of Hong Kong, Hong Kong, China

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

CIKM02

Sponsor:

CIKM02: Eleventh ACM International Conference on Information and Knowledge Management

November 8, 2002

Virginia, McLean, USA

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
686
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mavroudopoulos IGounaris A(2023)SIESTA: A Scalable Infrastructure of Sequential Pattern AnalysisIEEE Transactions on Big Data10.1109/TBDATA.2022.32290929:3(975-990)Online publication date: 1-Jun-2023
https://doi.org/10.1109/TBDATA.2022.3229092
Facca FLanzi P(2019)Mining interesting knowledge from weblogsData & Knowledge Engineering10.1016/j.datak.2004.08.00153:3(225-241)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1016/j.datak.2004.08.001
Sharma NShamkuwar M(2018)Big Data Analysis in Cloud and Machine LearningBig Data Processing Using Spark in Cloud10.1007/978-981-13-0550-4_3(51-85)Online publication date: 17-Jun-2018
https://doi.org/10.1007/978-981-13-0550-4_3
Bendre MThool V(2016)Analytics, challenges and applications in big data environment: a surveyJournal of Management Analytics10.1080/23270012.2016.11865783:3(206-239)Online publication date: Jul-2016
https://doi.org/10.1080/23270012.2016.1186578
Chen MMao SLiu Y(2014)Big DataMobile Networks and Applications10.1007/s11036-013-0489-019:2(171-209)Online publication date: 1-Apr-2014
https://dl.acm.org/doi/10.1007/s11036-013-0489-0
Chen MMao SZhang YLeung VChen MMao SZhang YLeung V(2014)Big Data Generation and AcquisitionBig Data10.1007/978-3-319-06245-7_3(19-32)Online publication date: 7-Apr-2014
https://doi.org/10.1007/978-3-319-06245-7_3
Andrzejewski WMorzy T(2006)AISSProceedings of the 8th international conference on Data Warehousing and Knowledge Discovery10.1007/11823728_48(503-512)Online publication date: 4-Sep-2006
https://dl.acm.org/doi/10.1007/11823728_48
Andrzejewski WMorzy TMorzy M(2005)Indexing of sequences of sets for efficient exact and similar subsequence matchingProceedings of the 20th international conference on Computer and Information Sciences10.1007/11569596_88(864-873)Online publication date: 26-Oct-2005
https://dl.acm.org/doi/10.1007/11569596_88
Otsuka SToyoda MHirai JKitsuregawa M(2004)Extracting User Behavior by Web Communities Technology on Global Web LogsDatabase and Expert Systems Applications10.1007/978-3-540-30075-5_92(957-968)Online publication date: 2004
https://doi.org/10.1007/978-3-540-30075-5_92
Facca FLanzi P(2003)Recent Developments in Web Usage Mining ResearchData Warehousing and Knowledge Discovery10.1007/978-3-540-45228-7_15(140-150)Online publication date: 2003
https://doi.org/10.1007/978-3-540-45228-7_15
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents