Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3578503.3583601acmconferencesArticle/Chapter ViewAbstractPublication PageswebsciConference Proceedingsconference-collections
research-article
Open access

Popular, but hardly used: Has Google Analytics been to the detriment of Web Analytics?

Published: 30 April 2023 Publication History

Abstract

Since 2005, Google has been offering a free version of Google Analytics, allowing website owners to access detailed user behavior data. However, while more and more features and tools have been added to the Google measurement suite since then, it is unclear if the free availability of these tools has really helped users to derive actionable insights for their websites. Earlier studies based on a small number of interviews have suggested that users tend to play with the tools as they lack data literacy, but a broader analysis has been missing by now. Our contribution is a large-scale study of Google Analytics implementations to examine what advanced features are used, allowing conclusions to be drawn about the webmasters’ analysis capabilities. In addition, we detail how difficult it has become to conduct such a study due to the arrangements that website owners have to put in place to comply with the GDPR requirements, but also due to the possibility of obfuscation with the latest development of web analytics software.

References

[1]
2012. Digital marketing made (much) easier: Introducing Google Tag Manager. https://analytics.googleblog.com/2012/10/google-tag-manager.html
[2]
2016. Encuesta sobre equipamiento y uso de tecnologías de información y comunicación en los hogares 2016. http://www.ine.es/jaxi/files/_px/es/xls/t25/p450/base_2011/a2016/l0/08014.xls?nocab=1
[3]
2019. The Impact of the General Data Protection Regulation on the Design and Measurement of Marketing Activities: Introducing Permission Marketing and Tracking for Improved Marketing & CRM Compliance with Legal Requirements. Journal of Marketing Development and Competitiveness 13, 4 (Nov. 2019). https://doi.org/10.33423/jmdc.v13i4.2352
[4]
2021. [GA4]Enhanced event measurement - Analytics Help. https://support.google.com/analytics/answer/9216061?hl=en
[5]
2022. Digital Analytics Association. https://www.digitalanalyticsassociation.org/
[6]
2022. Usage Statistics and Market Share of Google Analytics for Websites, October 2022. https://w3techs.com/technologies/details/ta-googleanalytics
[7]
Simo Ahava. 2020. Server-side Tagging In Google Tag Manager. https://www.simoahava.com/analytics/server-side-tagging-google-tag-manager/
[8]
Tom Alby. 2023. Popular but hardly used: Has Google Analytics been to the detriment of Web Analytics (Dataset). https://doi.org/10.5281/zenodo.7603944 tex.entrytype: dataset tex.version: 1.0.
[9]
Tom Alby and Robert Jäschke. 2022. Analyzing the web: Are top websites lists a good choice for research?. In Linking theory and practice of digital libraries, Gianmaria Silvello, Oscar Corcho, Paolo Manghi, Giorgio Maria Di Nunzio, Koraljka Golub, Nicola Ferro, and Antonella Poggi (Eds.). Springer International Publishing, Cham, 11–25.
[10]
F. Bonchi, F. Giannotti, C. Gozzi, G. Manco, M. Nanni, D. Pedreschi, C. Renso, and S. Ruggieri. 2001. Web log data warehousing and mining for intelligent web caching. Data & Knowledge Engineering 39, 2 (Nov. 2001), 165–189. https://doi.org/10.1016/S0169-023X(01)00038-6
[11]
Dave Chaffey and Mark Patron. 2012. From web analytics to digital marketing optimization: Increasing the commercial value of digital analytics. Journal of Direct, Data and Digital Marketing Practice 14, 1 (July 2012), 30–45. https://doi.org/10.1057/dddmp.2012.20
[12]
D.J. Clark, David Nicholas, and Hamid R. Jamali. 2014. Evaluating information seeking and use in the changing virtual world: the emerging role of Google Analytics. Learned Publishing 27, 3 (July 2014), 185–194. https://doi.org/10.1087/20140304
[13]
Brett Crosby. 2005. The circle of analytics. https://googleblog.blogspot.com/2005/11/circle-of-analytics.html
[14]
Alden DeSoto. 2007. Exciting Announcements at eMetrics Today. https://analytics.googleblog.com/2007/10/exciting-announcements-at-emetrics.html
[15]
Steven Englehardt, Chris Eubank, Peter Zimmerman, Dillon Reisman, and Arvind Narayanan. 2016. OpenWPM: An automated platform for web privacy measurement. Proceedings of ACM CCS 2016(2016).
[16]
Steven Englehardt and Arvind Narayanan. 2016. Online Tracking: A 1-million-site Measurement and Analysis. In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security. ACM, Vienna Austria, 1388–1401. https://doi.org/10.1145/2976749.2978313
[17]
Federico Michele Facca and Pier Luca Lanzi. 2005. Mining interesting knowledge from weblogs: a survey. Data & Knowledge Engineering 53, 3 (June 2005), 225–241. https://doi.org/10.1016/j.datak.2004.08.001
[18]
Nicole Farley. 2023. Google Optimize will sunset this year. https://searchengineland.com/google-optimize-will-sunset-this-year-392004
[19]
Nicole Farley. 2023. Make the switch to GA4, or Google will do it for you. https://searchengineland.com/make-the-switch-to-ga4-or-google-will-do-it-for-you-392612
[20]
Ben Fisher. 2020. Improve performance and security with Server-Side Tagging. https://blog.google/products/marketingplatform/360/improve-performance-and-security-server-side-tagging/
[21]
Abdelghani Guerbas, Omar Addam, Omar Zaarour, Mohamad Nagi, Ahmad Elhajj, Mick Ridley, and Reda Alhajj. 2013. Effective web log mining and online navigational pattern prediction. Knowledge-Based Systems 49 (Sept. 2013), 50–62. https://doi.org/10.1016/j.knosys.2013.04.014
[22]
Russel Ketchum. 2019. A new way to unify app and website measurement in Google Analytics. https://blog.google/products/marketingplatform/analytics/new-way-unify-app-and-website-measurement-google-analytics/
[23]
Russel Ketchum. 2022. Prepare for the future with Google Analytics 4. https://blog.google/products/marketingplatform/analytics/prepare-for-future-with-google-analytics-4/
[24]
Michael Kretschmer, Jan Pennekamp, and Klaus Wehrle. 2021. Cookie banners and privacy policies: Measuring the impact of the GDPR on the web. ACM Transactions on the Web 15, 4 (July 2021). https://doi.org/10.1145/3466722 Number of pages: 42 Place: New York, NY, USA Publisher: Association for Computing Machinery tex.articleno: 20 tex.issue_date: November 2021.
[25]
Vincent Lefrere, Logan Warberg, Cristobal Cheyre, Veronica Marotta, and Alessandro Acquisti. 2020. The impact of the GDPR on content providers. Post-print. HAL. https://EconPapers.repec.org/RePEc:hal:journl:hal-03111801
[26]
Adam Lerner, Anna Kornfeld Simpson, Tadayoshi Kohno, and Franziska Roesner. 2016. Internet jones and the raiders of the lost trackers: An archaeological study of web tracking from 1996 to 2016. In Proceedings of the 25th USENIX conference on security symposium(SEC’16). USENIX Association, USA, 997–1013. Number of pages: 17 Place: Austin, TX, USA.
[27]
Alexander Lex, Nils Gehlenborg, Hendrik Strobelt, Romain Vuillemot, and Hanspeter Pfister. 2014. UpSet: Visualization of Intersecting Sets. IEEE Transactions on Visualization and Computer Graphics (InfoVis) 20, 12(2014), 1983–1992. https://doi.org/10.1109/TVCG.2014.2346248
[28]
Chao Liu, Ryen W. White, and Susan Dumais. 2010. Understanding web browsing behaviors through Weibull analysis of dwell time. In Proceeding of the 33rd international ACM SIGIR conference on Research and development in information retrieval - SIGIR ’10. ACM Press, Geneva, Switzerland, 379. https://doi.org/10.1145/1835449.1835513
[29]
Nick Mihailovski. 2014. Universal Analytics: Out of beta, into primetime. https://analytics.googleblog.com/2014/04/universal-analytics-out-of-beta-into.html
[30]
Manav Mishra. 2012. Re-imagining Google Analytics to support the versatile usage patterns of today’s users. https://analytics.googleblog.com/2012/10/universal-analytics.html
[31]
Bamshad Mobasher. 2007. Data Mining for Web Personalization. In The Adaptive Web, Peter Brusilovsky, Alfred Kobsa, and Wolfgang Nejdl (Eds.). Vol. 4321. Springer Berlin Heidelberg, Berlin, Heidelberg, 90–135. https://doi.org/10.1007/978-3-540-72079-9_3 Series Title: Lecture Notes in Computer Science.
[32]
Bamshad Mobasher, Robert Cooley, and Jaideep Srivastava. 2000. Automatic personalization based on Web usage mining. Commun. ACM 43, 8 (Aug. 2000), 142–151. https://doi.org/10.1145/345124.345169
[33]
Bamshad Mobasher, Honghua Dai, Tao Luo, and Miki Nakagawa. 2001. Discovery and evaluation of aggregate usage profiles for web personalization. Data Mining and Knowledge Discovery 6 (Aug. 2001). https://doi.org/10.1023/A:1013232803866
[34]
Roger Mueller. 2018. 76% of Users Ignore Cookie Banners! | Amazee Metrics. https://www.advance-metrics.com/en/blog/76-ignore-cookie-banners-the-user-behavior-after-30-days-of-gdpr/
[35]
H. Pakkala, K. Presser, and T. Christensen. 2012. Using Google Analytics to measure visitor statistics: The case of food composition websites. International Journal of Information Management (2012). https://doi.org/c
[36]
Emily January Petersen and Breeanne Matheson Martin. 2015. Misuse, play, and disuse: Technical and professional communication’s role in understanding and supporting website owners’ engagement with Google Analytics. In 2015 IEEE International Professional Communication Conference (IPCC). IEEE, Limerick, Ireland, 1–5. https://doi.org/10.1109/IPCC.2015.7235786
[37]
Victor Le Pochat, Tom van Goethem, Samaneh Tajalizadehkhoob, Maciej Korczynski, and Wouter Joosen. 2019. Tranco: A research-oriented top sites ranking hardened against manipulation. In 26th annual network and distributed system security symposium, NDSS 2019, san diego, california, USA, february 24-27, 2019. The Internet Society. https://doi.org/10.14722/ndss.2019.23386 tex.bibsource: dblp computer science bibliography, https://dblp.org tex.biburl: https://dblp.org/rec/conf/ndss/PochatGTKJ19.bib tex.timestamp: Mon, 01 Feb 2021 08:42:23 +0100.
[38]
Orit Raphaeli, Anat Goldstein, and Lior Fink. 2017. Analyzing online consumer behavior in mobile and PC devices: A novel web usage mining approach. Electronic Commerce Research and Applications 26 (Nov. 2017), 1–12. https://doi.org/10.1016/j.elerap.2017.09.003
[39]
Keith Regan. 2005. Google Buys Web Analytics Firm Urchin Software. https://www.ecommercetimes.com/story/google-buys-web-analytics-firm-urchin-software-41857.html
[40]
Iskander Sanchez-Rola, Matteo Dell’Amico, Platon Kotzias, Davide Balzarotti, Leyla Bilge, Pierre-Antoine Vervier, and Igor Santos. 2019. Can I opt out yet? GDPR and the global illusion of cookie control. In Proceedings of the 2019 ACM asia conference on computer and communications security(Asia CCS ’19). Association for Computing Machinery, New York, NY, USA, 340–351. https://doi.org/10.1145/3321705.3329806 Number of pages: 12 Place: Auckland, New Zealand.
[41]
José Ramón Saura, Pedro Palos-Sánchez, and Luis Manuel Cerdá Suárez. 2017. Understanding the Digital Marketing Environment with KPIs and Web Analytics. Future Internet (2017). https://doi.org/10.3390/fi9040076
[42]
Manya Sleeper, Sunny Consolvo, and Jessica Staddon. 2014. Exploring the benefits and uses of web analytics tools for non-transactional websites. In Proceedings of the 2014 conference on Designing interactive systems. ACM, Vancouver BC Canada, 681–684. https://doi.org/10.1145/2598510.2598555
[43]
Kate A. Smith and Alan Ng. 2003. Web page clustering using a self-organizing map of user navigation patterns. Decision Support Systems 35, 2 (May 2003), 245–256. https://doi.org/10.1016/S0167-9236(02)00109-4
[44]
Qinbao Song and Martin Shepperd. 2006. Mining web browsing patterns for E-commerce. Computers in Industry 57, 7 (Sept. 2006), 622–630. https://doi.org/10.1016/j.compind.2005.11.006
[45]
Parameswar Sriram. 2017. The importance of site-wide tagging for accurate conversion measurement in DoubleClick Search. https://blog.google/products/ads/the-importance-of-site-wide-tagging-for/
[46]
Nick Statt. 2020. Apple updates Safari’s anti-tracking tech with full third-party cookie blocking. https://www.theverge.com/2020/3/24/21192830/apple-safari-intelligent-tracking-privacy-full-third-party-cookie-blocking
[47]
Christine Utz, Martin Degeling, Sascha Fahl, Florian Schaub, and Thorsten Holz. 2019. (un)informed consent: Studying GDPR consent notices in the field. In CCS ’19: Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security. https://doi.org/10.1145/3319535.3354212
[48]
Feng-Hsu Wang and Hsiu-Mei Shao. 2004. Effective personalized recommendation based on time-framed navigation clustering and association mining. Expert Systems with Applications 27, 3 (Oct. 2004), 365–377. https://doi.org/10.1016/j.eswa.2004.05.005
[49]
JiaJing Wang. 2013. Expanding Universal Analytics into Public Beta. https://analytics.googleblog.com/2013/03/expanding-universal-analytics-into.html
[50]
Xiaozhe Wang, Ajith Abraham, and Kate A. Smith. 2005. Intelligent web traffic mining and analysis. Journal of Network and Computer Applications 28, 2 (April 2005), 147–165. https://doi.org/10.1016/j.jnca.2004.01.006
[51]
Webtrends. 2022. About Us. https://www.webtrends.com/about-us/
[52]
Johannes Zirngibl, Steffen Deutch, Patrick Sattler, Juliane Aulbach, Georg Carle, and Mattijs Jonker. 2022. Domain parking: Largely present, rarely considered!. In Proceedings of the 6th edition of the network traffic measurement and analysis conference (TMA conference 2022). International Federation for Information Processing (IFIP). https://tma.ifip.org/2022/

Cited By

View all
  • (2024)Bridging the Analytics Gap: Optimizing Content Performance using Actionable Knowledge DiscoveryProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3675121(185-192)Online publication date: 10-Sep-2024
  • (2024)The Effect of Analytics Tools on Energy Consumption of Websites2024 10th International Conference on ICT for Sustainability (ICT4S)10.1109/ICT4S64576.2024.00041(335-345)Online publication date: 24-Jun-2024
  • (2024)CAWALInformation Processing and Management: an International Journal10.1016/j.ipm.2023.10361761:3Online publication date: 2-Jul-2024
  • Show More Cited By

Index Terms

  1. Popular, but hardly used: Has Google Analytics been to the detriment of Web Analytics?

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      WebSci '23: Proceedings of the 15th ACM Web Science Conference 2023
      April 2023
      373 pages
      ISBN:9798400700897
      DOI:10.1145/3578503
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 30 April 2023

      Check for updates

      Author Tags

      1. data literacy
      2. digital analytics
      3. gdpr
      4. google analytics
      5. web analytics
      6. web privacy measurement

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      WebSci '23
      Sponsor:
      WebSci '23: 15th ACM Web Science Conference 2023
      April 30 - May 1, 2023
      TX, Austin, USA

      Acceptance Rates

      Overall Acceptance Rate 245 of 933 submissions, 26%

      Upcoming Conference

      Websci '25
      17th ACM Web Science Conference
      May 20 - 24, 2025
      New Brunswick , NJ , USA

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)741
      • Downloads (Last 6 weeks)111
      Reflects downloads up to 03 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Bridging the Analytics Gap: Optimizing Content Performance using Actionable Knowledge DiscoveryProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3675121(185-192)Online publication date: 10-Sep-2024
      • (2024)The Effect of Analytics Tools on Energy Consumption of Websites2024 10th International Conference on ICT for Sustainability (ICT4S)10.1109/ICT4S64576.2024.00041(335-345)Online publication date: 24-Jun-2024
      • (2024)CAWALInformation Processing and Management: an International Journal10.1016/j.ipm.2023.10361761:3Online publication date: 2-Jul-2024
      • (2024)Transparency in Open Government Data Portals: An Assessment of Web Tracking Practices Across EuropeElectronic Participation10.1007/978-3-031-70804-6_14(209-222)Online publication date: 25-Aug-2024
      • (2024)Analysis of Customer BehaviorMulti-variant User Interfaces in E-commerce10.1007/978-3-031-67758-8_3(45-65)Online publication date: 19-Sep-2024

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Login options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media