demonstration

Public Access

Coagmento v3.0: Rapid Prototyping of Web Search Experiments

Authors:

Matthew Mitsui,

Chirag ShahAuthors Info & Claims

CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval

Pages 367 - 371

https://doi.org/10.1145/3295750.3298917

Published: 08 March 2019 Publication History

Abstract

As understanding of web search behavior grows, researchers rapidly develop new study designs to capture and understand search behavior. Researchers have restricted time in which to design a study, develop a collection tool, collect data, analyze it, and report new insights. In particular, sufficient time and development skills are often required to create a tool that meets the needs of any particular web search behavior study. Coagmento is a tool that is developed for facilitating many of the needs for designing and running a lab study, from executing a session flow to collecting log data. By streamlining the programming of unique parts for a specific study, Coagmento helps researchers tailor various parts of running a user study, lowering the barrier for designing and conducting lab study experiments. One-click interactions with a graphical user interface permit researchers to operate through a web-based administrative service to generate stages, search tasks, and questionnaires for their interactive information retrieval studies. In this demonstration, Coagmento provides a solution to increase efficiency in the production of laboratory experiments for web search behavior.

References

[1]

{n. d.}. Latin Squares - Williams Design. http://statpages.info/latinsq.html

[2]

Saleema Amershi and Meredith Ringel Morris. 2008. CoSearch: A System forCo-located Collaborative Web Search. InProceedings of CHI '08. ACM, New York,NY, USA, 1647--1656.

Digital Library

[3]

Jaime Arguello. 2014. Predicting Search Task Difficulty. InProceedings of the36th European Conference on IR Research on Advances in Information Retrieval -Volume 8416 (ECIR 2014). Springer-Verlag New York, Inc., New York, NY, USA,88--99.

[4]

Rob Capra, Jaime Arguello, and Yinglong Zhang. 2017. The effects of search task determinability on search behavior. In Advances in Information Retrieval-39th European Conference on IR Research, ECIR 2017, Proceedings (Lecture Notesin Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). Springer Verlag, Germany, 108--121.

[5]

Marc-Allen Cartright, Ryen W. White, and Eric Horvitz. 2011. Intentions and Attention in Exploratory Health Search. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR '11). ACM, New York, NY, USA, 65--74.

Digital Library

[6]

Anita Crescenzi, Diane Kelly, and Leif Azzopardi. 2015. Time Pressure and System Delays in Information Search. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '15). ACM, New York, NY, USA, 767--770.

Digital Library

[7]

Ashlee Edwards and Diane Kelly. 2017. Engaged or Frustrated?: Disambiguating Emotional State in Search. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '17). ACM, New York, NY, USA, 125--134.

Digital Library

[8]

Gene Golovchinsky, John Adcock, Jeremy Pickens, Pernilla Qvarfordt, and Mari-beth Back. 2008. Cerchiamo: a collaborative exploratory search tool.Proceedingsof CSCW(2008), 8--12.

[9]

Roberto González-Ibáñez, Chirag Shah, and Natalia Cordova-Rubio. 2011. Smile! Studying expressivity of happiness as a synergic factor in collaborative infor-mation seeking. Proceedings of the American Society for Information Science and Technology 48, 1 (2011), 1--10.

[10]

Roberto González-ibáñez and Chirag Shah. 2011. Coagmento: A System for Supporting Collaborative Information Seeking. The 74th Annual Meeting of the American Society for Information Science and Technology ASIST 2011(2011).

[11]

Paul Grau. 2017. Balanced Latin Squares in PythonâĂŞ Paul Grau âĂŞ Medium. https://medium.com/@graycoding/balanced-latin-squares-in-python-2c3aa6ec95b9

[12]

Chathra Hendahewa and Chirag Shah. 2017. Evaluating User Search Trailsin Exploratory Search Tasks. Inf. Process. Manage. 53, 4 (July 2017), 905--922.

Digital Library

[13]

Hugo C. Huurdeman, Max L. Wilson, and Jaap Kamps. 2016. Active and Passive Utility of Search Interface Features in Different Information Seeking Task Stages. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval (CHIIR '16). ACM, New York, NY, USA, 3--12.

Digital Library

[14]

Diane Kelly and Colleen Cool. 2002.The Effects of Topic Familiarity on Information Search Behavior. In Proceedings of the 2Nd ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '02). ACM, New York, NY, USA, 74--75.

Digital Library

[15]

Simon Knight, Bart Rienties, Karen Littleton, Matthew Mitsui, Dirk Tempelaar, and Chirag Shah. 2017. The relationship of (perceived) epistemic cognition to interaction with resources on the internet. Computers in Human Behavior 73,Supplement C (2017), 507--518.

Digital Library

[16]

Yuelin Li and Nicholas J. Belkin. 2008. A faceted approach to conceptualizing tasks in information seeking. Information Processing and Management 44, 6 (2008). Adaptive Information Retrieval.

Digital Library

[17]

Chang Liu, Jingjing Liu, Michael Cole, Nicholas J. Belkin, and Xiangmin Zhang.{n. d.}. Task difficulty and domain knowledge effects on information search behaviors.Proceedings of the American Society for Information Science and Technology 49, 1 ({n. d.}), 1--10.

[18]

Mihai Lupu. 2012. Patent Information Retrieval: An Instance of Domain-specific Search. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '12). ACM, New York, NY, USA,1189--1190.

Digital Library

[19]

Matthew Mitsui, Jiqun Liu, Nicholas J. Belkin, and Chirag Shah. 2017. Predicting Information Seeking Intentions from Search Behaviors. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '17). ACM, New York, NY, USA, 1121--1124.

Digital Library

[20]

Matthew Mitsui, Jiqun Liu, and Chirag Shah. 2018. Coagmento: Past, Present, and Future of an Individual and Collaborative Information Seeking Platform. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval(CHIIR '18). ACM, New York, NY, USA, 325--328.

Digital Library

[21]

Matthew Mitsui, Jiqun Liu, and Chirag Shah. 2018. The Paradox of Personalization: Does Task Prediction Require Individualized Models?. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (CHIIR '18). ACM, New York, NY, USA, 277--280.

Digital Library

[22]

Sophie Monchaux, Franck Amadieu, Aline Chevalier, and Claudette Marin 2015. Query strategies during information searching: Effects of prior domain knowledge and complexity of the information problems to be solved. Information Processing & Management 51, 5 (2015), 557--569.

Digital Library

[23]

Meredith Ringel Morris and Eric Horvitz. 2007. Search Together: An Interface for Collaborative Web Search. In Proceedings of the 20th ACM UIST Symposium (UIST'07). ACM, New York, NY, USA, 3--12.

Digital Library

[24]

Kira Radinsky, Krysta M. Svore, Susan T. Dumais, Milad Shokouhi, Jaime Teevan, Alex Bocharov, and Eric Horvitz. 2013. Behavioral Dynamics on the Web: Learning, Modeling, and Prediction. ACM Trans. Inf. Syst. 31, 3, Article 16 (Aug. 2013),37 pages.

Digital Library

[25]

Georg P. Schoenherr and Ryen W. White. 2014. Interactions Between Health Searchers and Search Engines. In Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR '14). ACM, New York, NY, USA, 143--152.

Digital Library

[26]

Chirag Shah and Roberto González-Ibáñez. 2012. Spatial context in collaborative information seeking. Journal of Information Science38, 4 (2012), 333--349.

Digital Library

[27]

Michael B. Twidale, David M. Nichols, and Chris D. Paice. 1997. Browsingis a collaborative process. Information Processing & Management 33, 6 (1997).

Digital Library

[28]

Ingmar Weber and Carlos Castillo. 2010. The Demographics of Web Search. In Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '10). ACM, New York, NY, USA,523--530.

Digital Library

Cited By

Ros KZhai C(2023)The CDL: An Online Platform for Creating Community-based Digital LibrariesCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3607495(372-375)Online publication date: 14-Oct-2023
https://dl.acm.org/doi/10.1145/3584931.3607495
Akbari ANowkarizi MRostami RMoghimi A(2022)The role of psychological, skill level and demographic variables in information-seeking behaviours in mental health professionalsJournal of Information Science10.1177/0165551522109236350:2(420-433)Online publication date: 21-Apr-2022
https://doi.org/10.1177/01655515221092363
Gäde MKoolen MHall MBogers TPetras VScholer FThomas PElsweiler DJoho HKando NSmith C(2021)A Manifesto on Resource Re-Use in Interactive Information RetrievalProceedings of the 2021 Conference on Human Information Interaction and Retrieval10.1145/3406522.3446056(141-149)Online publication date: 14-Mar-2021
https://dl.acm.org/doi/10.1145/3406522.3446056
Show More Cited By

Index Terms

Coagmento v3.0: Rapid Prototyping of Web Search Experiments
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing systems and tools
      1. Open source software
2. Information systems
  1. Information retrieval
    1. Evaluation of retrieval results
      1. Test collections
    2. Users and interactive retrieval
      1. Search interfaces
      2. Task models

Recommendations

Coagmento: Past, Present, and Future of an Individual and Collaborative Information Seeking Platform
CHIIR '18: Proceedings of the 2018 Conference on Human Information Interaction & Retrieval

In this demo, we present Coagmento, a Web-based, open-source tool for information seeking projects that collects information for individuals and groups and helps facilitate collaborative information seeking. Coagmento has been used in information ...
What's Missing from Collaborative Search?

Research shows that people frequently try to search for information with other people. The fact that no user interface for collaborative searching has yet caught fire suggests that the best parts of the design space have yet to be investigated.
Influences on Query Reformulation in Collaborative Web Search

Past analysis has considered query reformulation primarily from the perspective of individual Web searches. Findings from a recent study suggest ways that collaboration during the search process influences how users generate new terms for query ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval

March 2019

463 pages

ISBN:9781450360258

DOI:10.1145/3295750

General Chairs:
Leif Azzopardi
University of Strathclyde, UK
,
Martin Halvey
University of Strathclyde, UK
,
Ian Ruthven
University of Strathclyde, UK
,
Program Chairs:
Hideo Joho
University of Tsukuba, Japan
,
Vanessa Murdock
Amazon, USA
,
Pernilla Qvarfordt
pxq Labs, USA

Copyright © 2019 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2019

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

National Science Foundation

Conference

CHIIR '19

Sponsor:

CHIIR '19: Conference on Human Information Interaction and Retrieval

March 10 - 14, 2019

Glasgow, Scotland UK

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
330
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)5

Reflects downloads up to 23 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ros KZhai C(2023)The CDL: An Online Platform for Creating Community-based Digital LibrariesCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3607495(372-375)Online publication date: 14-Oct-2023
https://dl.acm.org/doi/10.1145/3584931.3607495
Akbari ANowkarizi MRostami RMoghimi A(2022)The role of psychological, skill level and demographic variables in information-seeking behaviours in mental health professionalsJournal of Information Science10.1177/0165551522109236350:2(420-433)Online publication date: 21-Apr-2022
https://doi.org/10.1177/01655515221092363
Gäde MKoolen MHall MBogers TPetras VScholer FThomas PElsweiler DJoho HKando NSmith C(2021)A Manifesto on Resource Re-Use in Interactive Information RetrievalProceedings of the 2021 Conference on Human Information Interaction and Retrieval10.1145/3406522.3446056(141-149)Online publication date: 14-Mar-2021
https://dl.acm.org/doi/10.1145/3406522.3446056
Wang YShah C(2021)Authentic versus synthetic: An investigation of the influences of study settings and task configurations on search behaviorsJournal of the Association for Information Science and Technology10.1002/asi.24554Online publication date: 28-Jul-2021
https://doi.org/10.1002/asi.24554
Fuhrmann RLehmann AMitschick ALangner RDachselt RPreim BNürnberger AHansen C(2020)CoFindProceedings of Mensch und Computer 202010.1145/3404983.3410012(425-429)Online publication date: 6-Sep-2020
https://dl.acm.org/doi/10.1145/3404983.3410012
Hall MBogers TO'Brien HFreund LArapakis IHoeber OLopatovska I(2020)A Standardised Format for Exchanging User Study InstrumentsProceedings of the 2020 Conference on Human Information Interaction and Retrieval10.1145/3343413.3377984(457-461)Online publication date: 14-Mar-2020
https://dl.acm.org/doi/10.1145/3343413.3377984

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents