Qlarify: Recursively Expandable Abstracts for Dynamic Information Retrieval over Scientific Papers
Authors: 
Raymond Fok, 
Joseph Chee Chang, 
Tal August, 
Amy X. Zhang, Daniel S. WeldAuthors Info & Claims
Article No.: 145, Pages 1 - 21
Abstract
Navigating the vast scientific literature often starts with browsing a paper’s abstract. However, when a reader seeks additional information, not present in the abstract, they face a costly cognitive chasm during their dive into the full text. To bridge this gap, we introduce recursively expandable abstracts, a novel interaction paradigm that dynamically expands abstracts by progressively incorporating additional information from the papers’ full text. This lightweight interaction allows scholars to specify their information needs by quickly brushing over the abstract or selecting AI-suggested expandable entities. Relevant information is synthesized using a retrieval-augmented generation approach, presented as a fluid, threaded expansion of the abstract, and made efficiently verifiable via attribution to relevant source-passages in the paper. Through a series of user studies, we demonstrate the utility of recursively expandable abstracts and identify future opportunities to support low-effort and just-in-time exploration of long-form information contexts through LLM-powered interactions.
References
[1]
Waleed Ammar, Dirk Groeneveld, Chandra Bhagavatula, Iz Beltagy, Miles Crawford, Doug Downey, Jason Dunkelberger, Ahmed Elgohary, Sergey Feldman, Vu Ha, Rodney Kinney, Sebastian Kohlmeier, Kyle Lo, Tyler Murray, Hsu-Han Ooi, Matthew Peters, Joanna Power, Sam Skjonsberg, Lucy Lu Wang, Chris Wilhelm, Zheng Yuan, Madeleine van Zuylen, and Oren Etzioni. 2018. Construction of the Literature Graph in Semantic Scholar. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3 (Industry Papers). Association for Computational Linguistics, New Orleans, LA, USA, 84–91. https://aclanthology.org/N18-3011
[2]
Tal August, Lucy Lu Wang, Jonathan Bragg, Marti A. Hearst, Andrew Head, and Kyle Lo. 2023. PaperPlain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processing. ACM Transactions on Computer-Human Interaction 30, 5 (Sept. 2023), 74:1–74:38. https://dl.acm.org/doi/10.1145/3589955
[3]
Jöran Beel and Bela Gipp. 2009. Google Scholar’s Ranking Algorithm: An Introductory Overview. In Proceedings of the 12th International Conference of the International Society for Scientometrics and Informetrics, Vol. 1. International Society for Scientometrics and Informetrics, Rio de Janeiro, Brazil, 230–241.
[4]
Mark Bernstein. 2009. On hypertext narrative. In Proceedings of the 20th ACM conference on Hypertext and hypermedia. Acm, Torino, Italy, 5–14. https://dl.acm.org/doi/10.1145/1557914.1557920
[5]
Bernd Bohnet, Vinh Q. Tran, Pat Verga, Roee Aharoni, Daniel Andor, Livio Baldini Soares, Massimiliano Ciaramita, Jacob Eisenstein, Kuzman Ganchev, Jonathan Herzig, Kai Hui, Tom Kwiatkowski, Ji Ma, Jianmo Ni, Lierni Sestorain Saralegui, Tal Schuster, William W. Cohen, Michael Collins, Dipanjan Das, Donald Metzler, Slav Petrov, and Kellie Webster. 2023. Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models. http://arxiv.org/abs/2212.08037 arXiv:2212.08037 [cs].
[6]
Isabel Cachola, Kyle Lo, Arman Cohan, and Daniel Weld. 2020. TLDR: Extreme Summarization of Scientific Documents. In Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, Online, 4766–4777. https://aclanthology.org/2020.findings-emnlp.428
[7]
Joel Chan, Joseph Chee Chang, Tom Hope, Dafna Shahaf, and Aniket Kittur. 2018. SOLVENT: A Mixed Initiative System for Finding Analogies between Research Papers. Proceedings of the ACM on Human-Computer Interaction 2, Cscw (Nov. 2018), 1–21. https://dl.acm.org/doi/10.1145/3274300
[8]
Joseph Chee Chang, Amy X. Zhang, Jonathan Bragg, Andrew Head, Kyle Lo, Doug Downey, and Daniel S. Weld. 2023. CiteSee: Augmenting Citations in Scientific Papers with Persistent and Personalized Historical Context. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(Chi ’23). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3544548.3580847
[9]
ChatDOC. 2023. ChatDOC - Chat with your documents. Retrieved September 26, 2023 from https://chatdoc.com/
[10]
ChatPDF. 2023. ChatPDF - Chat with any PDF. Retrieved September 26, 2023 from https://www.chatpdf.com/
[11]
Duen Horng Chau, Aniket Kittur, Jason I. Hong, and Christos Faloutsos. 2011. Apolo: interactive large graph sensemaking by combining machine learning and visualization. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Acm, San Diego, CA, USA, 739–742. https://dl.acm.org/doi/10.1145/2020408.2020524
[12]
Eunsol Choi, Jennimaria Palomaki, Matthew Lamm, Tom Kwiatkowski, Dipanjan Das, and Michael Collins. 2021. Decontextualization: Making Sentences Stand-Alone. Transactions of the Association for Computational Linguistics 9 (April 2021), 447–461. https://doi.org/10.1162/tacl_a_00377
[13]
Johan S. G. Chu and James A. Evans. 2021. Slowed canonical progress in large fields of science. Proceedings of the National Academy of Sciences 118, 41 (Oct. 2021), e2021636118. https://www.pnas.org/doi/10.1073/pnas.2021636118 Publisher: Proceedings of the National Academy of Sciences.
[14]
Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, and Matt Gardner. 2021. A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Online, 4599–4610. https://aclanthology.org/2021.naacl-main.365
[15]
Elicit. 2023. Elicit - The AI Research Assistant. Retrieved September 26, 2023 from https://elicit.com/
[16]
Raymond Fok, Hita Kambhamettu, Luca Soldaini, Jonathan Bragg, Kyle Lo, Marti Hearst, Andrew Head, and Daniel S Weld. 2023. Scim: Intelligent Skimming Support for Scientific Papers. In Proceedings of the 28th International Conference on Intelligent User Interfaces. Acm, Sydney, NSW, Australia, 476–490. https://dl.acm.org/doi/10.1145/3581641.3584034
[17]
Allen Institute for AI. 2022. Pdf-component-library. Allen Institute for AI. https://github.com/allenai/pdf-component-library
[18]
Allen Institute for AI. 2023. MMDA - Multimodal Document Analysis. Allen Institute for AI. https://github.com/allenai/mmda
[19]
National Science Foundation. 2021. Publications Output: U.S. Trends and International Comparisons. https://ncses.nsf.gov/pubs/nsb20214
[20]
Luyu Gao, Zhuyun Dai, Panupong Pasupat, Anthony Chen, Arun Tejasvi Chaganty, Yicheng Fan, Vincent Zhao, Ni Lao, Hongrae Lee, Da-Cheng Juan, and Kelvin Guu. 2023. RARR: Researching and Revising What Language Models Say, Using Language Models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Anna Rogers, Jordan Boyd-Graber, and Naoaki Okazaki (Eds.). Association for Computational Linguistics, Toronto, Canada, 16477–16508. https://aclanthology.org/2023.acl-long.910
[21]
Samira Ghodratnama, Mehrdad Zakershahrak, and Fariborz Sobhanmanesh. 2021. Adaptive Summaries: A Personalized Concept-Based Summarization Approach by Learning from Users’ Feedback. In Service-Oriented Computing – ICSOC 2020 Workshops, Hakim Hacid, Fatma Outay, Hye-young Paik, Amira Alloum, Marinella Petrocchi, Mohamed Reda Bouadjenek, Amin Beheshti, Xumin Liu, and Abderrahmane Maaradji (Eds.). Springer International Publishing, Cham, 281–293.
[22]
Grobid. 2008–2023. Grobid. https://github.com/kermitt2/grobid
[23]
Tovi Grossman, Fanny Chevalier, and Rubaiat Habib Kazi. 2015. Your Paper is Dead! Bringing Life to Research Articles with Animated Figures. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems(Chi Ea ’15). Association for Computing Machinery, New York, NY, USA, 461–475. https://dl.acm.org/doi/10.1145/2702613.2732501
[24]
Jiangen He, Qing Ping, Wen Lou, and Chaomei Chen. 2019. PaperPoles: Facilitating adaptive visual exploration of scientific publications by citation links. Journal of the Association for Information Science and Technology 70, 8 (2019), 843–857. https://onlinelibrary.wiley.com/doi/abs/10.1002/asi.24171
[25]
Andrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok, Sam Skjonsberg, Daniel S. Weld, and Marti A. Hearst. 2021. Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbols. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(Chi ’21). Association for Computing Machinery, New York, NY, USA, 1–18. https://dl.acm.org/doi/10.1145/3411764.3445648
[26]
Nouf Ibrahim Altmami and Mohamed El Bachir Menai. 2022. Automatic summarization of scientific articles: A survey. Journal of King Saud University - Computer and Information Sciences 34, 4 (April 2022), 1011–1028. https://www.sciencedirect.com/science/article/pii/S1319157820303554
[27]
Emi Ishita, Yasuko Hagiwara, Yukiko Watanabe, and Yoichi Tomiura. 2018. Which Parts of Search Results do Researchers Check when Selecting Academic Documents?. In Proceedings of the 18th ACM/IEEE on Joint Conference on Digital Libraries(Jcdl ’18). Association for Computing Machinery, New York, NY, USA, 345–346. https://dl.acm.org/doi/10.1145/3197026.3203867
[28]
Farnaz Jahanbakhsh, Elnaz Nouri, Robert Sim, Ryen W. White, and Adam Fourney. 2022. Understanding Questions that Arise When Working with Business Documents. Proceedings of the ACM on Human-Computer Interaction 6, Cscw2 (Nov. 2022), 341:1–341:24. https://dl.acm.org/doi/10.1145/3555761
[29]
Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. 2023. Survey of Hallucination in Natural Language Generation. Comput. Surveys 55, 12 (Dec. 2023), 1–38. https://dl.acm.org/doi/10.1145/3571730
[30]
Hyeonsu Kang, Joseph Chee Chang, Yongsung Kim, and Aniket Kittur. 2022. Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific Literature. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology(Uist ’22). Association for Computing Machinery, New York, NY, USA, 1–15. https://dl.acm.org/doi/10.1145/3526113.3545660
[31]
Hyeonsu B Kang, Rafal Kocielnik, Andrew Head, Jiangjiang Yang, Matt Latzke, Aniket Kittur, Daniel S Weld, Doug Downey, and Jonathan Bragg. 2022. From Who You Know to What You Read: Augmenting Scientific Recommendations with Implicit Social Networks. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (Chi ’22). Association for Computing Machinery, New York, NY, USA, Article 302, 23 pages. https://doi.org/10.1145/3491102.3517470
[32]
Hyeonsu B Kang, Nouran Soliman, Matt Latzke, Joseph Chee Chang, and Jonathan Bragg. 2023. ComLittee: Literature Discovery with Personal Elected Author Committees. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Acm, Hamburg, Germany, 1–20. https://dl.acm.org/doi/10.1145/3544548.3581371
[33]
Hyeonsu B Kang, Tongshuang Wu, Joseph Chee Chang, and Aniket Kittur. 2023. Synergi: A Mixed-Initiative System for Scholarly Synthesis and Sensemaking. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (San Francisco, CA, USA) (Uist ’23). Association for Computing Machinery, New York, NY, USA, Article 43, 19 pages. https://doi.org/10.1145/3586183.3606759
[34]
Tae Soo Kim, Matt Latzke, Jonathan Bragg, Amy X. Zhang, and Joseph Chee Chang. 2023. Papeos: Augmenting Research Papers with Talk Videos. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (San Francisco, CA, USA) (Uist ’23). Association for Computing Machinery, New York, NY, USA, Article 15, 19 pages. https://doi.org/10.1145/3586183.3606770
[35]
Jeffrey W. Knopf. 2006. Doing a Literature Review. PS: Political Science and Politics 39, 1 (2006), 127–132. https://www.jstor.org/stable/20451692
[36]
Wei-Jen Ko, Te-yuan Chen, Yiyan Huang, Greg Durrett, and Junyi Jessy Li. 2020. Inquisitive Question Generation for High Level Text Comprehension. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Online, 6544–6555. https://aclanthology.org/2020.emnlp-main.530
[37]
Huan Yee Koh, Jiaxin Ju, Ming Liu, and Shirui Pan. 2022. An Empirical Survey on Long Document Summarization: Datasets, Models, and Metrics. Comput. Surveys 55, 8 (Dec. 2022), 154:1–154:35. https://doi.org/10.1145/3545176
[38]
Vaibhav Kumar and Alan W Black. 2020. ClarQ: A large-scale and diverse dataset for Clarification Question Generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 7296–7301. https://aclanthology.org/2020.acl-main.651
[39]
Esther Landhuis. 2016. Scientific literature: Information overload. Nature 535, 7612 (July 2016), 457–458. https://www.nature.com/articles/nj7612-457a
[40]
Byungjoo Lee, Olli Savisaari, and Antti Oulasvirta. 2016. Spotlights: Attention-Optimized Highlights for Skim Reading. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(Chi ’16). Association for Computing Machinery, New York, NY, USA, 5203–5214. https://dl.acm.org/doi/10.1145/2858036.2858299
[41]
Ziming Liu. 2005. Reading behavior in the digital environment: Changes in reading behavior over the past ten years. Journal of Documentation 61, 6 (Jan. 2005), 700–712. https://doi.org/10.1108/00220410510632040
[42]
Kyle Lo, Lucy Lu Wang, Mark Neumann, Rodney Kinney, and Daniel Weld. 2020. S2ORC: The Semantic Scholar Open Research Corpus. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 4969–4983. https://www.aclweb.org/anthology/2020.acl-main.447
[43]
Justin Matejka, Tovi Grossman, and George Fitzmaurice. 2021. Paper Forager: Supporting the Rapid Exploration of Research Document Collections. In Proceedings of Graphics Interface(Gi 2021). Canadian Information Processing Society, Online, 237–245.
[44]
Joshua Maynez, Shashi Narayan, Bernd Bohnet, and Ryan McDonald. 2020. On Faithfulness and Factuality in Abstractive Summarization. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 1906–1919. https://aclanthology.org/2020.acl-main.173
[45]
Yan Meng, Liangming Pan, Yixin Cao, and Min-Yen Kan. 2023. FollowupQG: Towards information-seeking follow-up question generation. In Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), Jong C. Park, Yuki Arase, Baotian Hu, Wei Lu, Derry Wijaya, Ayu Purwarianti, and Adila Alfa Krisnadhi (Eds.). Association for Computational Linguistics, Nusa Dua, Bali, 252–271. https://aclanthology.org/2023.ijcnlp-main.17
[46]
Jacob Menick, Maja Trebacz, Vladimir Mikulik, John Aslanides, Francis Song, Martin Chadwick, Mia Glaese, Susannah Young, Lucy Campbell-Gillingham, Geoffrey Irving, and Nat McAleese. 2022. Teaching language models to support answers with verified quotes. http://arxiv.org/abs/2203.11147 arXiv:2203.11147 [cs].
[47]
Meredith Ringel Morris. 2023. Scientists’ Perspectives on the Potential for Generative AI in their Fields. arxiv:2304.01420 [cs.CY] https://arxiv.org/abs/2304.01420
[48]
Sheshera Mysore, Mahmood Jasim, Haoru Song, Sarah Akbar, Andre Kenneth Chase Randall, and Narges Mahyar. 2023. How Data Scientists Review the Scholarly Literature. In Proceedings of the 2023 Conference on Human Information Interaction and Retrieval(Chiir ’23). Association for Computing Machinery, New York, NY, USA, 137–152. https://dl.acm.org/doi/10.1145/3576840.3578309
[49]
Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen Krueger, Kevin Button, Matthew Knight, Benjamin Chess, and John Schulman. 2022. WebGPT: Browser-assisted question-answering with human feedback. http://arxiv.org/abs/2112.09332 arXiv:2112.09332 [cs].
[50]
Theodor H. Nelson. 1983. Literary Machines: The Report On, and Of, Project Xanadu Concerning Word Processing, Electronic Publishing, Hypertext, Thinkertoys, Tomorrow’s Intellectual Revolution, and Certain Other Topics Including Knowledge, Education and Freedom.
[51]
Benjamin Newman, Luca Soldaini, Raymond Fok, Arman Cohan, and Kyle Lo. 2023. A Question Answering Framework for Decontextualizing User-facing Snippets from Scientific Documents. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 3194–3212. https://aclanthology.org/2023.emnlp-main.193
[52]
Srishti Palani, Aakanksha Naik, Doug Downey, Amy X. Zhang, Jonathan Bragg, and Joseph Chee Chang. 2023. Relatedly: Scaffolding Literature Reviews with Existing Related Work Sections. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(Chi ’23). Association for Computing Machinery, New York, NY, USA, 1–20. https://dl.acm.org/doi/10.1145/3544548.3580841
[53]
Pallets. 2023. Welcome to Flask – Flask Documentation (2.3.x). Retrieved August 27, 2023 from https://flask.palletsprojects.com/en/2.3.x/
[54]
Connected Papers. 2023. Connected Papers | Find and explore academic papers. Retrieved September 26, 2023 from https://www.connectedpapers.com/
[55]
Pontus Plavén-Sigray, Granville James Matheson, Björn Christian Schiffler, and William Hedley Thompson. 2017. The readability of scientific texts is decreasing over time. eLife 6 (Sept. 2017), e27725. https://doi.org/10.7554/eLife.27725
[56]
Antoine Ponsard, Francisco Escalona, and Tamara Munzner. 2016. PaperQuest: A Visualization Tool to Support Literature Review. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(Chi Ea ’16). Association for Computing Machinery, New York, NY, USA, 2264–2271. https://dl.acm.org/doi/10.1145/2851581.2892334
[57]
Napol Rachatasumrit, Jonathan Bragg, Amy X. Zhang, and Daniel S Weld. 2022. CiteRead: Integrating Localized Citation Contexts into Scientific Paper Reading. In Proceedings of the 27th International Conference on Intelligent User Interfaces (Helsinki, Finland) (Iui ’22). Association for Computing Machinery, New York, NY, USA, 707–719. https://doi.org/10.1145/3490099.3511162
[58]
Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, Hong Kong, China, 3982–3992. https://aclanthology.org/D19-1410
[59]
Anna Rogers, Matt Gardner, and Isabelle Augenstein. 2023. QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension. Comput. Surveys 55, 10 (Feb. 2023), 197:1–197:45. https://doi.org/10.1145/3560260
[60]
Jon Saad-Falcon, Joe Barrow, Alexa Siu, Ani Nenkova, Ryan A. Rossi, and Franck Dernoncourt. 2023. PDFTriage: Question Answering over Long, Structured Documents. http://arxiv.org/abs/2309.08872 arXiv:2309.08872 [cs].
[61]
Ori Shapira, Ramakanth Pasunuru, Mohit Bansal, Ido Dagan, and Yael Amsterdamer. 2022. Interactive Query-Assisted Summarization via Deep Reinforcement Learning. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Seattle, WA, USA, 2551–2568. https://aclanthology.org/2022.naacl-main.184
[62]
Ayah Soufan, Ian Ruthven, and Leif Azzopardi. 2022. Searching the Literature: An Analysis of an Exploratory Search Task. In Proceedings of the 2022 Conference on Human Information Interaction and Retrieval (Regensburg, Germany) (Chiir ’22). Association for Computing Machinery, New York, NY, USA, 146–157. https://doi.org/10.1145/3498366.3505818
[63]
Meta Open Source. 2023. React. Retrieved August 27, 2023 from https://react.dev/
[64]
Nicole Sultanum, Christine Murad, and Daniel Wigdor. 2020. Understanding and Supporting Academic Literature Review Workflows with LitSense. In Proceedings of the 2020 International Conference on Advanced Visual Interfaces (Salerno, Italy) (Avi ’20). Association for Computing Machinery, New York, NY, USA, Article 67, 5 pages. https://doi.org/10.1145/3399715.3399830
[65]
Carol Tenopir, Donald King, Sheri Edwards, and Lei Wu. 2009. Electronic Journals and Changes in Scholarly Article Seeking and Reading Patterns. Carol Tenopir 61 (Jan. 2009), 5–32.
[66]
Maartje ter Hoeve, Robert Sim, Elnaz Nouri, Adam Fourney, Maarten de Rijke, and Ryen W. White. 2020. Conversations with Documents: An Exploration of Document-Centered Assistance. In Proceedings of the 2020 Conference on Human Information Interaction and Retrieval(Chiir ’20). Association for Computing Machinery, New York, NY, USA, 43–52. https://doi.org/10.1145/3343413.3377971
[67]
Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Vincent Zhao, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Pranesh Srinivasan, Laichee Man, Kathleen Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Aguera-Arcas, Claire Cui, Marian Croak, Ed Chi, and Quoc Le. 2022. LaMDA: Language Models for Dialog Applications. http://arxiv.org/abs/2201.08239 arXiv:2201.08239 [cs].
[68]
Katherine Tian, Eric Mitchell, Allan Zhou, Archit Sharma, Rafael Rafailov, Huaxiu Yao, Chelsea Finn, and Christopher Manning. 2023. Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 5433–5442. https://doi.org/10.18653/v1/2023.emnlp-main.330
[69]
Chris Tyler, KL Akerlof, Alessandro Allegra, Zachary Arnold, Henriette Canino, Marius A Doornenbal, Josh A Goldstein, David Budtz Pedersen, and William J Sutherland. 2023. AI tools as science policy advisers? The potential and the pitfalls. Nature 622, 7981 (2023), 27–30.
[70]
Raymon van Dinter, Bedir Tekinerdogan, and Cagatay Catal. 2021. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology 136 (2021), 106589. https://doi.org/10.1016/j.infsof.2021.106589
[71]
Yun Wang, Dongyu Liu, Huamin Qu, Qiong Luo, and Xiaojuan Ma. 2016. A Guided Tour of Literature Review: Facilitating Academic Paper Reading with Narrative Visualization. In Proceedings of the 9th International Symposium on Visual Information Communication and Interaction(Vinci ’16). Association for Computing Machinery, New York, NY, USA, 17–24. https://doi.org/10.1145/2968220.2968242
[72]
Jeff Wu, Long Ouyang, Daniel M. Ziegler, Nisan Stiennon, Ryan Lowe, Jan Leike, and Paul Christiano. 2021. Recursively Summarizing Books with Human Feedback. http://arxiv.org/abs/2109.10862 arXiv:2109.10862 [cs].
[73]
Miao Xiong, Zhiyuan Hu, Xinyang Lu, YIFEI LI, Jie Fu, Junxian He, and Bryan Hooi. 2024. Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs. In The Twelfth International Conference on Learning Representations. OpenReview.net, Vienna, Austria.
[74]
Michihiro Yasunaga, Jungo Kasai, Rui Zhang, Alexander R Fabbri, Irene Li, Dan Friedman, and Dragomir R Radev. 2019. Scisummnet: A large annotated corpus and content-impact models for scientific paper summarization with citation networks. In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, Vol. 33(01). AAAI Press, Washington, DC, USA, 7386–7393.
[75]
J.D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, and Qian Yang. 2023. Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Acm, Hamburg, Germany, 1–21. https://dl.acm.org/doi/10.1145/3544548.3581388
[76]
Amy X. Zhang, Lea Verou, and David Karger. 2017. Wikum: Bridging Discussion Forums and Wikis Using Recursive Summarization. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. Acm, Portland, OR, USA, 2082–2096. https://dl.acm.org/doi/10.1145/2998181.2998235
[77]
Xiaoyu Zhang, Senthil Chandrasegaran, and Kwan-Liu Ma. 2021. ConceptScope: Organizing and Visualizing Knowledge in Documents based on Domain Ontology. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Acm, Yokohama, Japan, 1–13. https://dl.acm.org/doi/10.1145/3411764.3445396
[78]
Xiaoyu Zhang, Jianping Li, Po-Wei Chi, Senthil Chandrasegaran, and Kwan-Liu Ma. 2023. ConceptEVA: Concept-Based Interactive Exploration and Customization of Document Summaries. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Acm, Hamburg, Germany, 1–16. https://dl.acm.org/doi/10.1145/3544548.3581260
Index Terms
- Qlarify: Recursively Expandable Abstracts for Dynamic Information Retrieval over Scientific Papers
Recommendations
Recommending Scientific Papers: The Role of Citation Contexts
DTUC '18: Proceedings of the 1st International Conference on Digital Tools & Uses CongressThis paper addresses the problem of building recommender systems for scientific papers based on the linguistic and contextual analysis of citation contexts. We explain the importance of taking into consideration citation contexts and the different ...
PaperHunter: A System for Exploring Papers and Citation Contexts
Advances in Information RetrievalAbstractIn this paper, we present a system that allows researchers to search for papers and in-text citations in a novel way. Specifically, our system allows users to search for the textual contexts in which publications are cited (so-called citation ...
Insularity and citation behavior of scientific articles in young fields: the case of ethnobiology
We investigated some factors that can affect the citation behavior in young scientific fields by using ethnobiology as a research model. In particular, we sought to assess the degree of insularity in the citations of scientific articles and whether this ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2024
2334 pages
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
UIST '24
UIST '24: The 37th Annual ACM Symposium on User Interface Software and Technology
October 13 - 16, 2024
PA, Pittsburgh, USA
Acceptance Rates
Overall Acceptance Rate 561 of 2,567 submissions, 22%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 707Total Downloads
- Downloads (Last 12 months)707
- Downloads (Last 6 weeks)207
Reflects downloads up to 17 Feb 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in