research-article

Quotebank: A Corpus of Quotations from a Decade of News

Authors:

Timoté Vaucher,

Michele Catasta,

Robert WestAuthors Info & Claims

WSDM '21: Proceedings of the 14th ACM International Conference on Web Search and Data Mining

Pages 328 - 336

https://doi.org/10.1145/3437963.3441760

Published: 08 March 2021 Publication History

Abstract

We present Quotebank, an open corpus of 178 million quotations attributed to the speakers who uttered them, extracted from 162 million English news articles published between 2008 and 2020. In order to produce this Web-scale corpus, while at the same time benefiting from the performance of modern neural models, we introduce Quobert, a minimally supervised framework for extracting and attributing quotations from massive corpora. Quobert avoids the necessity of manually labeled input and instead exploits the redundancy of the corpus by bootstrapping from a single seed pattern to extract training data for fine-tuning a BERT-based model. Quobert is language- and corpus agnostic and correctly attributes 86.9% of quotations in our experiments. Quotebank and Quobert are publicly available at https://doi.org/10.5281/zenodo.4277311.

References

[1]

Eugene Agichtein and Luis Gravano. 2000. Snowball: Extracting Relations From Large Plain-text Collections. In Proceedings of the Fifth ACM Conference on Digital Libraries . https://doi.org/10.1145/336597.336644

Digital Library

[2]

Mariana S. C. Almeida, Miguel B. Almeida, and André F. T. Martins. 2014. A Joint Model for Quotation Attribution and Coreference Resolution. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, EACL. https://doi.org/10.3115/v1/e14--1005

[3]

Kevin Burton, Niels Kasch, and Ian Soboroff. 2011. The ICWSM 2011 Spinn3r Dataset. In Proceedings of the Fifth Annual Conference on Weblogs and Social Media, ICWSM .

[4]

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT. https://doi.org/10.18653/v1/n19--1423

[5]

David K. Elson and Kathleen R. McKeown. 2010. Automatic Attribution of Quoted Speech in Literary Narrative. In Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, AAAI . http://www.aaai.org/ocs/index.php/AAAI/AAAI10/paper/view/1945

[6]

Marti A. Hearst. 1992. Automatic Acquisition of Hyponyms from Large Text Corpora. In 14th International Conference on Computational Linguistics, COLING. https://www.aclweb.org/anthology/C92--2082/

Digital Library

[7]

Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR. http://arxiv.org/abs/1412.6980

[8]

Mark Leibovich. 2019. How Lindsey Graham Went From Trump Skeptic to Trump Sidekick. The New York Times (February 25, 2019). https://www.nytimes.com/2019/02/25/magazine/lindsey-graham-what-happened-trump.html

[9]

Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Rose Finkel, Steven Bethard, and David McClosky. 2014. The Stanford CoreNLP Natural Language Processing Toolkit. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, ACL. 55--60. https://doi.org/10.3115/v1/p14--5010

[10]

Mike Mintz, Steven Bills, Rion Snow, and Daniel Jurafsky. 2009. Distant supervision for relation extraction without labeled data. In Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics, ACL, and the 4th International Joint Conference on Natural Language Processing of the AFNLP . https://www.aclweb.org/anthology/P09--1113/

[11]

Grace Muzny, Michael Fang, Angel X. Chang, and Dan Jurafsky. 2017. A Two-stage Sieve Approach for Quote Attribution. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, EACL. https://doi.org/10.18653/v1/e17--1044

[12]

Chris Newell, Tim Cowlishaw, and David Man. 2018. Quote Extraction and Analysis for News. In KDD Workshop on Data Science, Journalism & Media, DSJM.

[13]

Vlad Niculae, Caroline Suen, Justine Zhang, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2015. QUOTUS: The Structure of Political Media Coverage as Revealed by Quoting Patterns. In Proceedings of the 24th International Conference on World Wide Web, WWW. https://doi.org/10.1145/2736277.2741688

Digital Library

[14]

Timothy O'Keefe, Silvia Pareti, James R. Curran, Irena Koprinska, and Matthew Honnibal. 2012. A Sequence Labelling Approach to Quote Attribution. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, EMNLP-CoNLL . https://www.aclweb.org/anthology/D12--1072/

Digital Library

[15]

Timothy O'Keefe, Kellie Webster, James R. Curran, and Irena Koprinska. 2013. Examining the Impact of Coreference Resolution on Quote Attribution. In Proceedings of the Australasian Language Technology Association Workshop, ALTA. https://www.aclweb.org/anthology/U13--1007/

[16]

Silvia Pareti, Timothy O'Keefe, Ioannis Konstas, James R. Curran, and Irena Koprinska. 2013. Automatically Detecting and Attributing Indirect Quotations. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, EMNLP. https://www.aclweb.org/anthology/D13--1101/

[17]

Dario Pavllo, Tiziano Piccardi, and Robert West. 2018. Quootstrap: Scalable Unsupervised Extraction of Quotation-Speaker Pairs from Large News Corpora via Bootstrapping. In Proceedings of the Twelfth International Conference on Web and Social Media, ICWSM. https://aaai.org/ocs/index.php/ICWSM/ICWSM18/paper/view/17827

[18]

Bruno Pouliquen, Ralf Steinberger, and Clive Best. 2007. Automatic Detection of Quotations in Multilingual News. In Proceedings of the International Conference on Recent Advances in Natural Language Processing, RANLP.

[19]

Andrew Salway, Paul Meurer, Knut Hofland, and Øystein Reigem. 2017. In Proceedings of the 21st Nordic Conference on Computational Linguistics, NODALIDA. http://www.ep.liu.se/ecp/article.asp?issue=131&article=041&volume=

[20]

Andreas Spitz and Michael Gertz. 2018. Exploring Entity-centric Networks in Entangled News Streams. In Companion of the The Web Conference, WWW. https://doi.org/10.1145/3184558.3188726

[21]

Caroline Suen, Sandy Huang, Chantat Eksombatchai, Rok Sosic, and Jure Leskovec. 2013. NIFTY: A System for Large Scale Information Flow Tracking and Clustering. In 22nd International World Wide Web Conference, WWW. https://doi.org/10.1145/2488388.2488496

[22]

Thomas Pellissier Tanon, Denny Vrandecic, Sebastian Schaffert, Thomas Steiner, and Lydia Pintscher. 2016. From Freebase to Wikidata: The Great Migration. In Proceedings of the 25th International Conference on World Wide Web, WWW. https://doi.org/10.1145/2872427.2874809

Digital Library

[23]

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems, NeurIPS . http://papers.nips.cc/paper/7181-attention-is-all-you-need

[24]

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Ré mi Louf, Morgan Funtowicz, and Jamie Brew. 2019. HuggingFace's Transformers: State-of-the-art Natural Language Processing. CoRR, Vol. abs/1910.03771 (2019). arxiv: 1910.03771 http://arxiv.org/abs/1910.03771

[25]

Yi Zhang, Zachary G. Ives, and Dan Roth. 2020. "Who said it, and Why?" Provenance for Natural Language Claims. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL. https://www.aclweb.org/anthology/2020.acl-main.406/

Cited By

Wu PZhang YTan WIves Z(2024)QuoteInspector: Gaining Insight about Social Media DiscussionsProceedings of the VLDB Endowment10.14778/3685800.368591017:12(4501-4504)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.14778/3685800.3685910
Zhang WGui LProcter RHe YHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Multi-Layer Ranking with Large Language Models for News Source RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657966(2537-2542)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657966
Kuculo TGottschalk S(2024)Event Analysis Through QuoteKG: A Multilingual Knowledge Graph of QuotesEvent Analytics across Languages and Communities10.1007/978-3-031-64451-1_7(123-148)Online publication date: 17-Jun-2024
https://doi.org/10.1007/978-3-031-64451-1_7
Show More Cited By

Index Terms

Quotebank: A Corpus of Quotations from a Decade of News
1. Computing methodologies
  1. Machine learning
    1. Learning paradigms
      1. Supervised learning
2. Information systems
  1. World Wide Web
    1. Web mining

Recommendations

Unsupervised identification of persian compound verbs
MICAI'11: Proceedings of the 10th Mexican international conference on Advances in Artificial Intelligence - Volume Part I

One of the main tasks related to multiword expressions (MWEs) is compound verb identification. There have been so many works on unsupervised identification of multiword verbs in many languages, but there has not been any conspicuous work on Persian ...
The bootstrapping of the Yarowsky algorithm in real corpora

The Yarowsky bootstrapping algorithm resolves the homograph-level word sense disambiguation (WSD) problem, which is the sense granularity level required for real natural language processing (NLP) applications. At the same time it resolves the knowledge ...
In search of a suitable method for disambiguation of word senses in Bengali
Abstract
The paper presents a study on word sense disambiguation (WSD) in Bengali, one of the less resourced Indian languages. The overall work is carried out in two sequential phases. In the first phase, four well-known approaches, which are often applied ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

WSDM '21: Proceedings of the 14th ACM International Conference on Web Search and Data Mining

March 2021

1192 pages

ISBN:9781450382977

DOI:10.1145/3437963

General Chairs:
Liane Lewin-Eytan
Amazon, Israel
,
David Carmel
Amazon, Israel
,
Elad Yom-Tov
Microsoft, Israel
,
Program Chairs:
Eugene Agichtein
Emory University and Amazon, USA
,
Evgeniy Gabrilovich
Google Health, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Swiss National Science Foundation

Conference

WSDM '21

Sponsor:

WSDM '21: The Fourteenth ACM International Conference on Web Search and Data Mining

March 8 - 12, 2021

Virtual Event, Israel

Acceptance Rates

Overall Acceptance Rate 498 of 2,863 submissions, 17%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
464
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)4

Reflects downloads up to 27 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wu PZhang YTan WIves Z(2024)QuoteInspector: Gaining Insight about Social Media DiscussionsProceedings of the VLDB Endowment10.14778/3685800.368591017:12(4501-4504)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.14778/3685800.3685910
Zhang WGui LProcter RHe YHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Multi-Layer Ranking with Large Language Models for News Source RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657966(2537-2542)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657966
Kuculo TGottschalk S(2024)Event Analysis Through QuoteKG: A Multilingual Knowledge Graph of QuotesEvent Analytics across Languages and Communities10.1007/978-3-031-64451-1_7(123-148)Online publication date: 17-Jun-2024
https://doi.org/10.1007/978-3-031-64451-1_7
Amirshahi AKirsch NReymond JBaghersalimi S(2023)Predicting Survey Response with Quotation-based Modeling: A Case Study on Favorability towards the United States2023 10th IEEE Swiss Conference on Data Science (SDS)10.1109/SDS57534.2023.00008(1-8)Online publication date: Jun-2023
https://doi.org/10.1109/SDS57534.2023.00008
Külz JSpitz AAbu-Akel AGünnemann SWest R(2023)United States politicians’ tone became more negative with 2016 primary campaignsScientific Reports10.1038/s41598-023-36839-113:1Online publication date: 28-Jun-2023
https://doi.org/10.1038/s41598-023-36839-1
Vuković VArora AChang HSpitz AWest RAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)Quote Erat Demonstrandum: A Web Interface for Exploring the Quotebank CorpusProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531696(3350-3354)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3531696
Voloshyn SVysotska VMarkiv ODyyak IBudz ISchuchmann V(2022)Sentiment Analysis Technology of English Newspapers Quotes Based on Neural Network as Public Opinion Influences Identification Tool2022 IEEE 17th International Conference on Computer Sciences and Information Technologies (CSIT)10.1109/CSIT56902.2022.10000627(83-88)Online publication date: 10-Nov-2022
https://doi.org/10.1109/CSIT56902.2022.10000627
Kuculo TGottschalk SDemidova E(2022)QuoteKG: A Multilingual Knowledge Graph of QuotesThe Semantic Web10.1007/978-3-031-06981-9_21(353-369)Online publication date: 31-May-2022
https://doi.org/10.1007/978-3-031-06981-9_21

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents