Abstract
In this chapter we discuss proposals concerning the detection of non-referentiality and non-anaphoricity, and the integration of such methods in an anaphora resolution system. We first review in brief a number of proposals on the topics, also covering literature on detecting abstract anaphora and discussing available resources; we then discuss in detail the proposals by Bergsma on expletive detection, and by Poesio et al. and Kabadjov on discourse-new detection.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
And indeed, the clearest difference between ‘anaphora resolution’ as specified in theoretical linguistics/psycholinguistics and ‘coreference resolution’ as specified by the muc annotation guidelines lies precisely in the treatment of predicative and quantificational nps. In anaphora resolution predicative nps have no antecedents, but bound pronouns do; conversely, in coreference resolution the links between bound pronouns and the quantifiers that bound them are not annotated, but those between predicative nps and their ‘antecedents’ are. (See chapter “Annotated Corpora and Annotation Tools”.)
- 2.
- 3.
- 4.
GuiTAR’s dd resolution module is an implementation of the Vieira/Poesio algorithm, see chapter “Early Approaches to Anaphora Resolution: Theoretically Inspired and Heuristic-Based”.
- 5.
In the case where no antecedent has been proposed, these features assume a value of − 1.
- 6.
In the case where no antecedent has been proposed, these features assume a value of − 1.
- 7.
However, note that a ceiling of 100 % may be a bit too high based on earlier work by Poesio and Vieira [49] where inter-annotator agreement on the task was estimated at K = 0. 76 (kappa value).
- 8.
The baselines and ceiling scores were computed with some additional assumptions such as considering discourse-new those definite descriptions for which no antecedent was proposed by the original resolution algorithm.
- 9.
The remaining 7 % were set aside for validation and parameter tuning.
- 10.
The baseline here is baseline1 from the 10-X-Validation experiment (i.e., Vieira and Poesio’s direct anaphora algorithm).
- 11.
Assuming perfect dn classification.
References
Asher, N.: Reference to Abstract Objects in English. D. Reidel, Dordrecht (1993)
Asher, N., Wada, H.: BUILDRS: an implementation of DR theory and of LFG. In: Proceedings of COLING-86, FRG, Bonn, pp. 540–545 (1986)
Baldridge, J., Morton, T.: The openNLP MAXENT package. Software available at http://maxent.sourceforge.net/
Bean, D.L., Riloff, E.: Corpus-based identification of non-anaphoric noun phrases. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), College Park (1999)
Bergsma, S., Lin, D., Goebel, R.: Distributional identification of non-referential pronouns. In: Proceedings of ACL-08: HLT, Columbus, pp. 10–18 (2008)
Bergsma, S., Yarowsky, D.: NADA: a robust system for non-referential pronoun detection. In: Proceedings of DAARC, Faro, pp. 12–23 (2011)
Björkelund, A., Farkas, R.: Data-driven multilingual coreference resolution using resolver stacking. In: Joint Conference on EMNLP and CoNLL – Shared Task, Association for Computational Linguistics, Jeju Island, pp. 49–55 (2012). http://www.aclweb.org/anthology/W12-4503
Bos, J.: Wide-coverage semantic analysis with BOXER. In: Bos, J., Delmonte, R. (eds.) Proceedings of Semantics in Text Processing (STEP), pp. 277–286. College Publications, London (2008)
Boyd, A., Gegg-Harrison, W., Byron, D.: Identifying nonreferential it: a machine learning approach incorporating linguistically motivated patterns. In: Proceedings of the ACL Workshop on Feature Engineering for Machine Learning in Natural Language Processing, Ann Arbor, pp. 40–47 (2005)
Byron, D.: Resolving pronominal reference to abstract entities. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL) (2002)
Byron, D.K.: Resolving pronominal reference to abstract entities. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL ’02), Philadelphia, pp. 80–87 (2002)
Byron, D.K., Gegg-Harrison, W.: Eliminating non-referring noun phrases from coreference resolution. In: Proceedings of the Discourse Anaphora and Reference Resolution Conference (DAARC2004), Lancaster, pp. 21–26 (2004)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines (2001). Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
Charniak, E.: A maximum-entropy-inspired parser. In: Proceedings of the Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL), Seattle (2000)
Chen, B., Su, J., Pan, S.J., Tan, C.L.: A twin-candidate based approach for event pronoun resolution using composite kernel. In: Proceedings of the 23rd International Conference on Computational Linguistics (COLING), Beijing (2010)
Collovini, S., Vieira, R.: Learning discourse-new references in portuguese text. In: Proceedings of IFIP 19th World Computer Congress, Santiago, pp. 267–276. Springer (2006)
Daelemans, W.: TiMBL: Tilburg University memory based learner version 2 reference guide. Technical Report ILK99-01, Tilburg University (1999)
Denis, P., Baldridge, J.: Joint determination of anaphoricity and coreference resolution using integer programming. In: Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics, Rochester, pp. 236–243 (2007)
Dipper, S., Zinsmeister, H.: Annotating abstract anaphora. Lang. Res. Eval. 46 (1), 37–52 (2012)
Doddington, G., Mitchell, A., Przybocki, M., Ramshaw, L., Strassell, S., Weischedel, R.: The automatic content extraction (ACE) program–tasks, data, and evaluation. In: Proceedings of the Language Resources and Evaluation Conference, Lisbon (2004)
Eckert, M., Strube, M.: Dialogue acts, synchronising units and anaphora resolution. J. Semant. 17, 51–89 (2001)
Evans, R.: Applying machine learning toward an automatic classification of it. Lit. Linguist. Comput. 16 (1), 45–57 (2001)
Fraurud, K.: Definiteness and the processing of NPs in natural discourse. J. Semant. 7, 395–433 (1990)
Hawkins, J.A.: Definiteness and Indefiniteness. Croom Helm, London (1978)
Hirschman, L.: MUC-7 coreference task definition, version 3.0. In: Chinchor, N. (ed.) Proceedings of the 7th Message Understanding Conference. NIST (1998). Available online at http://www-nlpir.nist.gov/related_projects/muc/proceedings/muc_7_toc.html
Hirst, G.: Anaphora in Natural Language Understanding: A Survey. Springer, Berlin/New York (1981)
Hobbs, J.: Resolving pronoun references. Lingua 44 (311), 339–352 (1978)
Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., Weischedel, R.: OntoNotes: the 90 % solution. In: Proceedings of HLT/NAACL, New York (2006)
Kabadjov, M.A.: A comprehensive evaluation of anaphora resolution and discourse-new recognition. Ph.D. thesis, Department of Computer Science, University of Essex (2007)
Kamp, H., Reyle, U.: From Discourse to Logic. D. Reidel, Dordrecht (1993)
Karttunen, L.: Discourse referents. In: McKawley, J. (ed.) Sytax and Semantics, vol. 7, pp. 361–385. Academic Press, New York (1976)
Kolhatkar, V.: Resolving shell nouns. Ph.D. thesis, University of Toronto (2014)
Kong, F., Zhou, G.: Improve tree kernel-based event pronoun resolution with competitive information. In: Proceedings of IJCAI, Barcelona (2011)
Kong, F., Zhu, Q., Zhou, G.: Anaphoricity determination for coreference resolution in English and Chinese languages. J. Comput. Res. Dev. 49 (5), 1072 (2012)
Kummerfeld, J.K., Bansal, M., Burkett, D., Klein, D.: Mention detection: heuristics for the OntoNotes annotations. In: Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task, Association for Computational Linguistics, Portland, pp. 102–106 (2011). http://www.aclweb.org/anthology/W11-1916
Lappin, S., Leass, H.J.: An algorithm for pronominal anaphora resolution. Comput. Linguist. 20 (4), 535–562 (1994)
Loebner, S.: Natural language and generalised quantifier theory. In: Gärdenfors, P. (ed.) Generalized Quantifiers, pp. 93–108. D. Reidel, Dordrecht (1987)
Mitkov, R.: Anaphora Resolution. Longman, London/New York (2002)
Muzerelle, J., Lefeuvre, A., Schang, E., Antoine, J.Y., Pelletier, A., Maurel, D., Eshkol, I., Villaneau, J.: Ancor_centre, a large free spoken French coreference corpus. In: Proceedings of LREC, Reykjavik (2014)
Navarretta, C.: Pronominal types and abstract reference in the Danish and Italian dad corpora. In: Johansson, C. (ed.) Proceedings of the Second Workshop on Anaphora Resolution (WAR II), NEALT proceedings series, Bergen, pp. 63–71 (2008)
Ng, V.: Learning noun phrase anaphoricity to improve coreference resolution: issues in representation and optimization. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, Barcelona, pp. 152–159 (2004)
Ng, V., Cardie, C.: Identifying anaphoric and non-anaphoric noun phrases to improve coreference resolution. In: Proceedings of the 19th International Conference on Computational Linguistics, Taipei, pp. 730–736 (2002)
Nissim, M., Dingare, S., Carletta, J., Steedman, M.: An annotation scheme for information status in dialogue. In: Proceedings of LREC, Lisbon (2004)
Palomar, M., Muñoz, R.: Definite descriptions in an information extraction system. In: Monard, M., Sichman, J.S. (eds.) Advances in Artificial Intelligence. Lecture Notes in Computer Science, vol. 1952, pp. 320–328. Springer, Berlin/Heidelberg (2000)
Poesio, M., Artstein, R.: Anaphoric annotation in the ARRAU corpus. In: Proceedings of LREC, Marrakesh (2008)
Poesio, M., Kabadjov, M.A.: A general-purpose, off-the-shelf anaphora resolution module: implementation and preliminary evaluation. In: Proceedings of the International Conference on Language Resources and Evaluation (LREC), Lisbon (2004)
Poesio, M., Kabadjov, M.A., Vieira, R., Goulart, R., Uryupina, O.: Do discourse-new detectors help definite description resolution? In: Proceedings of the International Workshop on Computational Semantics (IWCS), Tilburg (2005)
Poesio, M., Modjeska, N.N.: Focus, activation, and this-noun phrases: an empirical study. In: Branco, A., McEnery, R., Mitkov, R. (eds.) Anaphora Processing, pp. 429–442. John Benjamins, Amsterdam/Philadelphi (2005)
Poesio, M., Renata, V.: A corpus-based investigation of definite description use. Computat. Linguist. 24 (2), 183–216 (1998)
Pradhan, S., Moschitti, A., Xue, N., Uryupina, O., Zhang, Y.: CoNLL-2012 shared task: modeling multilingual unrestricted coreference in OntoNotes. In: Proceedings of the Sixteenth Conference on Computational Natural Language Learning (CoNLL’12), Jeju (2012)
Pradhan, S., Ramshaw, L., Marcus, M., Palmer, M., Weischedel, R., Xue, N.: Conll-2011 shared task: modeling unrestricted coreference in ontonotes. In: Proceedings of the Fifteenth Conference on Computational Natural Language Learning (CoNLL 2011), Portland (2011)
Prince, E.F.: Toward a taxonomy of given-new information. In: Cole, P. (ed.) Radical Pragmatics, pp. 295–325. Academic Press, New York (1981)
Prince, E.F.: The zpg letter: subjects, definiteness and information status. In: Thompson, S., Mann, W. (eds.) Discourse Description: Diverse Analyses of a Fund-Raising Text, pp. 295–325. John Benjamins, Amsterdam/Philadelphia (1992)
Quirk, R., Greenbaum, S., Leech, G., Svartvik, J.: A Comprehensive Grammar of the English Language. Longman, Harlow (1985)
Recasens, M.: Coreferència: Teoria, anotació, resolució i avaluació. Ph.D. thesis, Universitat de Barcelona (2010)
Recasens, M., de Marneffe, M.C., Potts, C.: The life and death of discourse entities: identifying singleton mentions. In: HLT-NAACL, Atlanta, pp. 627–633 (2013)
Recasens, M., Martí, M.A.: Ancora-co: coreferentially annotated corpora for Spanish and Catalan. Lang. Res. Eval. (2009)
Roberts, C.: Modal Subordination, Anaphora and Distributivity. Garland, New York (1990)
Rodriguez, K.J., Delogu, F., Versley, Y., Stemle, E., Poesio, M.: Anaphoric annotation of Wikipedia and blogs in the live memories corpus. In: Proceedings of LREC (poster), Valletta (2010)
Sinclair, J. (ed.): Collins COBUILD English Grammar. Harper Collins, London (1995)
Swan, M.: Practical English Usage. Oxford University Press, Oxford/New York (1995)
Uryupina, O.: High-precision identification of discourse-new and unique noun phrases. In: Proceedings of the ACL’03 Student Workshop, Sapporo, pp. 80–86 (2003)
Uryupina, O.: Detecting anaphoricity and antecedenthood for coreference resolution. Processamento del Lenguaje Natural 42, 113–120 (2009)
Uryupina, O., Moschitti, A.: Multilingual mention detection for coreference resolution. In: Proceedings of the International Joint Conference on Natural Language Processing (IJCNLP’13), Nagoya (2013)
Vallduvi, E.: Information packaging: a survey. Research Paper RP-44, University of Edinburgh, HCRC (1993)
Versley, Y., Moschitti, A., Poesio, M., Yang, X.: Coreference systems based on kernels methods. In: Proceedings of the International Conference on Computational Linguistics (COLING), Manchester, pp. 961–968 (2008)
Vieira, R.: Definite description resolution in unrestricted texts. Ph.D. thesis, Centre for Cognitive Science, University of Edinburgh (1998)
Vieira, R., Poesio, M.: An empirically-based system for processing definite descriptions. Comput. Linguist. 26 (4), 539–593 (2000)
Vilain, M., Burger, J., Aberdeen, J., Connolly, D., Hirschman, L.: A model-theoretic coreference scoring scheme. In: Proceedings of the Sixth Message Understanding Conference (MUC-6), Columbia, pp. 45–52 (1995)
Ward, G., Birner, B.J.: Information structure. In: Horn, L.R., Ward, G. (eds.) Handbook of Pragmatics, pp. 153–174. Blackwell, Oxford/Basil (2004)
Webber, B.L.: Structure and ostension in the interpretation of discourse deixis. Lang. Cognit. Process. 6 (2), 107–135 (1991)
Weischedel, R., Brunstein, A.: BBN Pronoun Coreference and Entity Type Corpus. Linguistic Data Consortium, Philadelphia (2005). LDC2005T33
Acknowledgements
This work was supported in part by the limosine project (Uryupina, Poesio), in part by the sensei project (Kabadjov, Poesio).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Uryupina, O., Kabadjov, M., Poesio, M. (2016). Detecting Non-reference and Non-anaphoricity. In: Poesio, M., Stuckardt, R., Versley, Y. (eds) Anaphora Resolution. Theory and Applications of Natural Language Processing. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-47909-4_13
Download citation
DOI: https://doi.org/10.1007/978-3-662-47909-4_13
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-47908-7
Online ISBN: 978-3-662-47909-4
eBook Packages: Computer ScienceComputer Science (R0)