research-article

Sangrahaka: a tool for annotating and querying knowledge graphs

Authors:

Hrishikesh Terdalkar,

Arnab BhattacharyaAuthors Info & Claims

ESEC/FSE 2021: Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Pages 1520 - 1524

https://doi.org/10.1145/3468264.3473113

Published: 18 August 2021 Publication History

Abstract

We present a web-based tool Sangrahaka for annotating entities and relationships from text corpora towards construction of a knowledge graph and subsequent querying using templatized natural language questions. The application is language and corpus agnostic, but can be tuned for specific needs of a language or a corpus. The application is freely available for download and installation. Besides having a user-friendly interface, it is fast, supports customization, and is fault tolerant on both client and server side. It outperforms other annotation tools in an objective evaluation metric. The framework has been successfully used in two annotation tasks. The code is available from <a>https://github.com/hrishikeshrt/sangrahaka</a>.

References

[1]

2016. Bhāvaprakaša of Bhāvamišra. 1, Chowkhamba Krishnadas Academy, Varanasi. isbn:9788121800002

[2]

2021. Asynchronous JavaScript and XML. https://en.wikipedia.org/wiki/Ajax_(programming)

[3]

2021. Bolt Protocol. https://boltprotocol.org/

[4]

2021. Bootstrap 4.6. https://getbootstrap.com/docs/4.6/getting-started/introduction/

[5]

2021. Cypher Query Language. https://neo4j.com/developer/cypher/

[6]

2021. Gunicorn - WSGI Server. https://docs.gunicorn.org/en/stable/

[7]

2021. Jinja - A very fast and expressive template engine. https://jinja.palletsprojects.com/en/2.11.x/

[8]

2021. JSON Lines. https://jsonlines.org/

[9]

2021. NGINX - High Performance Load Balancer, Web Server and Reverse Proxy. https://docs.gunicorn.org/en/stable/

[10]

2021. Single-page application. https://en.wikipedia.org/wiki/Single-page_application

[11]

2021. SQLAlchemy - The Python SQL Toolkit and Object Relational Mapper. https://www.sqlalchemy.org/

[12]

2021. Valmiki Ramayana. http://valmikiramayan.pcriot.com/

[13]

2021. vis.js Community Edition. https://visjs.org/

[14]

Kalina Bontcheva, Hamish Cunningham, Ian Roberts, Angus Roberts, Valentin Tablan, Niraj Aswani, and Genevieve Gorrell. 2013. GATE Teamware: a web-based, collaborative text annotation framework. Language Resources and Evaluation, 47, 4 (2013), 1007–1029.

Digital Library

[15]

Kisari Mohan Ganguli. 1884. The Mahabharata. Bharata Press.

[16]

Miguel Grinberg. 2018. Flask web development: developing web applications with python. " O’Reilly Media, Inc.".

[17]

Ian Hickson. 2021. Web Storage (Second Edition). W3C. https://www.w3.org/TR/2021/SPSD-webstorage-20210128/.

[18]

Richard D Hipp. 2021. SQLite. https://www.sqlite.org/index.html

[19]

Lynette Hirschman and Robert Gaizauskas. 2001. Natural language question answering: the view from here. natural language engineering, 7, 4 (2001), 275.

[20]

Matthew Honnibal, Ines Montani, Sofie Van Landeghem, and Adriane Boyd. 2020. spaCy: Industrial-strength Natural Language Processing in Python. https://doi.org/10.5281/zenodo.1212303

[21]

Dan Jurafsky. 2000. Speech & language processing. Pearson Education India.

[22]

Yoji Kiyota, Sadao Kurohashi, and Fuyuko Kido. 2002. “Dialog Navigator”: A Question Answering System based on Large Text Knowledge Base. In COLING 2002: The 19th International Conference on Computational Linguistics.

[23]

Hiroki Nakayama, Takahiro Kubo, Junya Kamura, Yasufumi Taniguchi, and Xu Liang. 2018. doccano: Text Annotation Tool for Human. https://github.com/doccano/doccano Software available from https://github.com/doccano/doccano.

[24]

Mariana Neves and Jurica Ševa. 2021. An extensive review of tools for manual annotation of documents. Briefings in bioinformatics, 22, 1 (2021), 146–163.

[25]

Armin Ronacher. [n.d.]. Opening the Falsk. URL: http://mitsuhiko.pocoo.org/flask-pycon-2011.pdf.

[26]

Pontus Stenetorp, Sampo Pyysalo, Goran Topić, Tomoko Ohta, Sophia Ananiadou, and Jun’ichi Tsujii. 2012. BRAT: a web-based tool for NLP-assisted text annotation. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. 102–107.

[27]

Hrishikesh Terdalkar and Arnab Bhattacharya. 2021. Sangrahaka: A Tool for Annotating and Querying Knowledge Graphs. arxiv:2107.02782

[28]

Maarten van Gompel. 2014. FoLiA Linguistic Annotation Tool. https://github.com/proycon/flat

[29]

Guido Van Rossum and Fred L. Drake. 2009. Python 3 Reference Manual. CreateSpace, Scotts Valley, CA. isbn:1441412697

[30]

Ellen M Voorhees. 1999. The TREC-8 question answering track report. In Trec. 99, 77–82.

[31]

Jim Webber. 2012. A programmatic introduction to neo4j. In Proceedings of the 3rd annual conference on Systems, programming, and applications: software for humanity. 217–218.

Digital Library

[32]

Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, and Jianfeng Gao. 2015. Semantic parsing via staged query graph generation: Question answering with knowledge base.

[33]

Seid Muhie Yimam, Iryna Gurevych, Richard Eckart de Castilho, and Chris Biemann. 2013. Webanno: A flexible, web-based and visually supported system for distributed annotations. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics: System Demonstrations. 1–6.

Cited By

Gyory RRestrepo Amariles DLewkowicz GBersini H(2024)Ant: a process aware annotation software for regulatory complianceArtificial Intelligence and Law10.1007/s10506-023-09372-932:4(1075-1110)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s10506-023-09372-9
Lee YChung JKim TSong JKim J(2022)Promptiverse: Scalable Generation of Scaffolding Prompts Through Human-AI Hybrid Knowledge Graph AnnotationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502087(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502087

Index Terms

Sangrahaka: a tool for annotating and querying knowledge graphs
1. Information systems
  1. Information retrieval
2. Software and its engineering
  1. Software notations and tools
    1. Software libraries and repositories

Recommendations

Hybrid Search based Enhanced Named Entity Annotation Tool
ISEC '22: Proceedings of the 15th Innovations in Software Engineering Conference

Identifying named entities is a crucial step in extracting information from text. Training NER models usually require annotated data. Human annotators spend a lot of time and effort annotating large datasets. In this paper, we introduce a novel hybrid ...
A Text Annotation Tool with Pre-annotation Based on Deep Learning
Knowledge Science, Engineering and Management
Abstract
In this paper, we introduce an open-source tool, YEDDA, supported by a pre-annotation module based deep learning. EPAD proposes a novel annotation workflow, combining pre-annotation and manual annotation, which improves the efficiency and quality ...
Towards Probabilistic Bitemporal Knowledge Graphs
WWW '18: Companion Proceedings of the The Web Conference 2018

The emergence of open information extraction as a tool for constructing and expanding knowledge graphs has aided the growth of temporal data, for instance, YAGO, NELL and Wikidata. While YAGO and Wikidata maintain the valid time of facts, NELL records ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ESEC/FSE 2021: Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

August 2021

1690 pages

ISBN:9781450385626

DOI:10.1145/3468264

General Chairs:
Diomidis Spinellis
Athens University of Economics and Business, Greece
,
Georgios Gousios
Facebook, Netherlands / Delft University of Technology, Netherlands
,
Program Chairs:
Marsha Chechik
University of Toronto, Canada
,
Massimiliano Di Penta
University of Sannio, Italy

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 August 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ESEC/FSE '21

Sponsor:

SIGSOFT

ESEC/FSE '21: 29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

August 23 - 28, 2021

Athens, Greece

Acceptance Rates

Overall Acceptance Rate 112 of 543 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
143
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)3

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gyory RRestrepo Amariles DLewkowicz GBersini H(2024)Ant: a process aware annotation software for regulatory complianceArtificial Intelligence and Law10.1007/s10506-023-09372-932:4(1075-1110)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s10506-023-09372-9
Lee YChung JKim TSong JKim J(2022)Promptiverse: Scalable Generation of Scaffolding Prompts Through Human-AI Hybrid Knowledge Graph AnnotationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502087(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502087

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents