Collaborative Data Acquisition and Learning Support
Pages 220 - 229
Abstract
With the constant development of neural networks, traditional algorithms relying on data structures lose their significance as more and more solutions are using AI rather than traditional algorithms. This in turn requires a lot of correctly annotated and informative data samples. In this paper, we propose a crowdsourcing based approach for data acquisition and tagging with support for Active Learning where the system acts as an oracle and repository of training samples. The paper presents the CenHive system implementing the proposed approach. Three different usage scenarios are presented that were used to verify the proposed approach.
References
[1]
Boiński, T.: Game with a purpose for mappings verification. In: 2016 Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 405–409. IEEE (2016)
[2]
Curtis V Motivation to participate in an online citizen science game: a study of foldit Sci. Commun. 2015 37 6 723-746
[3]
Fort K, Adda G, and Cohen KB Amazon mechanical turk: gold mine or coal mine? Comput. Linguist. 2011 37 2 413-420
[4]
Gal, Y., Islam, R., Ghahramani, Z.: Deep bayesian active learning with image data. In: Proceedings of the 34th International Conference on Machine Learning-Volume 70, pp. 1183–1192. JMLR. org (2017)
[5]
Garcia I Learning a language for free while translating the web. Does Duolingo work? Int. J. Engl. Linguist. 2013 3 1 19
[6]
Girshick, R., Radosavovic, I., Gkioxari, G., Dollár, P., He, K.: Detectron (2018). https://github.com/facebookresearch/detectron
[7]
Jagoda J and Boiński T Szymański J and Velegrakis Y Assessing word difficulty for quiz-like game Semantic Keyword-Based Search on Structured Data Sources 2018 Cham Springer 70-79
[8]
Kellenberger B, Marcos D, Lobry S, and Tuia D Half a percent of labels is enough: efficient animal detection in uav imagery using deep cnns and active learning IEEE Trans. Geosci. Remote Sens. 2019 57 12 9524-9533
[9]
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)
[10]
Richardson L and Ruby S RESTful Web Services 2008 Newton O’Reilly Media, Inc.
[11]
Settles, B.: Active learning literature survey. University of Wisconsin-Madison, Department of Computer Sciences, Technical report (2009)
[12]
Swanson A, Kosmala M, Lintott C, Simpson R, Smith A, and Packer C Snapshot serengeti, high-frequency annotated camera trap images of 40 mammalian species in an african savanna Sci. Data 2015 2 150026
[13]
Szymański J and Boiński T Crowdsourcing-based evaluation of automatic references between wordnet and wikipedia Int. J. Softw. Eng. Knowl. Eng. 2019 29 03 317-344
[14]
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, p. I. IEEE (2001)
[15]
Von Ahn L Games with a purpose Computer 2006 39 6 92-94
[16]
Von Ahn L, Maurer B, McMillen C, Abraham D, and Blum MreCAPTCHA: Human-based character recognition via web security measuresScience200832158951465-14682452148
Index Terms
- Collaborative Data Acquisition and Learning Support
Index terms have been assigned to the content through auto-classification.
Recommendations
On privacy preservation in text and document-based active learning for named entity recognition
PAVLAD '09: Proceedings of the ACM first international workshop on Privacy and anonymity for very large databasesThe preservation of the privacy of persons mentioned in text requires the ability to automatically recognize and identify names. Named entity recognition is a mature field and most current approaches are based on supervised machine learning techniques. ...
Leveraging Active Learning and Conditional Mutual Information to Minimize Data Annotation in Human Activity Recognition
A difficulty in human activity recognition (HAR) with wearable sensors is the acquisition of large amounts of annotated data for training models using supervised learning approaches. While collecting raw sensor data has been made easier with advances in ...
A Density-Based Re-ranking Technique for Active Learning for Data Annotations
ICCPOL '09: Proceedings of the 22nd International Conference on Computer Processing of Oriental Languages. Language Technology for the Knowledge-based EconomyOne of the popular techniques of active learning for data annotations is uncertainty sampling, however, which often presents problems when outliers are selected. To solve this problem, this paper proposes a <em>density-based re-ranking</em> technique, ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Oct 2020
497 pages
© Springer Nature Switzerland AG 2020.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 16 October 2020
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 22 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in