Abstract
Automatic fuzzy text processing, context extraction and disambiguation are three challenging research areas with high relevance to complex business domains. Business knowledge can be found in plain text message exchanges, emails, support tickets, internal chat messengers and other volatile means, making the decoding of text-based domain knowledge a challenging task. Traditional natural language processing approaches focus on a comprehensive representation of business knowledge and any relevant mappings. However, such approaches can be highly complex, not cost-effective and of high maintenance, especially in environments that experience frequent changes. This work applies LSTM Siamese Networks to measure text similarities in ambiguous domains. We implement the Manhattan LSTM (MaLSTM) Siamese neural network for semi-automatic knowledge acquisition of business knowledge and decoding of domain-relevant features that enable building similarity measures. Our aim is to minimize the effort from human experts while extracting domain knowledge from rich text, containing context-free abbreviations, grammatically incorrect text and mixed language.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Brynjolfsson, E., McElheran, K.: Data in action: data-driven decision making in U.S. manufacturing. Center for Economic Studies (CES), January 2016
Aamodt, A., Plaza, E.: Case-based reasoning: foundational issues, methodological variations, and system approaches. AI Commun. 1(7), 39–59 (1994)
Bengio, Y.: Deep learning of representations: looking forward. In: Proceedings of the 1st International Conference on Statistical Language and Speech Processing, SLSP 2013, pp. 1–37. Springer, Tarragona (2013)
Bengio, Y., LeCun, Y.: Scaling learning algorithms towards, AI. In: Bottou, L., Chapelle, O., DeCoste, D., Weston, J. (eds.) Large Scale Kernel Machines, vol. 34, pp. 321–360. MIT Press, Cambridge (2007)
Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013). https://doi.org/10.1109/TPAMI.2013.50
Ashley, K.: Modeling Legal Argument, Reasoning with Cases and Hypotheticals. MIT-Press, Cambridge (1990)
Brüninghaus, S., Ashley, K.D.: How machine learning can be beneficial for textual case-based reasoning. In: Proceedings of the AAAI 1998/ICML 1998 Workshop on Learning for Text Categorization (AAAI Technical Report WS-98-05), Madison, WI, pp. 71–74 (1998)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: NIPS 2013 Proceedings of the 26th International Conference on Neural Information Processing Systems, vol. 2 (2013)
Bach, K., Althoff, K.D., Newo, R., Stahl, A.: A case-based reasoning approach for providing machine diagnosis from service reports. In: Ram, A., Wiratunga, N. (eds.) Case-Based Reasoning Research and Development, ICCBR. Lecture Notes in Computer Science, vol. 6880. Springer, Heidelberg (2011)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9, 1735–1780 (1997)
Stram, R., Reuss, P., Althoff, K.D.: Weighted one mode projection of a bipartite graph as a local similarity measure. In: Aha, D., Lieber, J. (eds.) Case-Based Reasoning Research and Development, ICCBR. Lecture Notes in Computer Science, vol. 10339. Springer, Cham (2017)
Reuss, P., Witzke, C., Althoff, K.D.: Dependency modeling for knowledge maintenance in distributed CBR systems. In: Aha, D., Lieber, J. (eds.) Case-Based Reasoning Research and Development, ICCBR. Lecture Notes in Computer Science, vol. 10339. Springer, Cham (2017)
Reuss, P., et al.: FEATURE-TAK - framework for extraction, analysis, and transformation of unstructured textual aircraft knowledge. In: Goel, A., Díaz-Agudo, M., Roth-Berghofer, T. (eds.) Case-Based Reasoning Research and Development, ICCBR. Lecture Notes in Computer Science, vol. 9969. Springer, Cham (2016)
Kapetanakis, S., Petridis, M., Knight, B., Ma, J., Bacon, L.: A case based reasoning approach for the monitoring of business workflows. In: Proceedings of the 18th International Conference on Case-Based Reasoning, ICCBR 2010, Alessandria, Italy. Lecture Notes in Artificial Intelligence LNAI, vol. 6176, pp. 390–405 (2010)
Kapetanakis, S., Petridis, M.: Evaluating a case-based reasoning architecture for the intelligent monitoring of business workflows. In: Montani, S., Jain, L.C. (eds.) Successful Case-based Reasoning Applications 2. Studies in Computational Intelligence, vol. 494, pp. 43–54. Springer, Heidelberg (2014)
Sizov, G., Öztürk, P., Štyrák, J.: Acquisition and reuse of reasoning knowledge from textual cases for automated analysis. In: Lamontagne, L., Plaza, E. (eds.) Case-Based Reasoning Research and Development, ICCBR 2014. Lecture Notes in Computer Science, vol. 8765. Springer (2014)
Khoo, C.S.G.: Automatic identification of causal relations in text and their use for improving precision in information retrieval. Ph.D. thesis, The University of Arizona (1995)
Bengio, Y., Ducharme, R., Vincent, P., Janvin, C.: A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137–1155 (2003)
Amin, K., Kapetanakis, S., Althoff, KD., Dengel, A., Petridis M.: Dynamic process workflow routing using deep learning. In: AI-2018 Thirty-Eighth SGAI International Conference on Artificial Intelligence, Cambridge (2018)
Amin, K., Lancaster, G., Kapetanakis, S., Althoff, KD., Dengel, A., Petridis, M.: Case-based reasoning in natural language processing: word2vec VS fastText. In: 23rd UK Symposium on Case-Based Reasoning, Cambridge (2018)
Martin, K., Wiratunga, N., Sani, S., Massie, S., Clos, J.: A convolutional Siamese network for developing similarity knowledge in the SelfBACK dataset. In: Sanchez-Ruiz, A.A., Kofod-Petersen, A. (eds.) Proceedings of the 25th International Case-Based Reasoning Conference (ICCBR 2017): Case-Based Reasoning and Deep Learning Workshop (CBRDL 2017), ICCBR, 26–28 June 2017, Trondheim, Norway, pp. 85–94 (2017)
Mueller, J., Thyagarajan, A.: Siamese recurrent architectures for learning sentence similarity. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI 2016) (2016)
Amin, K., Kapetanakis, S., Althoff, K.D., Dengel, A., Petridis, M.: Answering with cases: a CBR approach to deep learning. In: Cox, M., Funk, P., Begum, S. (eds.) Case-Based Reasoning Research and Development, ICCBR. Lecture Notes in Computer Science, vol. 11156. Springer, Cham (2018)
Joulin, A., Grave, E., Bojanowski, P., Mikolov, T.: Bag of tricks for efficient text classification. DBLP Computer Science Bibliography (2017)
Bromley, J., et al.: Signature verification using a “siamese” time delay neural network. In: NIPS 1993 Proceedings of the 6th International Conference on Neural Information Processing Systems, pp. 737–744 (1993)
Zeiler, M.D.: ADADELTA: an adaptive learning rate method (2012). arXiv:1212.5701
Pascanu, R., Mikolov, T., Bengio, Y.: On the difficulty of training recurrent neural networks. In: ICML, pp. 1310–1318 (2013)
Goel, A.K., Diaz-Agudo, B.: What’s hot in case-based reasoning. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI 2017) (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Amin, K., Lancaster, G., Kapetanakis, S., Althoff, KD., Dengel, A., Petridis, M. (2020). Advanced Similarity Measures Using Word Embeddings and Siamese Networks in CBR. In: Bi, Y., Bhatia, R., Kapoor, S. (eds) Intelligent Systems and Applications. IntelliSys 2019. Advances in Intelligent Systems and Computing, vol 1038. Springer, Cham. https://doi.org/10.1007/978-3-030-29513-4_32
Download citation
DOI: https://doi.org/10.1007/978-3-030-29513-4_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29512-7
Online ISBN: 978-3-030-29513-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)