Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

From Users’ Intentions to IF-THEN Rules in the Internet of Things

Published: 16 August 2021 Publication History

Abstract

In the Internet of Things era, users are willing to personalize the joint behavior of their connected entities, i.e., smart devices and online service, by means of trigger-action rules such as “IF the entrance Nest security camera detects a movement, THEN blink the Philips Hue lamp in the kitchen.” Unfortunately, the spread of new supported technologies makes the number of possible combinations between triggers and actions continuously growing, thus motivating the need of assisting users in discovering new rules and functionality, e.g., through recommendation techniques. To this end, we present , a semantic Conversational Search and Recommendation (CSR) system able to suggest pertinent IF-THEN rules that can be easily deployed in different contexts starting from an abstract user’s need. By exploiting a conversational agent, the user can communicate her current personalization intention by specifying a set of functionality at a high level, e.g., to decrease the temperature of a room when she left it. Stemming from this input, implements a semantic recommendation process that takes into account (a) the current user’s intention, (b) the connected entities owned by the user, and (c) the user’s long-term preferences revealed by her profile. If not satisfied with the suggestions, then the user can converse with the system to provide further feedback, i.e., a short-term preference, thus allowing to provide refined recommendations that better align with the original intention. We evaluate by running different offline experiments with simulated users and real-world data. First, we test the recommendation process in different configurations, and we show that recommendation accuracy and similarity with target items increase as the interaction between the algorithm and the user proceeds. Then, we compare with other similar baseline recommender systems. Results are promising and demonstrate the effectiveness of in recommending IF-THEN rules that satisfy the current personalization intention of the user.

References

[1]
IFTTT. 2019. IFTTT. Retrieved from https://ifttt.com/.
[2]
Microsoft. 2019. Microsoft Flow. Retrieved from https://flow.microsoft.com/en-us/.
[3]
Zapier. 2019. Zapier. Retrieved from https://zapier.com/.
[4]
Amazon. 2020. Amazon Alexa. Retrieved from https://developer.amazon.com/en-US/alexa.
[5]
Google. 2020. Google Assistant. Retrieved from https://developers.google.com/assistant.
[6]
Xavier Amatriain, Josep M. Pujol, Nava Tintarev, and Nuria Oliver. 2009. Rate it again: Increasing recommendation accuracy by user re-rating. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09). Association for Computing Machinery, New York, NY, 173–180.
[7]
Sarabjot Singh Anand, Patricia Kearney, and Mary Shapcott. 2007. Generating semantically enriched user profiles for web personalization. ACM Trans. Internet Technol. 7, 4 (Oct. 2007).
[8]
Grigoris Antoniou, Paul Groth, Frank van Harmelen, and Rinke Hoekstra. 2012. A Semantic Web Primer. The MIT Press.
[9]
We are Social. 2020. Digital in 2020. Retrieved from https://wearesocial.com/blog/2020/01/digital-2020-3-8-billion-people-use-social-media.
[10]
Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2010. The internet of things: A survey. Comput. Netw.: Int. J. Comput. Telecommun. Netw. 54 (15 Oct. 2010), 2787–2805.
[11]
Barbara Rita Barricelli and Stefano Valtolina. 2015. Designing for end-user development in the internet of things In Proceedings of the 5th International Symposium on End-user Development. Springer International Publishing, Cham, 9–24.
[12]
C. Bizer, T. Heath, and T. Berners-Lee. 2009. Linked data—The story so far. Int. J. Seman Web Inf. Syst. 5, 3 (2009), 1–22.
[13]
Julia Brich, Marcel Walch, Michael Rietzler, Michael Weber, and Florian Schaub. 2017. Exploring end user programming needs in home automation. ACM Trans. Comput.-Hum. Interact. 24, 2 (Apr. 2017).
[14]
Derek Bridge, Mehmet H. Göker, Lorraine McGinty, and Barry Smyth. 2005. Case-based recommender systems. Knowl. Eng. Rev. 20, 3 (Sept. 2005), 315–320.
[15]
Robin Burke. 2000. Knowledge-based recommender systems. In Encyclopedia of Library and Information Systems. Marcel Dekker.
[16]
Iván Cantador, Alejandro Bellogín, and Pablo Castells. 2008. A multilayer ontology-based hybrid recommendation model. AI Commun. 21, 2–3 (Apr. 2008), 203–210.
[17]
V. Cerf and M. Senges. 2016. Taking the internet to the next physical level. IEEE Comput. 49, 2 (Feb. 2016), 80–86.
[18]
Li Chen and Pearl Pu. 2012. Critiquing-based recommenders: Survey and emerging trends. User Model. User-adapt. Interact. 22, 1 (2012), 125–150.
[19]
F. Corno, L. De Russis, and A. Monge Roffarello. 2017. A semantic web approach to simplifying trigger-action programming in the IoT. Computer 50, 11 (2017), 18–24.
[20]
Fulvio Corno, Luigi De Russis, and Alberto Monge Roffarello. 2019. A high-level semantic approach to end-user development in the internet of things. Int. J. Hum.-comput. Stud. 125 (2019), 41–54.
[21]
Fulvio Corno, Luigi De Russis, and Alberto Monge Roffarello. 2019. RecRules: Recommending IF-THEN rules for end-user development. ACM Trans. Intell. Syst. Technol. 10, 5 (Sept. 2019).
[22]
Fulvio Corno, Luigi De Russis, and Alberto Monge Roffarello. 2020. HeyTAP: Bridging the gaps between users’ needs and technology in IF-THEN rules via conversation. In Proceedings of the International Conference on Advanced Visual Interfaces (AVI’20). Association for Computing Machinery, New York, NY.
[23]
Fulvio Corno, Luigi De Russis, and Alberto Monge Roffarello. 2020. TAPrec: Supporting the composition of trigger-action rules through dynamic recommendations. In Proceedings of the 25th International Conference on Intelligent User Interfaces (IUI’20). Association for Computing Machinery, New York, NY, 579–588.
[24]
Florian Daniel and Maristella Matera. 2014. Mashups: Concepts, Models and Architectures. Springer Publishing Company, Incorporated.
[25]
Luigi De Russis and Alberto Monge Roffarello. 2020. Personalizing IoT ecosystem via voice. In Proceedings of the Conference on Empowering People in Dealing with Internet of Things Ecosystems (AVI’20).
[26]
Giuseppe Desolda, Carmelo Ardito, and Maristella Matera. 2017. Empowering end users to customize their smart environments: Model, composition paradigms, and domain-specific tools. ACM Trans. Comput.-hum. Interact. 24, 2 (2017).
[27]
Anind K. Dey, Timothy Sohn, Sara Streng, and Justin Kodama. 2006. iCAP: Interactive prototyping of context-aware applications. In Proceedings of the 4th International Conference on Pervasive Computing (PERVASIVE’06). Springer-Verlag, Berlin, 254–271.
[28]
Gerhard Fischer. 2009. End-user development and meta-design: Foundations for cultures of participation. In End-User Development, Volkmar Pipek, Mary Beth Rosson, Boris de Ruyter, and Volker Wulf (Eds.). Springer Berlin, 3–14.
[29]
Mathias Funk, L.-L. Chen, S.-W. Yang, and Y.-K. Chen. 2018. Addressing the need to capture scenarios, intentions and preferences: Interactive intentional programming in the smart home. Int. J. Des. 12 (04 2018), 53–66.
[30]
Jianfeng Gao, Michel Galley, and Lihong Li. 2018. Neural approaches to conversational AI. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’18). Association for Computing Machinery, New York, NY, 1371–1374.
[31]
Giuseppe Ghiani, Marco Manca, Fabio Paternò, and Carmen Santoro. 2017. Personalization of context-dependent applications through trigger-action rules. ACM Trans. Comput.-hum. Interact. 24, 2 (2017).
[32]
Lorraine Mc Ginty and Barry Smyth. 2002. Comparison-based recommendation. In Advances in Case-Based Reasoning, Susan Craw and Alun Preece (Eds.). Springer Berlin, 575–589.
[33]
Will Haines, Melinda Gervasio, Aaron Spaulding, and Bart Peintner. 2010. Recommendations for end-user development. In Proceedings of the ACM RecSys Workshop on User-centric Evaluation of Recommender Systems and Their Interfaces (UCERSTI’10).
[34]
Justin Huang and Maya Cakmak. 2015. Supporting mental model accuracy in trigger-action programming. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’15). Association for Computing Machinery, New York, NY, 215–225.
[35]
Ting-Hao K. Huang, A. Azaria, and J. P. Bigham. 2016. InstructableCrowd: Creating IF-THEN rules via conversations with the crowd. In Proceedings of the CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA’16). ACM, New York, NY, 1555–1562.
[36]
Dietmar Jannach, Ahtsham Manzoor, Wanling Cai, and Li Chen. 2020. A Survey on Conversational Recommender Systems. arxiv:2004.00646.
[37]
Joseph A. Konstan and John Riedl. 2012. Recommender systems: from algorithms to user experience. User Model. User-adapt. Interact. 22, 1 (2012), 101–123.
[38]
Henry Lieberman, Fabio Paternò, Markus Klann, and Volker Wulf. 2006. End-user development: An emerging paradigm. In End User Development. Springer Netherlands, Dordrecht, Netherlands, 1–8.
[39]
Friedemann Mattern and Christian Floerkemeier. 2010. From the Internet of Computers to the Internet of Things. Springer Berlin, 242–259.
[40]
Xianghang Mi, Feng Qian, Ying Zhang, and XiaoFeng Wang. 2017. An empirical characterization of IFTTT: Ecosystem, usage, and performance. In Proceedings of the Internet Measurement Conference (IMC’17). ACM, New York, NY, 398–404.
[41]
Dejan Munjin. 2013. User Empowerment in the Internet of Things. Ph.D. Dissertation. Université de Genève. Retrieved from http://archive-ouverte.unige.ch/unige:28951.
[42]
Abdallah Namoun, Athanasia Daskalopoulou, Nikolay Mehandjiev, and Zhang Xun. 2016. Exploring mobile end user development: Existing use and design factors. IEEE Trans. Softw. Eng. 42, 10 (Oct. 2016), 960–976.
[43]
Tommaso Di Noia, Vito Claudio Ostuni, Paolo Tomeo, and Eugenio Di Sciascio. 2016. SPrank: Semantic path-based ranking for top-n recommendations using linked open data. ACM Trans. Intell. Syst. Technol. 8, 1, (Sept. 2016).
[44]
Arpit Rana and Derek Bridge. 2020. Navigation-by-preference: A new conversational recommender with preference-based feedback. In Proceedings of the 25th International Conference on Intelligent User Interfaces (IUI’20). Association for Computing Machinery, New York, NY, 155–165.
[45]
Ian Ruthven and Mounia Lalmas. 2003. A survey on the use of relevance feedback for information access systems. Knowl. Eng. Rev. 18, 2 (June 2003), 95–145.
[46]
Giovanni Semeraro, Pasquale Lops, Pierpaolo Basile, and Marco de Gemmis. 2009. Knowledge infusion into content-based recommender systems. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09). ACM, New York, NY, 301–304.
[47]
Barry Smyth. 2007. Case-based Recommendation. Springer-Verlag, Berlin, 342–376.
[48]
Barry Smyth and L. McGinty. 2003. An analysis of feedback strategies in conversational recommenders. In Proceedings of the 14th Irish Artificial Intelligence and Cognitive Science Conference.
[49]
Barry Smyth and Lorraine McGinty. 2003. The power of suggestion. In Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI’03). Morgan Kaufmann Publishers Inc., San Francisco, CA, 127–132.
[50]
Kathryn T. Stolee and Sebastian Elbaum. 2013. Identification, impact, and refactoring of smells in pipe-like web mashups. IEEE Trans. Softw. Eng. 39, 12 (Dec. 2013), 1654–1679.
[51]
Quan Thanh Tho, Siu Cheung Hui, A. C. M. Fong, and Tru Hoang Cao. 2006. Automatic fuzzy ontology generation for semantic web. IEEE Trans. Knowl. Data Eng. 18, 6 (June 2006), 842–856.
[52]
Blase Ur, Elyse McManus, Melwyn Pak Yong Ho, and Michael L. Littman. 2014. Practical trigger-action programming in the smart home. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’14). ACM, New York, NY, 803–812.
[53]
Blase Ur, Melwyn Pak Yong Ho, Stephen Brawner, Jiyun Lee, Sarah Mennicken, Noah Picard, Diane Schulze, and Michael L. Littman. 2016. Trigger-action programming in the wild: An analysis of 200,000 IFTTT recipes. In Proceedings of the CHI Conference on Human Factors in Computing Systems) (CHI’16). Association for Computing Machinery, New York, NY, 3227–3231.
[54]
Pierre-Yves Vandenbussche, Ghislain Atemezing, María Poveda-Villalón, and B. Vatant. 2017. Linked open vocabularies (LOV): A gateway to reusable semantic vocabularies on the web. Seman. Web 8 (01 2017), 437–452.
[55]
Lina Yao, Quan Z. Sheng, Anne H. H. Ngu, Helen Ashman, and Xue Li. 2014. Exploring recommendations in internet of things. In Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’14). ACM, New York, NY, 855–858.
[56]
Lefan Zhang, Weijia He, Jesse Martinez, Noah Brackenbury, Shan Lu, and Blase Ur. 2019. AutoTap: Synthesizing and repairing trigger-action programs using LTL properties. In Proceedings of the 41st International Conference on Software Engineering (ICSE’19). IEEE Press, 281–291.
[57]
Lefan Zhang, Weijia He, Olivia Morkved, Valerie Zhao, Michael L. Littman, Shan Lu, and Blase Ur. 2020. Trace2TAP: Synthesizing trigger-action programs from traces of behavior. Proc. ACM Interact., Mob., Wear. Ubiq. Technol. 4, 3 (Sept. 2020).
[58]
Shiyu Zhang, Juan Zhai, Lei Bu, Mingsong Chen, Linzhang Wang, and Xuandong Li. 2020. Automated generation of LTL specifications for smart home IoT using natural language. In Proceedings of the 23rd Conference on Design, Automation and Test in Europe (DATE’20). EDA Consortium, San Jose, CA, 622–625.
[59]
Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, and W. Bruce Croft. 2018. Towards conversational search and recommendation: System ask, user respond. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM’18). Association for Computing Machinery, New York, NY, 177–186.

Cited By

View all
  • (2024)ChatIoT: Zero-code Generation of Trigger-action Based IoT ProgramsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785858:3(1-29)Online publication date: 9-Sep-2024
  • (2024)Navigating User-System Gaps: Understanding User-Interactions in User-Centric Context-Aware Systems for Digital Well-being InterventionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641979(1-15)Online publication date: 11-May-2024
  • (2024)Social Web in IoT: Can Evolutionary Computation and Clustering Improve Ontology Matching for Social Web of Things?IEEE Transactions on Computational Social Systems10.1109/TCSS.2023.333256211:3(3966-3977)Online publication date: Jun-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems
ACM Transactions on Information Systems  Volume 39, Issue 4
October 2021
482 pages
ISSN:1046-8188
EISSN:1558-2868
DOI:10.1145/3477247
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 August 2021
Accepted: 01 January 2021
Revised: 01 December 2020
Received: 01 May 2020
Published in TOIS Volume 39, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Trigger-action programming
  2. abstraction
  3. conversational recommender system
  4. semantic web
  5. Internet of Things
  6. functionality

Qualifiers

  • Research-article
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)119
  • Downloads (Last 6 weeks)12
Reflects downloads up to 17 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)ChatIoT: Zero-code Generation of Trigger-action Based IoT ProgramsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785858:3(1-29)Online publication date: 9-Sep-2024
  • (2024)Navigating User-System Gaps: Understanding User-Interactions in User-Centric Context-Aware Systems for Digital Well-being InterventionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641979(1-15)Online publication date: 11-May-2024
  • (2024)Social Web in IoT: Can Evolutionary Computation and Clustering Improve Ontology Matching for Social Web of Things?IEEE Transactions on Computational Social Systems10.1109/TCSS.2023.333256211:3(3966-3977)Online publication date: Jun-2024
  • (2024)Green artificial intelligence for cost-duration variance prediction (CDVP) for irrigation canals rehabilitation projectsExpert Systems with Applications10.1016/j.eswa.2024.123789249(123789)Online publication date: Sep-2024
  • (2024)A data fusion framework based on heterogeneous information network embedding for trigger-action programming in IoTExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121065235:COnline publication date: 1-Jan-2024
  • (2024)TAP with ease: a generic recommendation system for trigger-action programming based on multi-modal representation learningApplied Soft Computing10.1016/j.asoc.2024.112163166(112163)Online publication date: Nov-2024
  • (2024)Crossover in mutation oriented norm evolutionComplex & Intelligent Systems10.1007/s40747-024-01470-810:5(6081-6102)Online publication date: 29-May-2024
  • (2023)Analyzing Long-Term and High Instantaneous Power Consumption of Buildings from Smart Meter Big Data with Deep Learning and Knowledge Graph TechniquesEnergies10.3390/en1619689316:19(6893)Online publication date: 29-Sep-2023
  • (2023)Artificial Intelligence-Enabled Chatbots in Mental Health: A Systematic ReviewComputers, Materials & Continua10.32604/cmc.2023.03465574:3(5105-5122)Online publication date: 2023
  • (2023)A Survey on Conflict Detection in IoT-based Smart HomesACM Computing Surveys10.1145/362951756:5(1-40)Online publication date: 27-Nov-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media