JP2018507451A - Internet platform, apparatus and method - Google Patents

Abstract

A system and method for the Internet of things is described. For example, one embodiment of a system includes an IoT hub that includes a WAN interface that couples an IoT hub to an IoT service over a WAN, and a local communication interface that communicatively couples the IoT hub to a plurality of different types of IoT devices; A memory for storing program code and at least one IoT device having a microcontroller for executing the program code, the program code including library program code, and the library program code By creating application program code that utilizes program code, including basic building blocks that can be used to implement any IoT device, Kutomo one, includes a communication stack to enable communication with the IoT hub, library program code is provided to the developer software development kit with a microcontroller (SDK). [Selection] Figure 3

Description

  The present invention relates generally to the field of computer systems. More specifically, the present invention relates to an Internet of Things (IoT) platform, apparatus, and method.

  “Internet of Things” refers to the interconnection of devices that are uniquely identifiable within the Internet infrastructure. Ultimately, IoT is a wide range of virtually any type of physical thing that can provide information about itself or its surroundings and / or remotely controlled via the Internet and through client devices. Expected to bring new types of applications.

IoT development and adoption is delayed due to issues related to connectivity, power, and lack of standardization. For example, one barrier to IoT development and adoption is the lack of a standard platform that allows developers to design and deliver new IoT devices and services. To enter the IoT market, developers need to design an entire IoT platform from scratch, including the network protocols and infrastructure, hardware, software, and services needed to accommodate the desired IoT implementation. is there. As a result, each provider of IoT devices uses its own technology for designing and connecting IoT devices, and the adoption of multiple types of IoT devices is burdensome for end users. Another obstacle that makes IoT adoption difficult is the difficulty associated with connecting and powering on IoT devices. For example, connected devices such as refrigerators, garage door openers, environmental sensors, and home security sensors / controllers require a power source to supply power to each connected IoT device, and such power sources are often in convenient locations. Not provided.
A better understanding of the present invention can be obtained from the following detailed description in conjunction with the following drawings, in which:

2 illustrates different embodiments of an IoT system architecture. 2 illustrates different embodiments of an IoT system architecture. 1 illustrates an IoT device according to an embodiment of the present invention. 1 illustrates an IoT hub according to an embodiment of the present invention. 1 illustrates one embodiment of an IoT device for receiving and processing input from an end user. 1 illustrates one embodiment of an IoT device for receiving and processing input from an end user. 1 illustrates one embodiment of an IoT hub implemented as a clock and information device. FIG. 4 illustrates one embodiment of an IoT hub clock / information device coupled to a frame having an integrated speaker. 2 illustrates different embodiments of an IoT clock hub. 2 illustrates different embodiments of an IoT clock hub. 2 illustrates different embodiments of an IoT clock hub. 2 illustrates different embodiments of an IoT clock hub. Fig. 4 illustrates a specific application of an IoT device for detecting when a product in a user's home needs to be replenished.

  In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the invention described below. However, it will be apparent to one skilled in the art that embodiments of the present invention may be practiced without some of these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid obscuring the underlying principles of embodiments of the present invention.

  One embodiment of the present invention includes an Internet of Things (IoT) platform that can be utilized by developers to design and build new IoT devices and applications. In particular, one embodiment includes a basic hardware / software platform for an IoT device that includes a predetermined networking protocol stack and an IoT hub where the IoT device is coupled to the Internet. Further, one embodiment includes an IoT service through which an IoT hub and connected IoT devices can be accessed and managed as described below. Further, one embodiment of the IoT platform includes an IoT application or web application (eg, running on a client device) for accessing and configuring IoT services, hubs, and connected devices. Existing online retailers and other website operators can easily provide their own IoT functionality to their existing user base using the IoT platform described herein.

  FIG. 1A provides an overview of an architecture platform on which embodiments of the present invention can be implemented. In particular, the illustrated embodiment includes a plurality of IoT devices 101 communicatively coupled via a local communication channel 130 to a central IoT hub 110 that is communicatively coupled to an IoT service 120 via the Internet 220 itself. ~ 105 are included. Each IoT device 101-105 can first be paired with an IoT hub 110 (eg, using a pairing technique described below) to enable each of the local communication channels 130.

  The IoT devices 101-105 collect information about itself and its surroundings, and provide the collected information to the IoT service 120, the user device 135, and / or the external website 130 via the IoT hub 110. Various types of sensors may be provided. Some IoT devices 101-105 may perform certain functions in response to control commands sent via the IoT hub 110. Various examples of information collected by the IoT devices 101-105 and control commands are provided below. In one embodiment described below, the IoT device 101 is a user input device designed to record user selections and send user selections to the IoT service 120 and / or website.

  In one embodiment, the IoT hub 110 includes a cellular radio that establishes a connection to the Internet 220 via a cellular service 115, such as 4G (eg, mobile WiMAX, LTE) or 5G cellular data service. Alternatively or in addition, the IoT hub 110 can include a WiFi radio for establishing a WiFi connection via a WiFi access point or router 116, which can connect the IoT hub 110 to the Internet (eg, Connect (via an Internet service provider that provides Internet services to end users). Of course, it should be noted that the basic principles of the present invention are not limited to a particular type of communication channel or protocol.

  In one embodiment, the IoT devices 101-105 are ultra low power devices that can be operated for long periods of time (eg, years) with battery power. To conserve power, the local communication channel 130 can be implemented using a low power wireless communication technology such as Bluetooth® Low Energy (LE). In this embodiment, each of the IoT devices 101-105 and the IoT hub 110 includes a Bluetooth LE radio and a protocol stack.

  As described above, in one embodiment, the IoT platform may be on a user device 135 that allows a user to access and configure connected IoT devices 101-105, IoT hub 110, and / or IoT service 120. IoT applications or web applications that run on In one embodiment, the application or web application can be designed by the operator of the website 130 to provide IoT functionality to its user base. As illustrated, the website may maintain a user database 131 that includes account records associated with each user.

  FIG. 1B shows additional connection options for multiple IoT hubs 110-111, 190. In this embodiment, a single user may have multiple hubs 110-111 installed on-site at a single user premises 180 (eg, the user's home or business). This can be done, for example, to extend the radio range required to connect all of the IoT devices 101-105. As described above, if a user has multiple hubs 110, 111, they may be connected via a local communication channel (eg, WiFi, Ethernet, power line networking, etc.). In one embodiment, each hub 110-111 can establish a direct connection to the IoT service 120 via a cellular 115 or WiFi 116 connection (not explicitly shown in FIG. 1B). Alternatively, or in addition, one of the IoT hubs, such as IoT hub 110, can function as a “master” hub, which is the other on user premises 180, such as IoT hub 111. Connectivity and / or local service to all IoT hubs (as shown by the dotted lines connecting IoT hub 110 and IoT hub 111). For example, the master IoT hub 110 may be the only IoT hub that establishes a direct connection to the IoT service 120. In one embodiment, only the “master” IoT hub 110 includes a cellular communication interface for establishing a connection to the IoT service 120. In this way, all communication between the IoT service 120 and other IoT hubs 111 flows through the master IoT hub 110. In this role, the master IoT hub 110 is responsible for data exchanged between other IoT hubs 111 and the IoT service 120 (eg, service some data requests locally if possible). Additional program code for performing the filtering operation may be provided.

  Regardless of how the IoT hubs 110-111 are connected, in one embodiment, the IoT service 120 logically associates the hub with the user and connects all of the connected IoT devices 101-105 to the installed application. Combine under a single generic user interface accessible via a user device having 135 (and / or a browser-based interface).

  In this embodiment, the master IoT hub 110 and one or more slave IoT hubs 111 are a WiFi network 116, an Ethernet network, and / or power line communication (PLC) networking (eg, all or part of the network powering a user's power line). Connected via a local network). Further, for IoT hubs 110-111, each IoT device 101-105 uses any type of local network channel, such as WiFi, Ethernet, PLC, or Bluetooth LE, to name a few. And may be interconnected.

  FIG. 1B also shows an IoT hub 190 installed at the second user premises 181. A substantially unlimited number of such IoT hubs 190 may be installed and configured to collect data from IoT devices 191-192 at user premises around the world. In one embodiment, the two user premises 180-181 may be configured for the same user. For example, one user premises 180 may be the user's basic home and the other user premises 181 may be the user's vacation home. In such a case, the IoT service 120 logically associates the IoT hubs 110-111, 190 with the user, and attaches all attached IoT devices 101-105, 191-192 to a single comprehensive user interface. And accessible via a user device with installed application 135 (and / or browser-based interface).

  As shown in FIG. 2, an exemplary embodiment of the IoT device 101 includes a memory 210 that stores program code and data 201-203, and a low power microcontroller 200 that executes the program code and processes the data. The memory 210 may be a volatile memory such as a dynamic random access memory (DRAM), or may be a non-volatile memory such as a flash memory. In one embodiment, non-volatile memory may be used for persistent storage and volatile memory may be used for program code execution and data execution. Further, the memory 210 may be integrated within the low power microcontroller 200 and coupled to the low power microcontroller 200 via a bus or communication fabric. The underlying principles of the present invention are not limited to a particular implementation of memory 210.

  As shown, the program code includes an application-specific function set executed by the IoT device 201 and library code 202 that includes a predetermined set of building blocks that can be utilized by an application developer of the IoT device 101. Application program code 203 to be defined can be included. In one embodiment, the library code 202 is a set of basic functions required to implement an IoT device, such as a communication protocol stack 201, to enable communication between each IoT device 101 and the IoT hub 110. including. As described above, in one embodiment, the communication protocol stack 201 includes a Bluetooth LE protocol stack. In this embodiment, the Bluetooth LE radio and antenna 207 may be integrated within the low power microcontroller 200. However, the basic principle of the present invention is not limited to a specific communication protocol.

  The particular embodiment shown in FIG. 2 also includes a plurality of input devices or sensors 210 that receive user input and provide user input to the low power microcontroller, which includes application code 203 and library code 202. Depending on the user input. In one embodiment, each of the input devices includes an LED 209 that provides feedback to the end user.

  In addition, the illustrated embodiment includes a battery 208 for supplying power to the low power microcontroller. In one embodiment, a non-rechargeable coin cell battery is used. However, in another embodiment, an integrated rechargeable battery can be used (eg, rechargeable by connecting an IoT device to an AC power source (not shown)).

  A speaker 205 for generating audio is also provided. In one embodiment, the low power microcontroller 299 includes audio decoding logic for decoding a compressed audio stream (eg, an MPEG-4 / Advanced Audio Coding (AAC) stream) to generate audio on the speaker 205. including. Instead, the low-power microcontroller 200 and / or application code / data 203 is a digitally sampled audio snippet to provide verbal feedback to the end user when the user enters a selection via the input device 210. Can be included.

  In one embodiment, one or more other / alternative I / O devices or sensors 250 may be included in the IoT device 101 based on the particular application for which the IoT device 101 is designed. For example, environmental sensors can be included to measure temperature, pressure, humidity, and the like. A security sensor and / or door lock opener may be included if the IoT device is used as a security device. Of course, these examples are provided for illustrative purposes only. The basic principles of the present invention are not limited to a particular type of IoT device. Indeed, given the highly programmable nature of the low power microcontroller 200 with library code 202, application developers can easily develop new application code 203 and new I / O devices 250 to effectively Interface with a low power microcontroller for any type of IoT application.

  In one embodiment, the low power microcontroller 200 also includes a secure key store for storing encryption keys used by embodiments described below (see, eg, FIGS. 4-6 and associated text). Alternatively, the key may be secured in a subscriber identity module (SIM), as will be described later.

  In one embodiment, a wake-up receiver 207 is included to wake up the IoT device from a very low power state that is not substantially consuming power. In one embodiment, the wakeup receiver 207 causes the IoT device 101 to respond to a wakeup signal received from a wakeup transmitter 307 configured on the IoT hub 110 as shown in FIG. Configured to get out of power state. In particular, in one embodiment, transmitter 307 and receiver 207 together form an electrical resonant transformer circuit such as a Tesla coil. In operation, energy is transmitted via a radio frequency signal from the transmitter 307 to the receiver 207 when the hub 110 needs to wake the IoT device 101 from a very low power state. For energy transfer, the IoT device 101 can be configured to consume substantially no power when in a low power state. This is because there is no need to “hear” the signal from the hub continuously (as is the case with the network protocol, where the device can be activated via the network signal). Rather, the microcontroller 200 of the IoT device 101 is configured to wake up after being effectively powered down by using energy that is electrically transmitted from the transmitter 307 to the receiver 207.

  As shown in FIG. 3, the IoT hub 110 also includes a memory 317 for storing program code and data 305, and hardware logic 301 such as a microcontroller for executing the program code and processing the data. . A wide area network (WAN) interface 302 and an antenna 310 couple the IoT hub 110 to the cellular service 115. Alternatively, as described above, the IoT hub 110 may include a local network interface (not shown), such as a WiFi interface (and a WiFi antenna) or an Ethernet interface, to establish a local area network communication channel. In one embodiment, hardware logic 301 also includes a secure key store for storing encryption keys used by embodiments described below (see, eg, FIGS. 4-6 and associated text). Alternatively, the key may be secured in a subscriber identity module (SIM), as will be described later.

  The local communication interface 303 and the antenna 311 establish a local communication channel with each of the IoT devices 101 to 105. As described above, in one embodiment, the local communication interface 303 / antenna 311 implements the Bluetooth LE standard. However, the principles underlying the present invention are not limited to a specific protocol for establishing a local communication channel with the IoT devices 101-105. Although shown as separate units in FIG. 3, the WAN interface 302 and / or the local communication interface 303 may be integrated into the same chip as the hardware logic 301.

  In one embodiment, the program code and data include a communication protocol stack 308 that includes separate stacks for communicating via the local communication interface 303 and the WAN interface 302. In addition, the device pairing program code and data 306 is stored in memory so that the IoT hub can be paired with a new IoT device. In one embodiment, each new IoT device 101-105 is assigned a unique code that is communicated to the IoT hub 110 during the pairing process. For example, the unique code may be embedded in a barcode on the IoT device, read by the barcode reader 106, and communicated via the local communication channel 130. In another embodiment, a unique ID code is magnetically embedded in the IoT device, and the IoT hub has a magnetic sensor, such as a radio frequency ID (RFID) or near field communication (NFC) sensor, and the IoT device 101 Detects the code as it moves within a few inches of the IoT hub 110.

  In one embodiment, once the unique ID is communicated, the IoT hub 110 queries a local database (not shown), performs a hash to verify that the code is acceptable, and / or Alternatively, the unique ID is verified by communicating with the IoT service 120 and the ID code is authenticated at the user device 135 and / or the website 130. Once authenticated, in one embodiment, the IoT hub 110 pairs the IoT device 101 and stores pairing data in memory 317 (which can include non-volatile memory as described above). Once pairing is complete, the IoT hub 110 can connect with the IoT device 101 to perform various functions described herein.

  In one embodiment, an organization executing IoT service 120 may provide an IoT hub 110 and a basic hardware / software platform so that developers can easily design new IoT services. In particular, in addition to the IoT hub 110, developers may be provided with a software development kit (SDK) for updating program code and data 305 executed in the hub 110. Further, for IoT device 101, the SDK is for base IoT hardware (eg, low power microcontroller 200 and other components shown in FIG. 2) to facilitate the design of various different types of applications 101. Includes an extensive set of library code 202 designed for In one embodiment, the SDK includes a graphical design interface where the developer only needs to specify the inputs and outputs of the IoT device. All the networking code including the communication stack 201 that allows the IoT device 101 to connect to the hub 110 and the service 120 is already in place for the developer. Furthermore, in one embodiment, the SDK also includes a library code base that facilitates the design of applications for mobile devices (eg, iPhone® and Android devices).

  In one embodiment, the IoT hub 110 manages a continuous bi-directional stream of data between the IoT devices 101-105 and the IoT service 120. When updates to / from IoT devices 101-105 are requested in real time (eg, when the user needs to see the current state of the security device or environment read), the IoT hub maintains an open TCP socket. Regular updates may be provided to the user device 135 and / or the external website 130. The particular networking protocol used to provide the update may be adjusted based on the needs of the underlying application. For example, if it may not make sense to have a continuous bi-directional stream, a simple request / response protocol can be used to collect information when needed.

  In one embodiment, both the IoT hub 110 and the IoT devices 101-105 can be updated automatically over the network. In particular, when new updates are available for the IoT hub 110, the updates can be automatically downloaded and installed from the IoT service 120. It first copies the updated code to local memory and executes it to verify the update before replacing the old program code. Similarly, if updates are available for each of the IoT devices 101-105, they may first be downloaded by the IoT hub 110 and pushed out to each of the IoT devices 101-105. Each IoT device 101-105 applies the update in the same manner as described above for the IoT hub and reports the result of the update to the IoT hub 110. If the update is successful, the IoT hub 110 deletes the update from its memory and records the latest version of code installed on each IoT device (eg, keeps checking for new updates for each IoT device) Is possible).

  In one embodiment, the IoT hub 110 is powered via A / C power. Specifically, the IoT hub 110 can include a power supply unit 390 with a transformer for converting A / C voltage supplied via the A / C power cord to a lower DC voltage.

  As discussed above, FIGS. 4A-B illustrate one particular embodiment of an IoT device 400 that can receive a card 410 that includes a list of selectable items 411-415. As shown in FIG. 4B, the card has a barcode 420 printed thereon that is read by the barcode reader of the IoT device 400 and associated with each of a corresponding plurality of user-selectable buttons 401. Item can be identified. For example, in FIG. 4A, once card 410 is inserted into a slot on device 400, button 401 is associated with item 411, button 402 is associated with item 412, button 403 is associated with item 413, button 401 404 is associated with item 414 and button 405 is associated with item 415. In this specific example, each of items 411-415 includes a food item (eg, water, pruned juice, rice, tobacco paper, and tuna). However, the basic principles of the present invention are not limited to any particular type of item. A set of magnets 430-432 is coupled to the back of the IoT device 400 and allows the user to magnetically attach the IoT device 400 to the front of the refrigerator.

  The illustrated IoT device 400 is particularly suitable for elderly users or other users who are not technically savvy (and / or do not have access to a full-featured client). In one embodiment, the end user's son / daughter or other party establishes an account on the grocery website and selects one on behalf of the end user based on the grocery items generally ordered by the end user. A set of cards 410 can be uniquely designed. The example grocery website 130 may have an established business arrangement with the IoT service 120 such that the IoT service 120 manages the IoT device 400 and the card 410 on behalf of the grocery website 130. Thus, once an item is selected for each of the cards, the IoT service allows the new IoT device 400, the IoT hub 110 (if the end user is not already installed), and the set of cards 410 to be the end user (or user). Relatives).

  In one embodiment, the IoT device 400 is pre-provisioned by the IoT service 120 embedded with a unique ID known by the IoT service. When the end user inserts card 410 into the slot and selects one or more buttons 401-405 corresponding to items 411-415 displayed on the card, the unique ID associated with device 400 and the last selected Identification data identifying the selected item is transmitted to the IoT service and / or directly to the grocery website 130 through the mobile service 115 (or WiFi). In one embodiment, the grocery website maintains a mapping between the end user's account and the device ID that can be communicated to the grocery service by the IoT service 120 after provision of the new device 400. As a result, the grocery website 130 identifies the end user with a device ID and fulfills the order for the item selected by the end user. For example, the grocery service may schedule delivery of items to the end user's home address that may be stored in the end user database 121 along with an association of the user's device ID and the end user's account. Thus, in this embodiment, the IoT service 120 does not need to maintain a database containing any user account data (thus protecting end user privacy and simplifying the implementation of the IoT service). Rather, the IoT service can only track the device ID of each IoT device provided to the end user.

  In one embodiment, when the user selects a particular item, the LED 209 on that button can be lit to reflect the selection. In one embodiment, the user can select a particular button 401-405 multiple times to order multiple instances of the item. In this case, the LEDs can change color to reflect the number of each item ordered. Alternatively, each button may have a small LCD (or other electronic visual display) configured to display the number of items selected by the end user. In one embodiment, the user can insert multiple cards 410 to select items in this manner, and when complete, can select a complete button 406 to complete the transaction. In addition, the transaction may be automatically completed after a specified period of time without additional user input. Once the transaction is completed, in one embodiment, the LED in button 406 (or another “order path LED”) remains lit until delivery is made to indicate that the ordered item is on the way. May be.

  In response, the low power microcontroller 200 sends a device ID with identification data for each of the selected items (and the selected number) to the IoT hub 110, and the IoT hub 110 confirms the user's selection. Transfer to IoT service 120 and / or directly to grocery store website 130. As described above, the user's address and other account information may be associated with a device ID in the end user database 121. Thus, upon receiving transaction details, the user's account is withdrawn for an amount equal to the cost of the selected item and delivery to the user's home is scheduled. Upon delivery, the IoT device 400 can be reset to reflect that there are no new orders currently waiting.

  In one embodiment, audio feedback is used to communicate the ordered items and the amount of each item. For example, in one embodiment, digital audio samples for each item on each card 410 may be transmitted to device 400 via IoT hub 410. The audio samples may then be played back using the audio decoder and speaker 205 of the low power microcontroller 200. For example, when the user selects the water package 411, the application program code 203 executed on the low power microcontroller 200 identifies the item (based on the bar code) and further digitally associated with the selected item. Audio samples can be identified. It can then cause the low power microcontroller 200 to render the digital audio sample on the speaker 205 along with the digital audio sample indicating the ordered number.

  In an alternative embodiment, the application program code 203 running on the low power microcontroller 200 can perform speech synthesis. In this case, a text description of each item can be provided to the IoT device 400, which performs text-to-speech synthesis to speak the text description verbally upon selection of each item by the end user.

  In one embodiment, when the user completes the item selection and presses the complete button 406, transaction details are audibly read back to the user via the speaker. This may include, for example, a description of the ordered item and / or a scheduled delivery date. In one embodiment, delivery date information is transmitted by the grocery website 130 to the IoT device 400 after the order details are received and evaluated by the website.

  Although described above in the context of grocery applications, the IoT device 400 can be used for virtually any application that requires a user to select from a set of options. For example, a set of such devices can be placed outside an apartment and a card with the name of each apartment's residence can be inserted. In response to the selection, the IoT device 400 can send a notification to the IoT service 120 (potentially with a photo of the user who made the selection if a network camera is available at that location). The IoT service 120 can then ring the appropriate residential doorbell and / or send a text or voice call to the user device 135 of the residential user. In one embodiment, the doorbell is implemented as another IoT device that is communicatively coupled to an IoT service via an IoT hub as described herein.

  As another example, the IoT device 400 may be implemented as a toy or educational device. For example, a list of different types of dinosaurs, animals, or other objects can be printed on the card. In response to the selection of the button, a corresponding subject description may be audibly generated for the end user. There can be a virtually unlimited number of applications that the user needs to select from a set of displayed options.

  In one embodiment shown in FIG. 5A, the IoT hub 550 is implemented as a smart clock / calendar device that can be mounted on the wall of the user's home or placed on an end table. In addition to the architectural components shown in FIG. 3, this embodiment provides a video display interface and screen for displaying various types of information including the current time 551 and temperature 552 and a set of calendar events 560-563 for that day. Including. The video display interface may be integrated within the low power microcontroller 200 or may be implemented in a separate chip that is communicatively coupled to the microcontroller 200.

  As shown, a time scale 565 is shown that visually shows the time that each of the calendar events is scheduled to occur and different graphics are used to imply different types of calendar events. In the particular example shown in FIG. 5A, the user has a doctor appointment 561 at 9 am, a lunch appointment 563 at noon, and a travel event at approximately 2 pm. In addition, a weather event 560 is displayed to indicate snow starting at 3:30 pm. As shown, graphics and / or animation (eg, animation representing snow, rain, wind, etc.) can be used to display transient weather events such as snow and rain in the background. In one embodiment, if the user has an appointment, a small map may be displayed to show the location of the appointment, and / or the appointment address may simply be displayed. The map / address display may also include an indication of the current amount of time required to move from the location of the IoT clock hub 550 to the appointment. All of the travel information may be extracted from an online mapping service such as Google Map ™ or Mapquest ™. In one embodiment, a display of major events such as earthquakes can also be displayed on the IoT clock hub 550 along with related information (such as event location). Of course, the above is merely an example. Various other types of information may be displayed on the IoT clock hub 550 within the context of the timeline 565.

  In one embodiment, the IoT clock hub 550 connects to the user's social networking service to download recently posted photos and / or comments from the user's social networking account. These can include posts created by the user and / or friends and / or family specified by the user. For example, the user can configure the IoT clock hub 550 to display new posts made only by a particular “friend” of the user on the social networking site.

  In one embodiment, data updates displayed on the watch are sent directly from the IoT service 120, one or more websites 130 for which the user has an account, and / or an application on the user's device 135. For example, the calendar data may be provided by a calendar managed by the user via an application on the user device 135 and / or a server-side such as Microsoft Exchange Server or a cloud-based server that the user maintains on the calendar. It may be provided via a calendar (eg, run on IoT service 120 or website 130). The current time and temperature may be provided by a network server such as the IoT service 120 and / or read from one or more IoT devices 101-105 coupled to the IoT clock hub 550. For example, one of the IoT devices 101-105 may be an environmental sensor and may provide the current temperature, pressure, humidity, etc. to the IoT clock hub 550.

  In one embodiment, the clock hub 550 is further configured to play the user's audio playlist from an external server and / or the user's mobile device. For example, the IoT clock 550 retrieves a playlist from the user's music library (eg, using a protocol common to that library), uses the built-in audio decoder and speaker 205 to stream music in the playlist, and Can be played. In one embodiment, the IoT clock hub 550 establishes a direct local connection with the user's mobile device 135 using the same network protocol that is used to communicate with the IoT devices 101-105. For example, it may establish a Bluetooth LE audio connection with the user's mobile device 135 and then operate as an audio output connected for the mobile device.

  In one embodiment, in order to keep the cost of the clock hub 550 low, it does not include an input device for entering new entries directly into the clock. That is, the IoT clock hub 550 receives data from a network source, but not directly from a user updating an entry via an application on the mobile device 135. Alternatively, in one embodiment, the user may interact directly with the IoT clock hub 550 itself to enter new data (eg, via a touch screen built into the IoT clock hub 550). ).

  In addition to audio, one embodiment of the IoT clock hub 550 may be directly from the user's mobile device 135, from the IoT service 120, and / or one or more other external servers (eg, where the user stores photos). The photos to be displayed can be downloaded from the website 130). Specific photos, audio and other content to be displayed on the IoT clock hub 550 can be specified by the user configuring and interacting with the hub via the IoT service 120 (as described above, Via an application installed on the user's computing device 135).

  In one embodiment, the IoT clock hub 550 can be configured to receive and display electronic messages sent by end users. For example, it can consist of an email message address or a text message address. For example, if the IoT clock hub 550 is in a visible position in the user's home, the user can send a message to the entire family by sending a text message or email message to the IoT clock hub 550. In one embodiment, if the message includes a photo, the IoT clock hub 550 can display the photo.

  In one embodiment, the IoT service 120 functions as a translator for content displayed or played on the IoT hub 110 and / or the IoT devices 101-105. For example, in one embodiment, a photo transmitted from a user's mobile device 135 is converted by the IoT service 120 into a format / resolution that can be rendered by the IoT hub 110 and / or the IoT devices 101-105. Similarly, for audio, the IoT service 120 is a format (potentially a lower bit rate or a different type of compression) that is configured to play audio by the IoT hub 110 and / or the IoT devices 101-105. ).

  As described above, the IoT clock hub 550 can be designed with mounting brackets or holes so that it can be mounted on a wall in a convenient location such as a user's kitchen. Further, in one embodiment shown in FIG. 5B, the IoT clock hub 550 may be adapted to connect with different types / styles of artistic frames 501. In one embodiment, a magnet 506 is attached or embedded within each frame 501 to magnetically attach the frame to an IoT hub clock 550 that includes a corresponding magnet or metal around it. Further, the IoT clock hub 550 can detect a model of the frame attached based on the position of the magnet 506 and / or the ID code encoded on the magnet. Thus, the position of the magnet or the encoding contained within the magnetic material can serve as a fingerprint to uniquely identify different types of frames. Alternatively, or in addition to the use of magnets, the IoT clock hub 550 can include a physical interface for interfacing with the frame 501. In this embodiment, an ID code identifying the frame may be provided via the interface. In addition, the interface can include a physical audio connection for the embodiment described below in which the frame includes a speaker 505.

  In one embodiment, the style of information displayed in the IoT clock hub display may be automatically changed based on the type of frame attached. For example, if a “modern” style frame is attached, the color / font / graphic style used to display information about the IoT clock hub 550 will automatically switch to match the modern frame style. be able to. Similarly, if a “traditional” style frame is attached, the color / font / graphic style used to display the IoT clock hub 550 information will automatically match the traditional frame style. Can be switched to. One embodiment of the frame 501 may be designed for use in a children's room (eg, a Hello Kitty ™ frame or a cuckoo clock may be designed). In response, the IoT clock hub 550 can be configured to display an appropriate background that matches the frame type (eg, displaying a Hello Kitty or cuckoo clock image at the hour). Furthermore, although a rectangular frame is shown in FIG. 5B, other shapes such as a circular or elliptical frame are also conceivable. In the case of a circular / elliptical frame, the display on the IoT clock hub 550 may be adjusted to fit the frame shape (eg, do not display content in the area of the screen hidden by the frame).

  As described above, in one embodiment, the frame 501 includes a set of high quality speakers 505 for generating audio provided from the IoT clock hub 550 via the audio interface. For example, in an embodiment where the IoT clock hub 550 downloads the user's audio playlist (as described above) and streams / decodes the audio identified in the playlist, the audio is embedded in the clock hub 550. It is reproduced not through the speaker 205 but through the high-quality speaker 505.

  Various different types of frames 501 can be coupled to the IoT hub 550 to provide a variety of different I / O capabilities. For example, the camera's built-in frame can be installed to take a picture or capture a video in response to a command sent from the user's mobile device / application 135 to the IoT hub 550. Thus, the frame 501 may operate as a local surveillance camera in the user's home. In another embodiment, the frame functions as an integrated remote control device that can be controlled via user equipment / apps (eg, to control local A / V equipment such as the user's TV and receiver). Can have an IR blaster. In another embodiment, the frame 501 can include a thermal sensor, a smoke sensor, and / or a carbon monoxide detector. In this embodiment, the IoT clock hub 550 can generate an alarm in response to any sensor that exhibits a level above an acceptable threshold. Alerts can also be configured to be sent to services such as home monitoring services and / or local fire stations.

  Another embodiment of an IoT clock hub 550 is shown in FIGS. 5C-5F, which attach the IoT clock hub 550 to a wall or place the IoT clock hub 550 on a desk (or other structure). Including these options. 5C-5D, the IoT clock hub 550 is shipped to the end user with a circular plate 510 magnetically secured in a circular cavity 513 formed in the rear of the IoT clock hub 550. Also good. FIG. 5C shows a circular plate 510 magnetically mounted in the cavity 513, and FIG. 5D shows the circular plate 510 removed from the cavity 513. The circular plate 510 may be formed from a magnetic material and / or the magnetic material is included under the circular cavity 513 and fixedly attached when the plate 510 contacts the circular cavity 513. In one embodiment, the circular plate 510 includes holes 512 that can be threaded with screws to secure the circular plate to the wall. 5E, the IoT clock hub 550 can then be attached to the circular plate 510 and the IoT clock hub 550 can be attached to the wall.

  Circular plate 510 is particularly useful for wall mounting. This is because the user can attach the circular plate 510 to the wall in any orientation (ie, without using a horizontal plane). The user then achieves the correct level by magnetically engaging the circular plate 510 with the circular cavity 513 on the back of the IoT clock hub 550 and rotating the IoT clock hub 550 as necessary. Thus, the clock hub 550 can be magnetically fixed to the wall.

  In addition, as shown in FIGS. 5C-5D, the back of the IoT clock hub 550 can include an insertion slot 511 that allows the user to place the IoT clock hub 550 on a table or desk (or other structure). If selected, a circular plate 510 may be inserted therein to provide support. FIG. 5F shows the circular plate 510 inserted into the insertion slot 511 of one embodiment of the IoT clock hub 550. As shown, once inserted, the IoT clock hub 550 is tilted backwards in a slightly tilted direction and relies on the balance provided by the circular plate 510.

  Thus, the circular plate 510, which is a single support element, can be used for both wall mounting of the IoT clock hub 550 and support of the IoT clock hub 550 on a table or other surface.

  FIG. 6 shows a specific application in which one IoT device 101 is coupled to or embedded in a water distributor 601 and another IoT device 102 is embedded in a rice distributor 602. In one embodiment, the IoT device 101 detects a sensor (shown as 250 in FIG. 2) to detect whether the amount of water currently present in the distributor 601 is below a specified threshold amount. including. For example, the sensor 250 can measure the weight of water in the distributor and report the current weight to the low power microcontroller 200. Based on the application program code 203, when the weight reaches a certain threshold, the IoT device 101 sends a message indicating that a new water container is needed. The message is sent via the IoT hub 110 to the IoT service 120 and / or the external website 130 to place an additional water order. The order may include identification information for the IoT device 101 (using a unique ID code) associated with the user's account including the user's home address and billing data. The new water container is then shipped automatically to the user's home. Similarly, the IoT device 102 in the rice distributor 602 can detect when the weight of rice contained therein reaches a certain threshold. The IoT device 102 can then automatically send a message (based on the application program code 203) when the weight reaches a specified threshold.

  Various other sensors can be integrated within the IoT devices 101-105 to collect a variety of different types of information. For example, in one embodiment, an IoT device with a thermal sensor may be configured on or near the stove to detect when the stove burner is on. In one embodiment, the IoT device may also be configured to control (eg, turn on / off) the stove in response to a signal transmitted from an app on the user's device 135. As another example, an IoT device may include an accelerometer and coupled to a device for detecting movement around and / or the user's home (number of steps taken by the user, or within the user's home) For example, to detect how often a particular object is used). The principles underlying the present invention can be implemented in a virtually unlimited number of applications and situations.

  Embodiments of the present invention may include the various steps described above. The process can be embodied in machine-executable instructions that can be used to cause a general purpose or special purpose processor to perform the process. Alternatively, these steps can be performed by specific hardware components including hard-wired logic for performing the steps or by any combination of programmed computer components and custom hardware components. .

  As described herein, the instructions are configured to perform certain specific operations, or certain functions or software instructions are stored in a memory embodied in a non-transitory computer readable medium. Reference may be made to a specific configuration of hardware, such as an application specific integrated circuit (ASIC). Thus, the techniques shown in the drawings may be implemented using code and data stored and executed on one or more electronic devices (eg, end stations, network elements, etc.). Such electronic devices include non-transitory computer machine readable storage media (eg, magnetic disk, optical disk, random access memory, read only memory, flash memory device, phase change memory), as well as temporary computer machine readable communication media ( For example, computer and machine readable storage media such as carrier waves, infrared signals, digital signals, etc., electrical, optical, acoustic or other forms of propagation signals) are used to store and (internally and / or data). (Or communicate with other electronic devices via a network). Further, such electronic devices may include one or more storage devices (non-transitory machine readable storage media), user input / output devices (eg, keyboards, touch screens, and / or displays), and network connections. It typically includes one or more sets of processors coupled to one or more other components. The connection between a set of processors and other components is typically done through one or more buses and bridges (also called bus controllers). Each of the signals carrying the storage device and network traffic represents one or more machine-readable storage media and machine-readable communication media. Thus, the storage device of a given electronic device typically stores code and / or data for execution on the set of one or more processors of that electronic device. Of course, one or more portions of embodiments of the present invention may be implemented using different combinations of software, firmware, and / or hardware. Throughout this detailed description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to those skilled in the art that the present invention may be practiced without some of these specific details. In certain instances, well-known structures and functions have not been described in detail in order to avoid obscuring the subject matter of the present invention. Accordingly, the scope and spirit of the present invention should be determined from the following claims.

Claims (55)

An Internet of Things (IoT) system,
An IoT hub including a WAN interface that couples the IoT hub to an IoT service over the WAN, and a local communication interface that communicatively couples the IoT hub to a plurality of different types of IoT devices;
At least one IoT device having a memory for storing program code and a microcontroller for executing the program code, the program code including library program code, the library program code being developed Includes basic building blocks that can be used to implement any IoT device by creating application program code that utilizes the library program code, wherein at least one of the basic building blocks is the IoT hub A communication stack enabling communication with the library program code provided to the developer in a software development kit (SDK) with a microcontroller.   The system of claim 1, wherein the IoT device includes a sensor that collects local data according to the application program code and / or an output control device that performs an output control function according to the application program code.   The application program code is executable by the microcontroller to cause the IoT device to perform one or more application-specific functions, at least one of the functions collecting local data or The system of claim 1, comprising performing a local control function.   The system of claim 1, wherein the IoT device further includes a low power communication interface for establishing a local communication channel with the IoT hub according to the library program code.   The system of claim 3, wherein the local communication interface includes a Bluetooth low energy (LE) radio for establishing a Bluetooth LE communication channel with the IoT hub.   The system of claim 1, wherein the WAN includes the Internet.   The system of claim 1, wherein the SDK includes the IoT hub and provides the developer with access to the IoT service. A method,
Providing an IoT hub including a WAN interface that couples an IoT hub to an IoT service over a WAN, and a local communication interface that communicatively couples the IoT hub to a plurality of different types of IoT devices;
Providing at least one IoT device having a memory for storing program code and a microcontroller for executing the program code;
Providing said program code including library program code including basic building blocks that can be used to implement any IoT device by creating application program code that utilizes the library program code. , At least one of the basic building blocks includes a communication stack that enables communication with the IoT hub, and the library program code provides the developer with a software development kit (SDK) comprising the microcontroller. ).   9. The method of claim 8, wherein the IoT device includes a sensor that collects local data according to the application program code and / or an output control device that performs output control functions according to the application program code.   The application program code is executable by the microcontroller to cause the IoT device to perform one or more application-specific functions, at least one of the functions collecting local data or The method of claim 8, comprising performing a local control function.   9. The method of claim 8, wherein the IoT device further includes a low power communication interface for establishing a local communication channel with the IoT hub according to the library program code.   The method of claim 10, wherein the local communication interface includes a Bluetooth low energy (LE) radio for establishing a Bluetooth LE communication channel with the IoT hub.   The method of claim 8, wherein the WAN includes the Internet.   9. The method of claim 8, wherein the SDK includes the IoT hub and provides the developer with access to the IoT service. A device,
A memory for storing the program code; a microcontroller for executing the program code;
A communication interface for connecting the microcontroller to a network;
A plurality of input elements communicatively coupled to the microcontroller to detect user input;
A slot for receiving a selection card, wherein the selection card includes a plurality of user-selectable items displayed thereon, each of the input elements when the selection card is inserted into the slot Associated with at least one of the user selectable items displayed on the card;
Upon selection of a specific input element corresponding to a specific item, the microcontroller transmits the identification code of the item to a service on the network, and the service uses the identification code to identify the item. An apparatus that performs one or more operations according to selection of the item by the user.   The apparatus of claim 15, wherein the item is a grocery item and the service is a grocery service.   17. Each card includes a list of grocery items selectable by the user via the input element associated with each of the grocery items when each card is inserted into the slot. Equipment.   16. The apparatus of claim 15, wherein the communication interface includes a local communication interface that couples the apparatus to a local hub device that is coupled to the service via a wide area network (WAN).   The apparatus of claim 18, wherein the communication interface comprises a Bluetooth low energy (LE) interface.   The apparatus of claim 15, wherein the plurality of input elements includes user selectable buttons.   21. Each user selectable button has a light emitting diode (LED) associated with it, and when the user selects an item, the microcontroller illuminates an LED associated with the button for that item. The device described in 1. An audio decoder communicatively coupled to or within the microcontroller, the audio decoder associated with the item being decoded when the user selects the item via the input element An audio decoder,
The apparatus of claim 15, further comprising a speaker that is integrated within the apparatus and generates sound included in the audio content.   23. The apparatus of claim 22, further comprising a speech synthesis module that converts text associated with the item into audio content, and then the audio content is decoded by the audio decoder and output to the speaker. A system,
An IoT hub that includes a WAN interface that couples the IoT hub to the oT service via the WAN and a local communication interface that communicatively couples the IoT hub to a plurality of different types of IoT devices;
An IoT device, the IoT device comprising:
A memory for storing the program code; a microcontroller for executing the program code;
A communication interface for connecting the microcontroller to the IoT hub via a network;
A plurality of input elements communicatively coupled to the microcontroller to detect user input;
A slot for receiving a selection card, wherein the selection card includes a plurality of user-selectable items displayed thereon, each of the input elements when the selection card is inserted into the slot Associated with at least one of the user selectable items displayed on the card;
Upon selection of a specific input element corresponding to a specific item, the microcontroller transmits the identification code of the item to a service on the network, and the service uses the identification code to identify the item. A system that performs one or more operations according to selection of the item by the user.   25. The system of claim 24, wherein the item is a grocery item and the service is a grocery service.   26. Each card includes a list of grocery items selectable by the user via the input element associated with each of the grocery items when each card is inserted into the slot. System.   25. The system of claim 24, wherein the communication interface includes a local communication interface that couples the IoT device to the IoT hub.   28. The system of claim 27, wherein the communication interface comprises a Bluetooth low energy (LE) interface.   25. The system of claim 24, wherein the plurality of input elements include user selectable buttons.   30. Each user selectable button has a light emitting diode (LED) associated with it, and when the user selects an item, the microcontroller illuminates the LED associated with the item button. The system described in. An audio decoder communicatively coupled to or coupled to the microcontroller, wherein the audio content associated with the item is decoded when the user selects the item via the input element An audio decoder;
25. The system of claim 24, further comprising a speaker that is integrated within the IoT device and generates sound included in the audio content.   32. The system of claim 31, further comprising a speech synthesis module that converts text associated with the item into audio content, and then the audio content is decoded by the audio decoder and output to the speaker. A method,
Providing an IoT hub that includes a WAN interface that couples the IoT hub to an IoT service over the WAN and a local communication interface that communicatively couples the IoT hub to a plurality of different types of IoT devices;
Providing an IoT device, the IoT device comprising:
A memory for storing the program code; a microcontroller for executing the program code;
A communication interface for connecting the microcontroller to a network;
A plurality of input elements communicatively coupled to the microcontroller to detect user input;
A slot for receiving a selection card, wherein the selection card includes a plurality of user-selectable items displayed thereon, each of the input elements when the selection card is inserted into the slot Associated with at least one of the user selectable items displayed on the card;
Upon selection of a specific input element corresponding to a specific item, the microcontroller transmits the identification code of the item to a service on the network, and the service uses the identification code to identify the item. A method of performing one or more operations according to selection of the item by the user. Internet of Things (IoT) clock hub,
A memory for storing the program code; a microcontroller for executing the program code;
A WAN interface for coupling the IoT clock hub to an IoT service via a WAN, and a local communication interface for communicatively coupling the IoT hub to a plurality of different types of IoT devices;
A display that displays a clock indicating a current time, current temperature, and one or more calendar events retrieved from a user's calendar, the calendar events being transmitted to the IoT clock hub via the WAN interface. Provided Internet of Things (IoT) clock hub.   35. The IoT clock hub of claim 34, wherein the calendar event is provided from a server-side calendar managed by the user via a user client device.   35. The IoT clock of claim 34, wherein at least some of the IoT devices are configured to collect data and provide the data to the IoT clock hub for display on the display. Hub. An audio decoder for decoding audio content streamed to the IoT clock device via the WAN or the local communication interface;
35. The IoT clock hub of claim 34, further comprising a speaker integrated within or on the IoT clock hub to generate an audible sound of the audio content.   38. The IoT clock hub of claim 37, wherein the audio content is identified by a user downloading a playlist to the IoT clock hub.   38. The IoT clock hub of claim 37, wherein the audio content is provided directly from the user's mobile device via the local communication interface.   38. The IoT clock hub of claim 37, wherein the local communication interface includes a Bluetooth low energy (LE) radio for establishing a Bluetooth LE communication channel with the IoT device.   35. The IoT clock hub of claim 34, further comprising a frame sized according to the width and height of the IoT clock hub and adapted to attach to the periphery of the IoT clock hub.   In response to the attachment of a photo frame, the microcontroller of the IoT clock hub detects one or more characteristics of the attached frame and updates one or more graphic characteristics used in the display accordingly. 42. The IoT clock hub of claim 41.   43. The IoT clock hub of claim 42, wherein the one or more graphic characteristics include graphic characteristics determined to match the frame.   The frame includes a speaker for playing audio content from the IoT clock hub, and the speaker is electrically coupled to an audio output of the IoT clock hub when the frame is attached to the IoT clock hub. 42. The IoT clock hub of claim 41. Internet of Things (IoT) clock hub system,
A memory for storing the program code; a microcontroller for executing the program code;
A WAN interface that couples the IoT clock hub to an IoT service via a WAN, and a local communication interface that communicatively couples the IoT hub to a plurality of different types of IoT devices;
A display that displays a clock showing current time, current temperature, and one or more calendar events retrieved from a user's calendar, the calendar events being provided to the IoT clock hub via the WAN interface The display and
At least one IoT device having a memory for storing program code and a microcontroller for executing the program code, the program code including library program code, A developer includes application program code that utilizes the library program code to include basic building blocks that can be used to implement any loT device, wherein at least one of the basic building blocks is the IoT A communication stack that enables communication with a hub, wherein the library program code is provided to the developer in a software development kit (SDK) with the microcontroller. Doo (IoT) clock hub system.   46. The IoT clock hub system of claim 45, wherein the calendar event is provided from a server-side calendar managed by the user via a user client device.   46. The IoT clock of claim 45, wherein at least some of the IoT devices are configured to collect data and provide the data to the IoT clock hub for display on the display. Hub system. An audio decoder for decoding audio content streamed to the IoT clock device via the WAN or the local communication interface;
46. The IoT clock hub system of claim 45, further comprising a speaker integrated within or on the IoT clock hub to generate an audible sound of the audio content.   38. The IoT clock hub system of claim 37, wherein the audio content is identified by a user downloading a playlist to the IoT clock hub.   50. The IoT clock hub system of claim 49, wherein the audio content is provided directly from the user's mobile device via the local communication interface.   49. The IoT clock hub system of claim 48, wherein the local communication interface includes a Bluetooth low energy (LE) radio for establishing a Bluetooth LE communication channel with the IoT device.   46. The IoT clock hub system of claim 45, further comprising a frame sized according to the width and height of the IoT clock hub and adapted to attach to the periphery of the IoT clock hub.   In response to the attachment of a photo frame, the microcontroller of the IoT clock hub detects one or more characteristics of the attached frame and correspondingly determines one or more graphic characteristics used in the display. 53. The IoT clock hub system of claim 52 that updates.   54. The IoT clock hub system of claim 53, wherein the one or more graphic characteristics include graphic characteristics determined to match the frame.   The frame includes a speaker for playing audio content from the IoT clock hub, and the speaker is electrically coupled to an audio output of the IoT clock hub when the frame is attached to the IoT clock hub. 53. The IoT clock hub system of claim 52.