JP6305122B2 - Refrigerator and network system equipped with refrigerator - Google Patents

Description

  The present invention relates to a refrigerator, in particular, a refrigerator capable of grasping food storage conditions in a warehouse by an image and a network system including the refrigerator.

  A variety of foods are stored in home refrigerators as the eating habits diversify, and the capacity increases to further increase the storage capacity, making it increasingly difficult to grasp the storage status in the storage. Yes. In addition, due to the increase in double-income households in recent years, it is difficult for housewives to grasp the storage situation in the warehouse completely, and the stored food was left to be discarded after the expiration date. Occasionally, there were cases where the necessary ingredients were not stocked, and there were also stories of experiences where the ingredients were wasted due to multiple purchases when the couple shared the shopping.

  The easiest way to check the storage status in the storage is to open the door directly and see it, but opening and closing the door causes an increase in the temperature in the storage and wastes energy for re-cooling. There is also an adverse effect on the quality of stored food. Therefore, if the storage state in the refrigerator can be grasped from a remote place such as during shopping without opening the door, the added value that the waste of food and energy can be suppressed and the preservation quality of the food can be maintained can be obtained.

  Therefore, a refrigerator using a camera door in which a CCD camera is embedded inside the door has been proposed as a conventional refrigerator for copying food in the warehouse and confirming the storage load situation in the warehouse by image data ( For example, see Patent Document 1).

  In addition, for example, as a conventional refrigerator that transmits an image in a warehouse to a user's portable terminal via a server, monitors the inside of the warehouse, a change in the contents in the warehouse is detected from the image, and an article storage that identifies the changed position A warehouse has been proposed (see, for example, Patent Document 2). In this patent document 2, by performing image processing such as enclosing the change position of the stored item with a frame on the entire image in the warehouse, the position where the stored item is changed can be easily identified.

JP 2001-317858 A (paragraphs [0040]-[0049], FIG. 4, FIG. 5) JP 2007-46834 A (paragraphs [0021]-[0027], FIGS. 1 to 3)

  In the refrigerator described in Patent Document 1, since it is possible to photograph from the right end to the left end in the cabinet, it is possible to grasp the food placed in the corner. However, in the technique of Patent Document 1, no consideration has been given to inventory management associated with storage / receipt of stored items, and there has been a problem that changes in stored items in the store cannot be easily detected.

  In the refrigerator described in Patent Document 2, when a change in the stored item is detected, image processing is performed so that the change position can be identified, and image data is sent to the portable terminal. For this reason, the user can grasp the change of the stored item without inquiring one by one in a remote place. However, since the image data transmitted to the mobile terminal is image data in which the change position of the stored item is superimposed on the entire image, the data capacity increases. In addition, since only the change position of the stored item is detected, there is a problem that it is not possible to determine whether the stored item is in or out.

  The present invention has been made in order to solve the above-described problems, and includes a refrigerator and a refrigerator that can perform inventory management in a warehouse associated with loading and unloading using a stored image extracted from the entire image. An object of the present invention is to provide a provided network system.

The refrigerator according to the present invention is stored on the basis of the storage room, the door for opening and closing the opening of the storage room, the photographing means for photographing the storage room, and the storage room images taken by the photographing means before and after opening and closing the door. And storage / retrieval item extraction means for extracting an image of the stored goods, and storage / accommodation identification information indicating whether the storage object image extracted by the storage / extraction storage object extraction means is a warehousing or a warehousing, Image storage means for storing together with time information when the door opening / closing operation is performed, and a display control device for causing the display means to output a display screen capable of confirming stock in the storage room based on stored data in the image storage means. The display screen is a screen in which the stored item images are displayed in a time-series list divided into warehousing and delivery .

  The network system according to the present invention includes the refrigerator.

  ADVANTAGE OF THE INVENTION According to this invention, the network system provided with the refrigerator and refrigerator which can perform the inventory management in the warehouse accompanying loading / unloading using the image data of stored goods itself can be obtained.

It is a schematic block diagram (front view) of the refrigerator which concerns on Embodiment 1 of this invention. It is a schematic block diagram (side projection) of the refrigerator compartment in the refrigerator which concerns on Embodiment 1 of this invention. It is an example of the imaging | photography data at the time of food entering / exiting in the refrigerator compartment of the refrigerator which concerns on Embodiment 1 of this invention. It is an example of the display method of the entering / exiting food image in a portable terminal in the refrigerator which concerns on Embodiment 1 of this invention. It is an example of the display method of the stock food image in the portable terminal in the refrigerator which concerns on Embodiment 1 of this invention. It is a schematic block diagram (side projection) of the refrigerator compartment in the refrigerator which concerns on Embodiment 2 of this invention. It is a schematic block diagram (side projection) of the refrigerator compartment in the refrigerator which concerns on Embodiment 3 of this invention. It is an example of the display method of the storage amount estimation result and stock food image in a portable terminal in the refrigerator compartment which concerns on Embodiment 3 of this invention. It is a schematic block diagram (side projection) of the refrigerator compartment in the refrigerator which concerns on Embodiment 4 of this invention. It is an example of the measurement data (storage volume occupation rate: 0%) which shows temperature history in the refrigerator compartment of the refrigerator which concerns on Embodiment 4 of this invention. It is an example of the actual measurement data (storage volume occupation rate: 40%) which shows the temperature history in the refrigerator compartment of the refrigerator which concerns on Embodiment 4 of this invention. It is an example of the actual measurement data (storage volume occupation rate: 70%) which shows the temperature history in the refrigerator compartment of the refrigerator which concerns on Embodiment 4 of this invention. It is a schematic block diagram (side projection) of the refrigerator which concerns on Embodiment 5 of this invention. It is a schematic block diagram of the home system by which the refrigerator which concerns on Embodiment 6 of this invention is mounted. It is a schematic block diagram of the indoor system in which the refrigerator which concerns on Embodiment 7 of this invention is mounted, and an external system.

[Embodiment 1]
FIG. 1 is a schematic configuration diagram (front view) of a refrigerator according to Embodiment 1 of the present invention. FIG. 2 is a schematic configuration diagram (side projection) of the refrigerator compartment in the refrigerator according to Embodiment 1 of the present invention.
As shown in FIG. 1, the refrigerator 1000 includes a plurality of storage rooms. For example, the storage room includes a refrigerator room 100, an ice making room 200, a switching room 300, a freezer room 400, and a vegetable room 500. If it demonstrates in detail, each storage room will be arrange | positioned in order of the refrigerator compartment 100, the ice making room 200, the switching room 300, the freezer compartment 400, and the vegetable compartment 500 from the top. In addition, an operation panel 1 capable of setting the temperature of each storage room, displaying current temperature information, an image in the warehouse, and a storage status is installed on the door of the refrigerator compartment 100. In addition, the installation position of the operation panel 1 is not restricted to the door of the refrigerator compartment 100, You may install in the side surface of the door of another storeroom, or the refrigerator 1000. FIG.

  In FIG. 2, the refrigerator compartment 100 is closed at the front side by a refrigerator compartment door 101, and a plurality of refrigerator compartment shelves 102 are installed therein, and the compartment is partitioned into a plurality of spaces (shelves). Yes. In addition, the refrigerator compartment 100 and the chilled compartment 110 are partitioned by the lowermost refrigerator compartment shelf plate 102, and inside the chilled compartment 110, along the guide jig such as a rail (not shown), the refrigerator compartment door 101 side. A chilled case 111 that can be pulled out is installed.

  On the inner surface of the refrigerator compartment door 101, a camera 2 having a visual field range from the ceiling surface of the refrigerator compartment 100 to the chilled compartment 110 is installed, and it is possible to take a picture from the refrigerator compartment door 101 side that is the same as the user's viewpoint. It has a configuration. The installation position of the camera 2 is not limited to the inner surface of the refrigerator compartment door 101, and may be any position as long as it can photograph a large amount of stored items such as food placed on the refrigerator compartment shelf board 102, for example, the ceiling If it is installed in the vicinity of the illumination device 4 installed on the surface, there is an advantage that it is easy to shoot because the illuminance can be secured.

  Further, a door open / close detection sensor 3 for detecting opening / closing of the refrigerator compartment door 101 is installed on the main body side of the refrigerator compartment 100 in contact with the refrigerator compartment door 101. The main role of the door opening / closing detection sensor 3 is related to the control of the lighting device 4, and the lighting device 4 is turned on when the open state of the refrigerator compartment door 101 is detected, and the lighting device 4 is turned off when the closed state is detected. The As the door opening / closing detection sensor 3, for example, a magnet system in which the proximity of a magnet (magnet) embedded in the refrigerator compartment door 101 is detected by a pair of reed switches installed on the refrigerator main body side is common.

  In addition, on the rear surface of the refrigerator 1000, a control device including a photographing signal transmission device 5, an incoming / outgoing food extraction device 6, a display control device 7 having an image memory 7a, and a wireless communication device 8 is mounted. A control board 1001 is installed. The control device is composed of, for example, a microcomputer. The shooting signal transmission device 5 is connected to the camera 2, the door opening / closing detection sensor 3, and the lighting device 4, and the shooting timing of the camera 2 and the lighting of the lighting device 4 according to the detection result of the door opening / closing detection sensor 3, Control the timing of turning off.

  The incoming / outgoing food extraction device 6 is connected to the camera 2 and the image memory 7a, and from the entire image (storage room image) in the refrigerator compartment 100 photographed by the camera 2, the incoming / outgoing food image (stored item image) is displayed. Extract and transfer only the extracted food image to the image memory 7a. The food image transferred to the image memory 7a is stored together with image accompanying information including time information and warehousing / departure identification information indicating whether the food is warehousing or warehousing. Furthermore, the image memory 7a is connected to the operation panel 1 and a wireless communication device 8 provided with a communication module such as Wi-Fi or Bluetooth (registered trademark), for example. The food image and the image associated information stored in 7 a can be displayed on the operation panel 1 or transmitted to a mobile terminal or the like as a user terminal via the wireless communication device 8.

Next, an example of the operation will be described with reference to FIGS.
In FIG. 2, when the door open / close detection sensor 3 detects that the refrigerator compartment door 101 has been opened, the photographing signal transmission device 5 turns on the illumination device 4. Then, food in and out of the warehouse is taken in and out. When it is detected that the refrigerator compartment door 101 is closed, the photographing signal transmission device 5 first instructs the camera 2 to perform photographing, and turns off the illumination device 4 after photographing is completed. The captured entire image of the refrigerator compartment 100 is temporarily stored in the storage / extraction food extraction device 6. Therefore, every time the refrigerator door 101 is opened / closed, the entire image of the refrigerator compartment 100 is sent from the camera 2 to the incoming / outgoing food extraction apparatus 6.

  The entering / exiting food extraction device 6 stores the entire image in the refrigerator compartment 100 when the door is opened and closed at the previous time and the current time, and calculates the difference between the two images. It is possible to extract the change in the image at the time of opening and closing the door, that is, the entering / exiting of the food. Further, by analyzing the portion changed by the difference, for example, by comparing the amount of change of the edge processed by the edge processing and the entire image in which the inside of the refrigerator compartment 100 is in a color state, it is possible to determine the food in / out of food. .

  The food image extracted every time the door is opened / closed, the shooting time (shooting time when the door is opened / closed) and the loading / unloading identification information associated with the image extracted by the loading / unloading food extraction device 6 are transferred to the image memory 7a. Saved. The stored food image and the information accompanying the image are displayed on the operation panel 1 and the user's portable terminal via the wireless communication device 8 at the request of the user, and not only when the latest door is opened and closed, but also retroactively. Can be called and displayed.

  FIG. 3 is a diagram showing an example of imaging data at the time of food entry / exit in the refrigerator compartment of the refrigerator according to Embodiment 1 of the present invention. FIG. 3 shows an entire image of the refrigerator compartment 100 photographed by the camera 2 when the refrigerator compartment door 101 is opened and closed, and a food image extracted by the entering / exiting food extractor 6 at that time and stored in the image memory 7a. In addition, information accompanying the image is shown in time series. (A) is a reference image in which there was no entry / exit at time A, (b) is when beer is delivered at time B, (c) is when salad is delivered at time C, (d) is time D It is an image and image-accompanying information obtained when milk and cakes are received.

  In FIG. 3, since the food image is stored together with the time and the loading / unloading identification information, it is possible to estimate the approximate expiration date / expiration date of the received food from the loading time, and manage stock food as image data. It becomes possible to do. Here, the image data stored in the image memory 7a is only the extracted food image. Further, the entire image of the large-capacity refrigerator compartment 100 stored in the storage / extraction food extraction device 6 is only one image serving as a difference reference image. In other words, after the food image is extracted, the entering / exiting food extraction device 6 stores only the latest whole image, and erases the rest.

  As described above, since the amount of image data stored in the image memory 7a and the incoming / outgoing food extraction apparatus 6 is reduced, the memory capacity and the data communication load are reduced. In addition, the data to be saved is limited to when the door is opened / closed, but the door must be opened / closed whenever food is stored, so it is necessary without storing unnecessary data in order to manage in-stock foods such as time and current time. The latest storage status can be confirmed with the minimum shooting, processing, and storage operations, and the purpose of inventory management can be achieved.

  Then, the display control device 7 outputs a display screen on which the inventory in the refrigerator compartment 100 can be confirmed based on the stored data in the image memory 7 a to the operation panel 1 or to the portable terminal via the wireless communication device 8. The user can check the stock in the warehouse by checking the display screen displayed on the operation panel 1 or the display unit of the mobile terminal. Hereinafter, an example of the display screen will be described.

  FIG. 4 is a diagram showing an example of a method for displaying an incoming / outgoing food image on the mobile terminal in the refrigerator according to Embodiment 1 of the present invention. FIG. 4 shows an example of rearranged display of the food image for each door opening / closing, and the shooting time and entry / exit identification information associated with the image extracted and stored in the image memory 7a by the storage / extraction food extraction device 6. Is shown. (A) is an example which displayed the food image with the imaging | photography time and entering / exiting identification information on the timeline. (B) is an example in which food images are divided into warehousing or leaving, and food images are listed in time series in each.

  Since only the extracted food image can be easily viewed from FIG. 4, (a) In the timeline display, for example, it is possible to search the target food retroactively and estimate the best / expiration date. Become. Therefore, waste such as discarding food can be prevented. In addition, (b) in the list display, it is possible to estimate the current remaining amount from the history of entering and leaving the target food at a remote place, for example, at a shopping destination, and to prevent over-buying or forgetting to purchase useless ingredients. It becomes possible.

  Moreover, FIG. 5 is a figure which shows an example of the display method of the stock food image in the portable terminal in the refrigerator which concerns on Embodiment 1 of this invention. FIG. 5 shows a stock image at a certain time based on the food image for each door opening / closing and the shooting time and the storage / entry identification information associated with the image extracted and stored in the image memory 7a. A food image estimated to be present is displayed. As shown in FIG. 5, if the stock food images are displayed as a list for each time, the stock status can be understood more clearly than the list display shown in FIG.

  As described above, in the first embodiment, the latest situation in the warehouse is acquired as an image, food that has been entered and exited and stocked food are detected, and the minimum necessary image data (food image) and image-associated information ( (Shooting time, entry / exit identification information) is transmitted to the portable terminal or the operation panel 1. Thereby, the refrigerator which has a stock management function in which a user can grasp | ascertain easily the storage condition, especially the receipt / extraction of foodstuffs inside or outside the house can be obtained.

  In the first embodiment, since the photographing timing by the camera 2 is when the door is closed, the food image entered and exited is compared by comparing the entire image when the door is closed with the entire image when the door is closed this time. However, it may be as follows. The overall image when the door was closed last time is equal to the overall image when the door was opened, so the food image entered and exited was compared by comparing the entire image when the door was opened and the entire image when the door was closed this time. May be obtained. And the image accompanying information, such as the time when the opening / closing operation | movement of the refrigerator compartment door 101 was performed with the food image, and entering / exiting identification information should just be memorize | stored in the image memory 7a. In short, it is only necessary to obtain a food image by comparing the entire images in which the change in the food storage status before and after the opening and closing of the refrigerator door 101 is known, and to store the time when the storage status changes.

  In FIG. 2, the lighting device 4 is installed on the ceiling surface of the refrigerator compartment 100, but as the installation position of the lighting device 4, the illuminance in the refrigerator compartment 100 is secured when the camera 2 takes a picture. The lighting device 4 may be built in the camera 2, for example. If the illuminating device 4 is turned off after the photographing of the camera 2 is finished by the photographing signal transmission device 5, the same effect can be obtained while ensuring the illuminance.

  4 and 5, the food image and the image accompanying information (photographing time, entry / exit identification information) for each opening / closing of the door extracted and stored in the image memory 7 a by the entry / exit food extraction device 6 are displayed on the mobile terminal. Although the example to do was shown, the medium to display is not restricted to a portable terminal. For example, the operation panel 1 installed outside the refrigerator compartment door 101 may be used. Moreover, even if the position of the medium to be displayed is not a remote place but in the vicinity, wasteful cooling can be suppressed by opening and closing the door if the entry / exit and inventory status can be confirmed without opening the door.

  In addition, according to the user's request, the food image and the image accompanying information (shooting time, entry / exit identification information) for each opening / closing of the door are displayed on the operation panel 1 or the user's portable terminal, but each time entry / exit is performed. Alternatively, it may be transmitted from the refrigerator 1000 to the user's mobile terminal in real time.

  In addition, although the transmission destination of the food image and the image accompanying information is the portable terminal, it may be a user terminal that can be operated by the user, and may be a desktop PC.

  In the first embodiment, the configuration in which the camera 2, the door opening / closing detection sensor 3, and the lighting device 4 are installed in the refrigerator compartment 100 has been described as an example. However, a storage chamber to which these configurations are applied is arbitrary. In a storage room other than the refrigerator room 100, for example, the camera 2 was installed on the ceiling surface of the freezer room 400 or the vegetable room 500, and the illuminating device 4 was turned off after the photographing of the camera 2 was finished by the photographing signal transmission device 5. The entire image in the refrigerator compartment 100 is processed by the loading / unloading food extraction apparatus 6, and the food image stored / shipped every time the door is opened / closed is stored in the image memory 7 a and displayed on the operation panel 1 or the user's portable terminal. In this case, the same effect can be obtained.

  In the first embodiment, the warehousing / exiting is identified, but the movement of food in the warehousing may also be identified. In this case, the difference between the entire images in the refrigerator compartment 100 at the previous opening and closing of the door is calculated, and whether the difference image matches the difference image obtained at the previous opening and closing of the previous door. Judgment is made by the matching process, and in some cases, it can be identified as “movement”.

[Embodiment 2]
The second embodiment relates to a configuration using another sensor instead of the door opening / closing detection sensor 3.

  FIG. 6 is a schematic configuration diagram (side projection) of the refrigerator compartment in the refrigerator according to Embodiment 2 of the present invention. Note that items not particularly described in the second embodiment are the same as those in the first embodiment, and the same functions and configurations are described using the same reference numerals.

  In FIG. 6, a door opening / closing angle detection sensor 9 is installed in the refrigerator door 101 instead of the door opening / closing detection sensor 3 in the configuration of the first embodiment. As the door opening / closing angle detection sensor 9, besides the direct angle measurement, the following may be used. For example, the object (a part of the refrigerator compartment door 101) is specified for the purpose of measuring the distance from the refrigerator main body with infrared rays or the like and converting it to an angle, or detecting only a specific angle. There is an infrared sensor or the like that detects passing through the position. Further, if the moving direction is detected like an acceleration sensor, not only the opening / closing angle of the refrigerator compartment door 101 but also the opening / closing direction can be detected. When an acceleration sensor is used as the door opening / closing angle detection sensor 9, the door opening / closing angle detection sensor 9 constitutes a door opening / closing angle detection means and a door opening / closing direction determination means according to the present invention.

  In addition, the camera 2 is installed on the inner surface of the refrigerator compartment door 101, and the visual field range of the camera 2 moves in the horizontal direction as the refrigerator compartment door 101 is opened and closed. The door opening / closing angle detection sensor 9 detects an angle that is easy to grasp. At this time, the installation position of the camera 2 is preferably as close as possible to the rotation axis of the refrigerator compartment door 101. The closer to the rotation axis, the smaller the radius of the rotation trajectory, and the rotation angle at which the camera 2 captures the inside of the refrigerator compartment 100 in the visual field range when the refrigerator door 101 is opened and closed increases.

  The photographing signal transmission device 5 mounted on the control board 1001 installed on the back surface of the refrigerator 1000 is connected to the camera 2 and the door opening / closing angle detection sensor 9. The photographing signal transmission device 5 transmits a photographing instruction to the camera 2 when the door opening / closing angle detection sensor 9 detects that the opening / closing angle of the refrigerator compartment door 101 has reached a predetermined value.

  Next, an example of the operation will be described with reference to FIG. Regarding the operation, the description of the same parts as those in Embodiment 1 is omitted.

  In FIG. 6, when the door opening / closing angle detection sensor 9 detects that the opening / closing angle of the refrigerator compartment door 101 is set to a predetermined angle that makes it easy to grasp the situation inside the refrigerator compartment 100, The signal transmission device 5 instructs the camera 2 to perform shooting. Thereafter, as in the first embodiment, in the storage / extraction food extraction apparatus 6, the food image stored / extracted is extracted from the entire image in the refrigerator compartment 100 taken every time the door is opened / closed, and the food image and the image are attached to the image. The photographing time and entry / exit identification information are transferred from the entry / exit food extraction device 6 to the image memory 7a and stored. Stored food images and information accompanying the images are stored in the timeline format or list format shown in FIG. 4 on the operation panel 1 or the user's portable terminal via the wireless communication device 8 according to the user's request. The food image or the inventory food image list shown in FIG. 5 is displayed.

  In the first embodiment, when the door opening / closing detection sensor 3 detects that the refrigerator compartment door 101 is closed, the illumination device 4 is turned off after the camera 2 takes a picture. On the other hand, in this Embodiment 2, the camera 2 is image | photographed in the middle of the door opening / closing in which the refrigerator compartment door 101 turns into a specific angle by the door opening / closing angle detection sensor 9. In general, the lighting device 4 is lit when the refrigerator door 101 is open. For this reason, in the configuration of FIG. 6, it is possible to take a picture in a situation where sufficient illuminance is ensured without controlling the photographing of the camera 2 and the timing of turning off the lighting device 4 by the photographing signal transmission device 5. .

  In addition, when the opening / closing angle of the refrigerator compartment door 101 is detected by the door opening / closing angle detection sensor 9 and shooting is performed by the camera 2 at a specific angle, shooting is performed twice during the opening operation and during the closing operation for one door opening / closing. Therefore, when the opening / closing speed is high, a deviation may occur between the opening operation position and the closing operation position. Therefore, it is desirable to detect the moving direction as the door opening / closing angle detection sensor 9 and to identify the opening / closing direction like an acceleration sensor. Differentiating the opening operation and the closing operation, with respect to the entire image in the refrigerator compartment 100 at the time of either one of the operations, the food extraction device 6 performs the difference and extracts the food image, thereby shifting the photographing position. And the effect of improving the accuracy of food image extraction is obtained.

[Embodiment 3]
In the third embodiment, the amount stored in the warehouse is estimated, and the estimation result is notified to the user.

FIG. 7 is a schematic configuration diagram (side projection) of the refrigerator compartment in the refrigerator according to Embodiment 3 of the present invention. Note that items that are not particularly described in the third embodiment are the same as those in the first or second embodiment, and the same functions and configurations are described using the same reference numerals.
7, in addition to the configuration of the first embodiment, the storage amount estimation device 10 is mounted on the control board 1001 installed on the back surface of the refrigerator 1000. The storage amount estimation device 10 receives an input from the image memory 7a and transmits the storage amount estimation result in the refrigerator compartment 100 to the user's portable terminal via the operation panel 1 and the wireless communication device 8. Yes.

  Next, an example of the operation will be described with reference to FIG. Regarding the operation, the description of the same parts as those in the first embodiment or the second embodiment is omitted.

  Similar to the first embodiment, the entire image in the refrigerator compartment 100 is taken every time the refrigerator door 101 is opened / closed according to the instruction of the imaging signal transmission device 5, and the entire inside of the refrigerator compartment 100 is stored in the storage / extraction food extraction device 6. The food image that has been moved in and out is extracted from the image. Then, the extracted food image and the photographing time and the entry / exit identification information accompanying the image are transferred from the entry / exit food extraction device 6 to the image memory 7a and stored. Stored food images and information accompanying the images are stored in the timeline format or list format shown in FIG. 4 on the operation panel 1 or the user's portable terminal via the wireless communication device 8 according to the user's request. The food image or the inventory food image list shown in FIG. 5 is displayed.

  In the third embodiment, in FIG. 7, the storage amount estimation device 10 in the refrigerator compartment 100 uses the food image stored in the image memory 7 a and the shooting time and the entry / exit identification information associated with the image. Estimate the amount of storage. The storage amount estimation device 10 can transmit and display the storage amount estimation result in the refrigerator compartment 100 to the user's portable terminal via the operation panel 1 or the wireless communication device 8. .

  FIG. 8 is a diagram showing an example of a storage amount estimation result and a stock food image display method in the portable terminal in the refrigerator compartment according to Embodiment 3 of the present invention. The display of FIG. 8 displays the storage amount estimation result superimposed on the inventory food image list shown in FIG. (A) is the display result when the storage amount is large (storage rate: about 90%), (b) is the display result when the storage amount is small (storage rate: about 60%), and the left side scrolls the screen to the top. The right side is when the screen is scrolled to the bottom.

  As shown in the inventory list of FIG. 8, the food image for each door opening / closing, which is extracted in the food extraction / removal device 6 and stored in the image memory 7a, and the shooting time and storage associated with the image are stored. By calculating the number of food images that are estimated to be in stock at a certain time from the identification information, it is possible to estimate the volume occupancy rate, that is, the storage amount by the approximate storage item. For example, the inside of the refrigerator compartment 100 is divided in advance into areas that assume the size of an average stored item, and the storage amount is estimated from the number of food images in the total number of regions. In the example of FIG. 8, the inside of the refrigerator compartment 100 is divided into 24 areas. That is, when there is no stored item, 24 color images are obtained, whereas 22 stock food images are obtained. In the case of (a), 22/24 = 92% ≈90%, and in the case of (b) where 14 stock food images are obtained, 14/24 = 58% ≈60%. The storage amount is estimated in the amount estimation device 10.

  Then, as shown in FIG. 8, the storage amount estimation result is transmitted from the storage amount estimation device 10 to the user's portable terminal via the wireless communication device 8 together with the inventory food image list. Thereby, for example, the remaining storage capacity can be grasped during shopping at a remote place, so that it is possible to prevent an unnecessary shopping that cannot be stored.

  In FIG. 7, as in the first embodiment, when the door opening / closing detection sensor 3 detects that the refrigerator compartment door 101 is closed, the entire image inside the refrigerator compartment 100 taken by the camera 2 is used. Entry / exit food images are extracted. However, as in the second embodiment, when the door opening / closing angle detection sensor 9 detects that the opening / closing angle of the refrigerator compartment door 101 is the angle at which the situation in the refrigerator compartment 100 is most easily grasped, You may use the whole image which the camera 2 image | photographed. A stock quantity image is estimated from a food image for each door opening / closing and image-accompanying information (photographing time, warehousing / departure identification information) extracted by the entering / exiting food extraction device 6 and stored in the image memory 7a. 10, the same effect can be obtained by estimating the storage amount.

[Embodiment 4]
In the fourth embodiment, the cooling load in the storage is estimated based on the storage amount in the storage and the air temperature in the storage, and the estimation result is notified to the user.

FIG. 9 is a schematic configuration diagram (side projection) of the refrigerator compartment in the refrigerator according to Embodiment 4 of the present invention. Items that are not particularly described in the fourth embodiment are the same as those in the first to third embodiments, and the same functions and configurations are described using the same reference numerals.
In FIG. 9, in the fourth embodiment, in addition to the configuration of the third embodiment, an internal temperature sensor 11 that detects the air temperature in the refrigerator compartment 100 is installed on the back wall of the refrigerator compartment 100. In addition, a cooling load estimation device 12 is mounted on the control board 1001 installed on the rear surface of the refrigerator 1000, receives inputs from the storage amount estimation device 10 and the internal temperature sensor 11, and receives the operation panel 1 and the wireless communication device. The cooling load estimation result in the refrigerating room 100 is transmitted to the user's portable terminal via 8.

  Next, an example of the operation will be described with reference to FIG. Regarding the operation, the same parts as in the first to third embodiments will not be described.

  Similar to the first embodiment, the entire image in the refrigerator compartment 100 is taken every time the refrigerator door 101 is opened / closed according to the instruction of the imaging signal transmission device 5, and the entire inside of the refrigerator compartment 100 is stored in the storage / extraction food extraction device 6. The food image that has been moved in and out is extracted from the image. Then, the extracted food image and the photographing time and the entry / exit identification information accompanying the image are transferred from the entry / exit food extraction device 6 to the image memory 7a and stored.

  Similarly to the third embodiment, the storage amount estimation apparatus 10 estimates the storage amount in the refrigerator compartment 100 using the stock food image stored in the image memory 7a. Furthermore, in this Embodiment 4, in FIG. 9, the storage amount estimation result in the refrigerator compartment 100 by the storage amount estimation apparatus 10 and the air temperature detection result in the refrigerator compartment 100 by the internal temperature sensor 11 are used. The cooling load estimation device 12 estimates the cooling load in the refrigerator compartment 100. The cooling load estimation result in the refrigerator compartment 100 estimated by the cooling load estimation device 12 is transmitted from the cooling load estimation device 12 to the user's portable terminal via the operation panel 1 or the wireless communication device 8 and displayed. be able to.

  Here, when food is stored in the refrigerator 1000, in order to maintain the quality of the food, it is necessary to cool the food at a temperature suitable for the cooling load of the food. In general, the cooling load is proportional to the storage amount, but this is not always the case. For example, even if the storage amount is small, the cooling load increases when the heat load of the stored item is large. On the other hand, if the storage temperature is low and the temperature is stable even if the storage amount is large, the cooling load will be small.In this case, there is no need to reduce the storage amount. In addition, food may freeze and deteriorate in quality. Therefore, in order to estimate the cooling load, it is desirable to reflect not only the amount of food stored but also the temperature of the air in the cabinet.

  Therefore, in the fourth embodiment, as shown in FIG. 9, the air temperature detection result by the internal temperature sensor 11 is reflected in the storage amount estimation result by the storage amount estimation device 10, and the cooling load estimation device 12 stores the storage amount. The cooling load in the refrigerating room 100 is estimated in consideration of both the amount and the air temperature in the refrigerator.

  FIGS. 10-12 is a figure which shows an example of the actual measurement data which show the temperature history in the refrigerator compartment of the refrigerator which concerns on Embodiment 4 of this invention. FIG. 10 shows a storage volume occupancy ratio of 0%, FIG. 11 shows a storage volume occupancy ratio of 40%, and FIG. 12 shows a storage volume occupancy ratio of 70%. First, the refrigerator compartment door is fully opened for 1 minute and then operated for 24 hours. It is the measured value of the temperature of each position in a warehouse, and power consumption. 10A to 12B, (a) is the main temperature and power consumption in the refrigerator compartment 100, (b) is the shelf temperature in the refrigerator compartment 100, and (c) is the actual measurement of the door shelf temperature in the refrigerator compartment 100. It is a result.

  (A) includes an average temperature 13 on the ceiling surface of the refrigerator compartment, an average temperature 14 on the rear surface of the refrigerator compartment, an average temperature 15 of the cooling air supplied from the outlet installed on the rear surface of the refrigerator compartment 100, and the entire refrigerator 1000. The power consumption 16 is shown. (B) shows the mass temperature 17 of each shelf in the refrigerator compartment 100 divided into four stages by the refrigerator compartment shelf plate 102. More specifically, the refrigerator compartment shelf uppermost mass temperature 17a, the refrigerator compartment shelf is shown. The second stage mass temperature 17b, the refrigerator compartment shelf third stage mass temperature 17c, and the refrigerator compartment shelf lowest stage mass temperature 17d are shown. (C) shows the mass temperature 18 of each door shelf (not shown) in the refrigerator compartment 100 installed on the back surface of the refrigerator compartment door 101 by three steps, and more specifically, the upper compartment of the refrigerator compartment door shelf. The mass temperature 18a, the refrigerator compartment door shelf middle mass temperature 18b, and the refrigerator compartment door shelf lower mass temperature 18c are shown. The stored items are simulated with instant noodles in bags, and the measurement position of the mass temperature 17 of each shelf in the refrigerator compartment 100 shown in (b) is on the back side of the stored items. The mass temperature is an air temperature considering the heat capacity of the space, and is actually the temperature of the brass cylinder with respect to the size of the space.

  10 to 12, in the internal temperature history of (a) to (c), the higher the storage volume occupancy, the lower the mass temperature 17 of the refrigerator compartment shelf that is arranged on the back side from the stored items. It is shown that Moreover, it is shown that the mass temperature 18 of the refrigerator compartment door shelf arrange | positioned at the door side from the stored item is so high that a storage volume occupation rate is high. That is, it is shown that the supply of the cooling air to the refrigerator compartment door 101 side is hindered by the stored items.

  In particular, when the storage volume occupancy ratio in FIG. 12 is 70%, the shelf temperature below the inside of the refrigerator compartment 100, the third compartment temperature 17c in the refrigerator compartment shelf, and the lowest compartment temperature 17d in the refrigerator compartment shelf are 0 ° C. or less. It has dropped to. On the other hand, the upper shelf temperature 18a of the refrigerator compartment door shelf, which is the upper shelf temperature in the refrigerator compartment 100, is maintained at 13 to 14 ° C., which is a temperature environment that is outside the refrigerator temperature zone and promotes the deterioration of food. It has been shown that

  10A to 12B, the fact that the total power consumption 16 is reduced to 0 indicates that the compressor of the refrigerant circuit for cooling the refrigerator 1000 is turned off. During the OFF state, only the air transfer device is driven. Storage capacity occupancy rate: 0 to 70%, the maximum value of total power consumption 16 is maintained at about 50 W, but the higher the storage capacity occupancy ratio, the less the number of times the compressor is turned off. As shown, it is increasing.

  Since the storage amount in the refrigerator 1000 and the internal temperature have the relationship as described above, the cooling load estimation device 12 further includes the internal temperature sensor 11 in addition to the storage amount estimation result by the storage amount estimation device 10. The cooling load in the refrigerator compartment 100 is estimated using the air temperature detection result.

  And the cooling load estimation apparatus 12 transmits and displays the internal cooling load estimation result in the refrigerator compartment 100 to the operation panel 1 or the portable terminal (user terminal) via the wireless communication apparatus 8. In addition to the internal cooling load estimation result, the storage amount estimation result may also be transmitted and displayed.

  Therefore, even if there is room for storage capacity, information that the storage quality of food will be reduced if stored more than this, and information that there is no problem even if the set temperature is raised because the cooling load in the cabinet is small, etc. Can be disclosed.

  In this way, the user can be notified of the amount of storage in the storage and the result of estimation of the cooling load in the storage, so that the best storage and cooling method, energy saving behavior, etc. can be educated while maintaining the preservation quality of food. The effect that it can be obtained.

  Here, in FIG. 9, the internal temperature sensor 11 is installed on the back wall of the third-stage refrigerator compartment shelf 102, but the installation position is not limited to this location. That is, the installation position of the internal temperature sensor 11 may be the back wall of another refrigerator compartment shelf 102 or the refrigerator compartment door 101 side as long as the air temperature in the refrigerator compartment 100 can be represented. In particular, as shown in FIGS. 10 to 12, if the internal temperature sensor 11 is installed in the vicinity of the measurement position of the refrigeration room door shelf upper stage mass temperature 18a where the temperature rises most remarkably due to an increase in the storage amount, the quality can be deteriorated. It is possible to quickly detect the sex and alert the user.

[Embodiment 5]
In the fifth embodiment, the estimation result of the cooling load in the cabinet is fed back to the cooling control of the refrigerator 1000.

FIG. 13: is a schematic block diagram (side projection drawing) of the refrigerator which concerns on Embodiment 5 of this invention. Items that are not particularly described in the fifth embodiment are the same as those in the first to fourth embodiments, and the same functions and configurations are described using the same reference numerals.
In FIG. 13, the refrigerator 1000 includes a refrigeration cycle circuit that cools air supplied to each storage room, and an air passage for supplying air cooled by the refrigeration cycle circuit to each storage room.

  The refrigeration cycle circuit includes a compressor 1002, a condenser (not shown) that condenses the refrigerant discharged from the compressor 1002, a throttle device (not shown) that expands the refrigerant flowing out of the condenser, and a throttle device. The cooler 1003 etc. which cools the air supplied to each store room with the expanded refrigerant | coolant are comprised. The compressor 1002 is arrange | positioned at the lower part of the back side of the refrigerator 1000, for example. The cooler 1003 is provided in a cooling air passage 1010 described later. The cooling air passage 1010 is also provided with an air conveyance device 1004 for sending air cooled by the cooler 1003 to each storage room (in other words, for circulating air in the refrigerator 1000).

  The air path for supplying the air cooled by the refrigeration cycle circuit to each storage room is composed of a cooling air path 1010, a return air path 1020, a refrigeration room return air path 103, a vegetable room return air path 501 and the like. ing. The cooling air path 1010 is formed in the back surface part of the refrigerator 1000, for example, and is a ventilation path through which the air cooled by the cooler 1003 is conveyed to each storage room. The amount of cooling air flowing into each storage room is adjusted by a damper (only the refrigerating room damper 104 for the refrigerating room is shown in FIG. 13) installed in the cooling air passage 1010. The return air passage 1020 is a ventilation passage through which air that has cooled each chamber is conveyed to the cooler 1003. The refrigerator compartment return air passage 103 is an air passage through which the air that has cooled the refrigerator compartment 100 and the chilled chamber 110 is conveyed to the vegetable compartment 500. The air that has cooled the refrigerator compartment 100 and the chilled chamber 110 is mixed with the air that has cooled the vegetable compartment 500 in the vegetable compartment return air passage 501, and is conveyed to the cooler 1003.

  In FIG. 13, in addition to the configuration of the fourth embodiment, a cooling control device 19 is further mounted on the control board 1001 installed on the back surface of the refrigerator 1000. The cooling control device 19 is connected to the compressor 1002, the air conveyance device 1004, the refrigerator compartment damper 104 and other storage room dampers (not shown), and controls these devices. The cooling control device 19 receives an input from the cooling load estimation device 12, and controls at least one of the compressor 1002, the air conveyance device 1004, the cold room damper 104 and other storage room dampers (not shown). A signal is transmitted to control the cooling of the storage room (change the cooling capacity). In addition, the cooling control device 19 sends a cooling load estimation result in the storage, contents of control to each device, a set temperature of each storage room, etc. to the user's portable terminal via the operation panel 1 and the wireless communication device 8. Is configured to transmit. The refrigerating room damper 104 and other dampers (not shown) of the storage room constitute the blown air volume control device according to the present invention.

  Next, an example of the operation will be described with reference to FIG. Regarding the operation, the same parts as in the first to fourth embodiments will not be described.

  Similar to the first embodiment, the entire image in the refrigerator compartment 100 is taken every time the refrigerator door 101 is opened / closed according to the instruction of the imaging signal transmission device 5, and the entire inside of the refrigerator compartment 100 is stored in the storage / extraction food extraction device 6. The food image that has been moved in and out is extracted from the image. Then, the extracted food image and the photographing time and the entry / exit identification information accompanying the image are transferred from the entry / exit food extraction device 6 to the image memory 7a and stored.

  As in the third embodiment, the storage amount estimation device 10 estimates the storage amount in the refrigerator compartment 100 using the stock food image stored in the image memory 7a. The cooling load estimation device 12 estimates the cooling load in the refrigerator compartment 100 using the stored amount estimation result and the air temperature detection result in the refrigerator compartment 100 by the internal temperature sensor 11.

  In the refrigerator 1000, the in-compartment air cooled by the cooler 1003 is generally transported to each storage room by the air transport device 1004 via the cooling air passage 1010. And the return air after cooling each store room becomes a circulation air path which returns to the cooler 1003 again via the return air path 1020. At this time, the air (for example, −30 ° C. to −25 ° C.) cooled by the cooler 1003 is distributed to each storage chamber by opening and closing a plurality of dampers including the refrigerator compartment damper 104. By adjusting the amount of cooling air flowing into each storage chamber by opening and closing the plurality of dampers, individual temperatures are set for each storage chamber.

  For example, the inflow damper of the freezing room 400 (for example, −22 ° C. to −16 ° C.) that is set to the lowest temperature is almost fully opened, and the inflow damper of the vegetable room 500 (for example, 3 ° C. to 9 ° C.) that is set to the highest temperature is almost all It is closed. And the vegetable room 500 is indirectly cooled with the return air which cooled the refrigerator compartment 100 (for example, 0 degreeC-6 degreeC) and the chilled room 110 (for example, 0 degreeC-2 degreeC) lower in temperature setting than the vegetable room 500, etc., The temperature in the storage room is adjusted.

  Here, in response to overcooling or undercooling, the temperature setting of each storage room can be adjusted to about ± 2 to 3 ° C., for example, the freezer room 400 has a temperature of about −25 ° C. to −13 ° C. 100 can be changed in the range of about −2 ° C. to 9 ° C.

  When a specific storage room is set to a low temperature due to insufficient cooling, for example, when only the refrigerating room 100 is lowered, the flow of cooling air into the refrigerating room 100 is increased by increasing the opening of the refrigerating room damper 104. Increase the amount. Further, when it is necessary to lower the temperature of the plurality of storage chambers, it is necessary to increase the cooling capacity of the refrigeration cycle by increasing the number of rotations of the compressor 1002 and the amount of air transported by the air transport device 1004. Therefore, when the temperature of the plurality of storage rooms is lowered, the power consumption of the refrigerator 1000 increases. On the other hand, when the temperature of the storage chamber is increased due to excessive cooling, the opening of the damper is reduced with respect to a specific storage chamber to reduce the inflow of cooling air. Further, when the temperature of the plurality of storage chambers is increased, the number of rotations of the compressor 1002 and the amount of air transported by the air transport device 1004 may be decreased, and the power consumption of the refrigerator 1000 is decreased.

  The power consumption of the refrigerator 1000 is smaller than that of other home appliances such as room air conditioners and IH cooking heaters, but cooling cannot be stopped (power off) because food is managed. For this reason, in order to implement power-saving operation, it is necessary to raise the preset temperature of each storage room according to the preservation | save state of foodstuffs, or a cooling load. For example, when the amount of food stored in the storage room is small, or when the amount of food stored is large and stable at low temperatures, the cooling capacity will be excessive, so even if the set temperature is raised, the food storage quality It becomes possible to carry out power saving operation without impairing the power consumption.

  Therefore, in the fifth embodiment, the cooling control device 19 controls the compressor 1002 and the air conveyance device 1004 according to the cooling load, using the cooling load estimation result in the warehouse by the cooling load estimation device 12 as an input. For example, when the cooling load in the storage chamber is small and the cooling capacity is sufficient, the cooling control device 19 transmits a signal for reducing the rotational speed of the compressor 1002 and the amount of air flow conveyed by the air conveying device 1004. Thereby, it becomes possible to reduce a power consumption level, maintaining the preservation | save quality of a foodstuff. That is, it is possible to automatically carry out an optimal cooling operation without excess or deficiency in maintaining the preservation quality of food.

  Moreover, the cooling control apparatus 19 performs the following control, when the cooling load only of a specific storage chamber increases rapidly. Specifically, for example, when the door of the refrigerator compartment 100 is frequently opened and closed during breakfast or dinner and the cooling load of the refrigerator compartment 100 increases, the cooling control device 19 gives a signal that the cooling load of the refrigerator compartment 100 has increased rapidly. It is received from the cooling load estimation device 12. In this case, the cooling control device 19 increases the open ratio of the refrigerator compartment damper 104 and sends a signal to the compressor 1002 and the air conveyance device 1004 to reduce the number of rotations of the compressor 1002 and the amount of air flow conveyed by the air conveyance device 1004. Control to send. Thereby, cooling air can be made to flow intensively into the refrigerator compartment 100 where the cooling load has increased, and cooling can be performed, and the power consumption level of the refrigerator 1000 as a whole can be reduced.

[Embodiment 6]
The sixth embodiment relates to a home system 2000 that is a network system including a refrigerator 1000.

  FIG. 14 is a schematic configuration diagram of a home system in which a refrigerator according to Embodiment 6 of the present invention is placed. Note that items not particularly described in the sixth embodiment are the same as those in the first to fifth embodiments, and the same functions and configurations are described using the same reference numerals.

  A home system 2000 illustrated in FIG. 14 includes home appliances such as a room air conditioner, a water heater, an IH cooking heater, and a lighting device, including a refrigerator 1000, a power measuring device 2002, and a home controller 2004. The refrigerator 1000 further includes a communication function with the in-home controller 2004 in addition to the configuration of the refrigerator 1000 of any one of the first to fifth embodiments. Each household electrical appliance and the power measuring device 2002 are connected to the system power supply 2001 by a power line and are supplied with power.

  The power measurement device 2002 can measure the power (power consumption) supplied to each home appliance and the total power supplied from the system power supply 2001 using, for example, a power measurement terminal 2003 such as CT, and can store a history. .

  In addition, each home electric appliance and the power measuring device 2002 are internally or externally connected with a wireless communication device 8 for bidirectional communication with the in-home controller 2004. As the wireless communication device 8, a communication module such as Wi-Fi or Bluetooth (registered trademark) is assumed, but each home appliance and the home controller 2004 are placed in the same home. You may connect by wire using.

  The in-home controller 2004 manages the power consumption of each home appliance, the power supplied to the system power supply 2001 obtained from the power measuring device 2002, and the information on the operating state and the surrounding environment obtained from each home appliance, Thus, the control change instruction can be transmitted.

  Next, an example of the operation will be described with reference to FIG. Regarding the operation, the same parts as those in the first to fifth embodiments will not be described.

  In FIG. 14, each household electrical appliance such as a refrigerator 1000, a room air conditioner, a water heater, an IH cooking heater, and a lighting device is supplied with power from the system power supply 2001 and operates. In addition, each home appliance transmits information on the driving state and the surrounding environment to the home controller 2004 via the wireless communication device 8 continuously or when requested. For example, in the refrigerator 1000, the operation state information includes set temperatures and actual temperature history of each storage room, operation modes such as presence / absence of ice making operation and rapid cooling operation, and alerts such as an empty water tank and an open door state. There is information. As information on the surrounding environment, for example, in a room air conditioner, there is information such as indoor air temperature and air humidity detected from the intake air, and in an illumination device, there is information such as indoor illuminance. The in-home controller 2004 manages the received operation state information and ambient environment information.

  The power measurement device 2002 calculates the power consumption of each home appliance and the power supplied to the system power supply 2001 supplied to each home appliance by the power measurement terminal 2003, and sends power information to the home controller 2004 via the wireless communication device 8. Send.

  The in-home controller 2004 applies the power consumption of each home appliance obtained from the power measuring device 2002, the power supplied to the system power supply 2001, and the information on the operating state and the surrounding environment obtained from each home appliance to each home appliance. Control change instruction. For example, when the total power consumption of each home appliance is close to the supply capacity of the system power supply 2001, the following control is performed in order to suppress power consumption in the home. That is, the in-home controller 2004 transmits a power saving instruction to a household electric appliance that consumes particularly large power, or determines whether the refrigerator 1000 is overcooled from the set temperature of the storage room and the actual temperature history, When it is determined that the cooling is excessive, an instruction to increase the set temperature is given.

  Furthermore, in the refrigerator 1000, as described in the fifth embodiment, the cooling control device 19 controls the compressor 1002 and the air conveyance device 1004 in accordance with the cooling load in the warehouse estimated by the cooling load estimation device 12. doing. In the cooling control of the refrigerator 1000, generally, basic control such as the operation rate of the compressor is determined by the air temperature outside the refrigerator before cooling with the set temperature of each storage room in the refrigerator as a target. In other words, if the outside of the refrigerator is low, operate a freezing prevention heater instead of suppressing the operation of the compressor. Conversely, if the outside of the refrigerator is high, increase the operation rate of the compressor and the frequency of defrost operation. Control is performed to optimize the system so that it can be cooled without problems. Therefore, the basic control is determined by the outside air temperature, and the cooling load (environmental load) outside the chamber is estimated in consideration of solar radiation and lighting, and the estimation result (outside cooling load estimation result) is calculated by the compressor. If reflected in operation control, it can be expected that the useless operation can be suppressed and the energy can be saved.

  Therefore, in the sixth embodiment, the cooling load estimation device 12 can obtain, for example, indoor air temperature / humidity information from a room air conditioner and indoor illuminance information from a lighting device via the home controller 2004. It has become. And using air temperature humidity information and illuminance information, for example, even if the outside air temperature is low, it is estimated that if the solar radiation is strong, the outside cooling load is high and the cooling capacity needs to be maintained. Yes. Or, even if the air temperature outside the warehouse is high at night, if the lighting is turned on at that time, the air temperature outside the warehouse is due to lighting, because it is nighttime, The outside cooling load is estimated to be low, and it can be determined that the cooling capacity need not be so high.

  By performing such estimation of the outside cooling load and determination of the cooling capacity based on the estimation result, it becomes possible to automatically carry out a cooling operation without excess or deficiency in maintaining the preservation quality of food. . That is, it is possible to perform an optimal cooling operation that suppresses a useless operation and to save energy. The cooling load estimation device 12 constitutes the cooling load estimation means and the external cooling load estimation means of the present invention.

  Further, since the refrigerator 1000 can obtain indoor air humidity information via the home controller 2004, the humidity information can be reflected in the operation of the refrigerator 1000. For example, the latent heat load can be taken into account when estimating the external cooling load as described above. That is, in the case of low humidity, the possibility of frosting by opening and closing the door is reduced, so the number of defrosting operations, which is the operation with the largest power consumption, is reduced, or the time interval for performing the defrosting operation is extended. In addition, the power consumption can be greatly reduced.

[Embodiment 7]
The seventh embodiment relates to a configuration in which the home system 2000 according to the sixth embodiment can obtain information from the outside system 3000.

  FIG. 15 is a schematic configuration diagram of an in-home system and an out-of-home system on which the refrigerator according to Embodiment 7 of the present invention is placed. Note that items not particularly described in the seventh embodiment are the same as those in the first to sixth embodiments, and the same functions and configurations are described using the same reference numerals.

  In FIG. 15, a broadband router 2005 is installed in the home system 2000 shown in the sixth embodiment, and the home controller 2004 is connected to the Internet 3001 that is a network of the outside system 3000 via the broadband router 2005. Yes. Furthermore, the Internet 3001 is connected to a cloud server 3002 that is an external server that stores environmental information such as various power information and weather forecasts, and a mobile terminal 3003 of a user such as a smartphone or a mobile tablet. Therefore, the in-home controller 2004 obtains power information and environmental information from the cloud server 3002, while obtaining power consumption of each home appliance and power supplied from the system power supply 2001 obtained from the power measuring device 2002 and each home appliance. Information (operation state information and ambient environment information) can be transmitted to the user's portable terminal 3003. Note that the user terminal connected to the Internet 3001 is not limited to the portable terminal 3003 but may be a desktop PC.

  Next, an example of the operation will be described with reference to FIG. Regarding the operation, the same parts as those in the first to sixth embodiments will not be described.

  In FIG. 15, the in-home controller 2004 obtains the power consumption of each home appliance and the power supplied from the system power supply 2001 from the power measurement device 2002 in the home system 2000 as described in the sixth embodiment. Get information on driving conditions and surrounding environment. Further, in the seventh embodiment, since the home controller 2004 is connected to the Internet 3001 via the broadband router 2005, it is possible to obtain various power information and environmental information from the cloud server 3002. For example, as power information, the supply and demand situation of power related to the area where the home system 2000 is installed is obtained, and when the power consumption in the area is close to the power that can be supplied, The following control can be performed. That is, a power-saving instruction is transmitted to a household electric appliance that consumes particularly large power, or the refrigerator 1000 is determined as being overcooled by determining whether it is overcooled from the set temperature of the storage room and the actual temperature history. In the case of a failure, it is possible to instruct an increase in the set temperature.

  Furthermore, in the refrigerator 1000, as described in the fifth embodiment, the cooling control device 19 controls the compressor 1002 and the air conveyance device 1004 in accordance with the cooling load in the warehouse estimated by the cooling load estimation device 12. doing. Moreover, in this Embodiment 7, it is a cooling load of the environment where the refrigerator 1000 was installed by obtaining at least one of temperature / humidity information and illuminance information via the in-home controller 2004 as in Embodiment 6. The external cooling load is estimated and reflected in the cooling control. In the seventh embodiment, the cooling control device 19 further obtains weather forecast information about the area where the in-home system 2000 is placed as, for example, environment information from the cloud server 3002 and cools based on the environment information. The fluctuation of the load (environmental load) can be predicted and reflected in the cooling control. Therefore, in the refrigerator 1000 according to the seventh embodiment, since the cooling control device 19 can instruct the control corresponding to the cooling load in advance, it is possible to cope with an abrupt environmental change and to always maintain the storage quality of food. Is obtained.

  In addition, although each Embodiment 1-7 demonstrated as each another embodiment, you may comprise a refrigerator combining suitably the characteristic structure of each embodiment, a process, etc., respectively.

  DESCRIPTION OF SYMBOLS 1 Operation panel, 2 Cameras (imaging means), 3 Door opening / closing detection sensor (door opening / closing angle detection means, door opening / closing direction discrimination means), 4 Illumination device, 5 Shooting signal transmission device, 6 Entry / exit food extraction device, 7 Display control Device, 7a Image memory (image storage means), 8 Wireless communication device (communication means), 9 Door opening / closing angle detection sensor, 10 Storage amount estimation device, 11 Internal temperature sensor, 12 Cooling load estimation device, 13 Cold room ceiling surface Average temperature, 14 refrigerator compartment back average temperature, 15 refrigerator compartment blowout average temperature, 16 total power consumption, 17a refrigerator compartment shelf top stage mass temperature, 17b refrigerator compartment shelf second stage mass temperature, 17c refrigerator compartment shelf third stage mass temperature 17d Refrigerating room shelf bottom mass temperature, 18a Refrigerating room door shelf upper mass temperature, 18b Refrigerating room door shelf middle mass temperature, 18c Refrigerating room door shelf lower mass temperature, 19 Cooling control device, 00 Refrigerated room, 101 Refrigerated room door, 102 Refrigerated room shelf, 103 Refrigerated room return air passage, 104 Refrigerated room damper (air blowing control device), 110 chilled room, 111 chilled case, 200 ice making room, 300 switching room, 400 Freezer room, 500 vegetable room, 501 vegetable room return air path, 1000 refrigerator, 1001 control board, 1002 compressor, 1003 cooler, 1004 air conveying device, 1010 cooling air path, 1020 return air path, 2000 residential system, 2001 system Power source, 2002 power measuring device, 2003 power measuring terminal, 2004 home controller, 2005 broadband router, 3000 outside system, 3001 Internet, 3002 cloud server (external server), 3003 mobile terminal.

Claims (15)

A storage room;
A door for opening and closing the opening of the storage room;
Photographing means for photographing the storage chamber;
Entry / exit storage item extraction means for extracting images of storage items that have been stored and exited based on storage room images before and after opening and closing of the door, taken by the imaging means;
Image storage means for storing the stored item image extracted by the incoming / outgoing stored item extracting means together with incoming / outgoing identification information indicating whether it is incoming or outgoing, and time information when the door opening / closing operation is performed. and,
A display control device for causing the display means to output a display screen capable of confirming the stock in the storage room based on the stored data in the image storage means,
The refrigerator is characterized in that the display screen is a screen in which the stored item images are displayed in a time-series list divided into warehousing and delivery . The display screen, refrigerator according to claim 1, wherein the stored item image is characterized in that the screen is a timeline displayed together with the time information and the entering goods issue identification information. The refrigerator according to claim 1 or 2 , wherein the display screen is a screen showing a list of the stored images of stored items currently stored in the storage room. The display means, a refrigerator according to any one of claims 1 to 3, characterized in that the a display section arranged on the outer surface of the door. The display means, a refrigerator according to any one of claims 1 to 3, characterized in that the display unit of the user terminal capable of communicating with the refrigerator. The entry / exit stored item extraction means stores therein the storage room images before and after opening and closing the door, extracts the stored item image using the stored storage room image, and stores the stored item image. After extraction, only the latest storage room image is stored, and the rest are deleted.
The refrigerator as described in any one of Claims 1-5 characterized by the above-mentioned. Door opening and closing detection means for detecting opening and closing of the door;
Illuminated when the door open / close detection means detects the open state of the door, the door open / close detection means detects the closed state of the door, and the imaging means turns off after the storage room is photographed With means,
The refrigerator as described in any one of Claims 1-6 characterized by the above-mentioned. A door opening / closing angle detecting means for detecting the opening / closing angle of the door;
When the predetermined opening angle is detected by the door opening / closing angle detection means, the storage room is imaged by the imaging means;
The refrigerator as described in any one of Claims 1-6 characterized by the above-mentioned. A door opening / closing direction determining means for determining an opening operation or a closing operation of the door;
When the door opening / closing angle detection means detects a predetermined angle set in advance, the storage by the photographing means is performed only when either the opening operation or the closing operation is determined by the door opening / closing direction determination means. Shooting indoors,
The refrigerator according to claim 8 . A storage amount estimating means for estimating a current storage amount in the storage chamber based on the stored image stored in the image storage means and estimated to be currently stored in the storage chamber;
The refrigerator according to any one of claims 1 to 9, characterized in that. An internal temperature detecting means for detecting the air temperature in the storage chamber;
Cooling load estimation means for estimating a cooling load in the storage chamber based on the storage amount in the storage chamber estimated by the storage amount estimation means and the air temperature in the storage chamber detected by the internal temperature detection means. With
The refrigerator according to claim 10 . A refrigeration cycle comprising a compressor, a condenser and a cooler;
An air conveying device for conveying the cooling air cooled by the cooler to the storage chamber;
A blowout air volume control device for adjusting an inflow amount of the cooling air supplied to the storage chamber;
In accordance with the estimation result of the cooling load estimating means, a cooling control means for transmitting a control signal to at least one of the compressor, the air conveying device and the blown air volume control device, and performing cooling control of the storage chamber; With
The refrigerator according to claim 11 . Information on at least one of the illuminance around the refrigerator and the air temperature around the refrigerator is obtained from other home appliances in the home network via communication means, and the environment where the refrigerator is placed based on the obtained information An outside cooling load estimating means for estimating the outside cooling load which is the cooling load of
The cooling control unit reflects the estimation result of the external cooling load estimation unit in the cooling control;
The refrigerator according to claim 12 . The cooling control means obtains environmental information about the area where the refrigerator is placed from an external server via communication means, and reflects the environmental information in the cooling control.
The refrigerator according to claim 12 or 13 , wherein the refrigerator is characterized. A network system comprising the refrigerator according to any one of claims 1 to 14 .