DE102018211048A1 - Process for holding food in a household refrigeration device, and household refrigeration device - Google Patents

Abstract

The invention relates to a method for holding food in a household refrigeration device (1), in which a food (15, 19) is captured in a receiving space (3) of the household refrigeration device (1) with at least one image acquisition unit (11) of the household refrigeration device (1) , and depending on whether the food (15, 19) is available in sufficient quantity, at least one separate first positioning device (14) being introduced locally specifically in the receiving space (3), by means of which a locally defined position for a user is specified for a defined first food item, the first food item (15) being able to be applied to the first set-up device (14) in the receiving space (3), and the at least one image which is recorded with the image capturing unit (11) is being evaluated accordingly whether the first installation device (14) has been detected and if the first installation device (14) is recognized in the image, i he amount of the first food (15) thereon is determined. The invention also relates to a household refrigerator (1).

Description

The invention relates to a method for keeping food ready in a household refrigerator. A food is captured in a receiving space of the household refrigeration device with at least one image acquisition unit of the household refrigeration device. Depending on this, it is determined whether the food is available in sufficient quantities. Furthermore, the invention also relates to a household refrigerator.

Such is for example from the DE 11 2016 003 769 T5 known. There is also known, among other things, a cooling device with a camera with which certain foods, such as a milk carton, can be monitored. If the milk carton is only a third full, the system can take the action to order another carton of milk. The system can also learn response times and automatically adjust an event trigger.

From the DE 10 2016 209 441 A1 A method and a device for acquiring the content of a storage space of a household refrigeration device is known, the acquisition being carried out with a reading device, which can be a camera or an RFID transmitter / receiver.

A disadvantage of the known systems can be seen in the fact that the fitting of a receiving space for food can be varied and different. This can be user-dependent and can meet individual needs. As a result, the detection with a camera, which is usually located in a fixed position on the household refrigeration device, is difficult, in particular partly not possible or not sufficiently accurate.

It is an object of the present invention to provide a method and a household refrigeration device in which or with which the detection of food can be carried out more precisely.

This object is achieved by a method and a household refrigerator according to the independent claims.

One aspect of the invention relates to a method for holding food in a household refrigeration device. In the method, a food is captured in a receiving space of the household refrigeration device, if it is there, with at least one image capturing unit of the household refrigeration device. Depending on this, it is determined whether there is a sufficient amount of food in the reception room. At least one first separate set-up device is provided in the receiving space. A first food item can be placed on this separate first set-up device in the receiving space. This set-up device specifies a set-up position for the first foodstuff that is locally defined for a user. The at least one image, which is recorded with the image capture unit, is evaluated to determine whether the first set-up device was captured in an image. If this is the case and the first set-up device is recognized in the image, the amount of the first food item on it is determined. With such a procedure, it is now more precisely possible to be able to capture a specific foodstuff in an improved image, since the setting device predefines a locally predefined area in the receiving space to which this first foodstuff is to be applied, and then, depending on this, this first foodstuff to be able to recognize them in an improved manner and then to be able to determine the amount of existing first food in an improved manner.

In particular, in the method in the sequence of image processing, an intelligent search is made for this first set-up device in the image evaluation, since this essentially represents the essential trigger for the food to be determined then, in particular with regard to its quantity, to be better recognized in the recording space. The set-up device thus represents a physical component which, on the one hand, provides the user with the information that he is supposed to apply his specific foodstuffs specifically assigned to this set-up device and thus locally defined, in order to then also target the quantity located thereon through the electronic system of the household refrigeration device to be able to determine the first food and to be able to decide whether a sufficient quantity is in stock. On the other hand, a search criterion for image evaluation is specified for the electronic system with the set-up device, which is to be searched for in the image in a first step. This positioning device then also defines a limited locality and thus a restricted area in the image, in which the food on it is then already clearly recognized as being the one that is predefined for storage on this positioning device, so that it is also local in this way Image very precisely focused the amount of this food can be determined.

It is advantageously provided that the image capture unit captures an area that is larger than the document area occupied by the first set-up device and the first foodstuffs possibly placed thereon, the document area and only the area being recognized during the evaluation of the at least one image Image section with this document area in the image for the Determining the amount of first foods is taken into account. On the one hand, this enables faster and more precise recognition of the first foodstuffs to be assessed, since other image areas of the image, in which other foodstuffs or, if appropriate, also such a first foodstuff are then also placed, are not taken into account. This improves the unambiguity of the statement about the amount of the first food. In particular, the installation device predefines where the user should store his associated foodstuff in order to be able to carry out the quantity monitoring electronically. If the user then consciously places such a first food item next to the set-up device, he consciously does so and then also knows that this quantity range of the first food item, which is not placed on the set-up device, during the pictorial electronic recording and quantity evaluation of the first food item is not taken into account.

This procedure provides a diverse and variable system for equipping an at least first food item for a user, in order to then also be able to carry out the automatic electronic determination of the amount of the first food item as a function thereof. In addition, in this image evaluation, by viewing only this image section with the document area, an area with immediately adjacent other foods that were recorded in the image is hidden and, if necessary, misinterpretations can at least be significantly reduced. Focusing the evaluation on only this image section then also improves the determination accuracy and the accuracy of the information.

Preferably, when the first set-up device is recognized in the image, only the amount of the first foodstuff thereon is determined in order to be able to make a statement as to whether this first foodstuff is available in sufficient quantity in the receiving space. Other foods besides the set-up device in the receiving space, in particular also first foods that are not placed on the set-up device, are then not taken into account.

It is preferably provided that the first set-up device can be positioned variably in the location in the location and that when evaluating the image the first set-up device is recognized regardless of its position if it was recorded in the image. This is another very advantageous embodiment, since the user can also position the first set-up device variably and in a variety of ways in the receiving space. This allows user-specific positioning of this first set-up device to be carried out, for example, in order to be able to position other foods in the receiving space according to user-specific wishes. This can be the case, for example, in view of the easy access to these foods and / or the arrangement of related foods in the receiving space. Depending on the size and / or quantity, it can then result, depending on the situation, that the first set-up device is positioned at individual positions in the receiving space. However, since this is then recognized in the recording image, these variable positions can also be easily taken into account and the installation device can nevertheless be recognized in the image and the quantity of first foodstuffs applied to it can then be determined.

It can also be provided that the first set-up device must always be attached to the same position in the recording space in order to enable correct detection via the camera. In particular, this can also be provided in such a case that the separate first installation device in question is installed in a stationary manner in the receiving space.

Provision can also be made for the first set-up device to provide set-up positions and / or set-up orientations for first foods in a defined manner on this first set-up device, so that the first foods are applied to them in a defined order. Such a specification then achieves a fixed position pattern of first foods on the set-up device, so that the detection of the first foods is improved, in particular with regard to their quantity present on the first set-up device. Provision can preferably be made for the set-up positions and / or set-up orientations to be predetermined by shape-specific recesses in the first set-up device. For example, these depressions can be designed as channels, so that elongated first foods can be positioned on them in a precise manner. The counting of the first food items is then simplified since there is no undesired concealment to one another which could not be resolved during the image evaluation. The orientation of the installation can then also be predetermined by the direction of such depressions. For example, in the case of such elongated first foods, if, for example, these channel-like depressions are oriented in the depth direction of the household refrigeration device, the first foods can be applied appropriately oriented on the stand-up device and can then also be aligned and thus oriented in the same direction next to one another and / or one above the other ,

Another example of a depression that defines a set-up position and / or set-up orientation can be an angular or round trough. A bottle with a round bottom can then be placed in this, for example, or a carton, such as can be realized in a so-called tetrapak, for example, can be placed securely. Other bowls, such as a fruit bowl or the like, can then also be set up in a positionally accurate and secure position.

It is preferably provided that a second food different from the first food can be applied to a second positioning device in the receiving space that is separate from the first set-up device, by means of which a locally defined position for a second food is specified for a user. The at least one image that is recorded with the image capturing unit is evaluated as to whether the second set-up device has been captured and, if the second set-up device is recognized in the image, in particular only the amount of the second food item located thereon is determined. This is a further very advantageous embodiment, since practically at the same time both a first set-up device and a second set-up device that is separate from it and possibly located at a distance from it in the receiving space can be recorded practically simultaneously. Individual determinations can then be made with respect to the respectively assigned and appropriately positioned different foods, namely the first foods and the second foods, quantity determinations. In this way, on the one hand, a very rapid quantity determination process can take place for several different foods and this can also take place independently of one another.

It can also be provided that two different foods can be set up in a defined manner on at least one set-up device and both foods can be captured in a defined manner by the image acquisition unit.

Different foods can generally result from the fact that the containers in which they are contained differ in their shape and / or size. However, there may also be a difference in addition to or instead of the coloring and / or external labeling, for example printing or a label or the like, of a container. In this case, the sizes and / or shapes of the containers can also be the same.

For example, a container can be a beverage container.

It can then be provided that when a specific shape and / or size of a beverage container is recognized, this particular beverage is reordered, in particular from a specific manufacturer. It can also be provided that when a specific beverage container in which a beverage from a specific manufacturer is contained is recognized, another beverage from this manufacturer is reordered or another type of this beverage that is recognized is made by the manufacturer. It can also be provided that when a beverage container with a beverage from a specific manufacturer is recognized, a beverage of this type is reordered from another manufacturer.

This is particularly advantageous when the two foods are different but belong together for the preparation of a drink or a meal. For example, this can be the case if a mixed drink can be produced with these two foods, which are both liquids. In this context, it is always particularly advantageous if there is information about the amounts of both foods in order to be able to individually determine an insufficient amount of at least one of the two foods. This allows you to respond individually and as best as possible. The amount can also be individually determined for other foods, such as fruit or other ingredients such as sauce containers, cream containers or the like, and a decision can be made individually as to whether an order is required.

In particular, this information about the amount of at least one food item can be used to determine whether a notice is given to a user and / or if this food item is automatically reordered by a mechanical, in particular electronic, management system of the household refrigeration device, in particular is generated electronically or optically. This is an intelligent response to the needs of at least one user of the household refrigeration device and an appropriate action is taken as required.

It can preferably be provided that a user specifies a supplier for a food item, which can be saved, for example, by a user. In the case of automatic reordering, the specified supplier is then contacted by the electronic management system in order to carry out the reordering order. As a result, user-specific references can be taken into account by the electronic system. For example, here then very short delivery times can be used. Specific special conditions, which may be granted to a user, can also be used in this way.

In an alternative embodiment it can be provided that the electronic administration system searches for delivery times and / or prices for the food to be re-ordered via a communication network, in particular the Internet, and automatically selects a supplier depending on this. It can be provided that in such an embodiment, when the electronic management system has found a supplier, this preference is communicated to the user. It can then be provided that the supplier is only contacted, in particular to place a reorder, when the user confirms this proposal from the selected supplier. For example, this can be done by communication via an input unit, such as a portable communication terminal such as a mobile radio device or a tablet. Since a user is very likely to carry such a device, the procedure for the reordering decision can also be communicated quickly here and, if necessary, finally decided by the user. This also minimizes delays in reordering.

Preferably, a necessary reordering is generated as an indication and / or a necessary shifting of the food in question from another storage area of the household refrigeration device to the first set-up device, optionally to the first set-up device and / or to the second set-up device. Provision can be made for a first amount of food to be applied to the first set-up device and for a further amount to be placed in the storage area, but not on the first set-up device. It can be provided that this storage area cannot be captured by the image capture unit. For example, such a configuration can be provided for reasons of space. Provision can also be made for the user to deliberately place such items in order, for example, to position first foodstuffs to be consumed, for example with priority on the time of consumption, on the first set-up device and to have an appropriate identification in this regard. In addition, such a loading of the receiving space can also be deliberately provided by a user, so that if the amount of first foodstuffs on the first set-up device leads to a reorder being suggested and the user already knows that a reordering is certain It takes time, but the first foods would still be available until a reordered amount of first foods would arrive. This is particularly advantageous if a quantity threshold, from which a reordering is triggered, is set relatively low or is automatically determined by the system itself.

In an advantageous embodiment, provision can be made for the generation of an indication to check whether the amount of the food detected has fallen below a first characterization threshold value and / or a second characterization threshold value characterizing the amount of the food to be assessed. In addition or instead of this, it can be provided that a reorder is made when the quantity of the food detected has fallen below a first characterization threshold value and / or a second characterization threshold value characterizing the quantity of the food to be assessed. Characterization threshold values of this type, in particular at least two different characterization threshold values, make the assessment scenario more precise. It can be recorded more precisely what amount of food that is applied to a stand-up device, in what time it is removed and what the future need for this food is then, if applicable.

It is particularly advantageous if a notification and / or a reorder occurs only if, starting from a start, a quantity of food on a set-up device is monitored, at least below the first characterization threshold and the second characterization threshold. In this way, a withdrawal interval of the food can be traced more precisely, and thus also the determination of when, for example, a reorder should be made and in which quantity the food to be reordered should be reordered. This version is also particularly advantageous in that it increases the accuracy of the information in the case of specific foods which are more difficult, in particular in terms of their pictorial recording and quantity evaluation, and in the event of a slight fluctuation in quantity by one of the characterization threshold values, to minimize the incorrect assessment. In particular, the values of these two characterization threshold values are determined so that they deviate from one another in such a way that there is a sufficient quantity in between in order to be able to accurately image the individual quantity of foodstuff on the associated setting-up device and then to be able to accurately recognize whether the two characterization threshold values have fallen below in order to be able to determine the exact amount of food taken from it.

In particular, a further note and / or a reordering is only generated if after a first note and / or a reordering both characterization threshold values have been exceeded again and then these two characterization threshold values have been undershot again.

It is preferably provided that a flexible mat is introduced into the receiving space as the first set-up device. On the one hand, this is designed to be relatively flat, so that the assembly space above the mat is not undesirably restricted. Precisely when such an embodiment of a set-up device is installed, for example, on a shelf in the receiving space of the household refrigeration device, there is sufficient volume space above this mat to also be able to apply a larger amount of appropriate foods to be provided thereon. In addition, such a flexible mat is particularly suitable for the ambient conditions in the recording room and is robust and robust with respect to the temperatures and / or humidity values. In addition, such a mat can also be handled easily by a user, so that removal and loading with food is easy. In addition, due to its design, such a mat can also be easily recognized in the image, and therefore a simple and precise recognition can take place. Furthermore, due to the flat structure of a mat, the foodstuffs applied to it can be recognized more precisely, even if they are arranged in a stack. A front-side detection is then particularly advantageous because the food is exposed on the front.

It is preferably provided that the mat, depending on its size and / or its color, symbolizes the placement of the first food for a user, so that the user can quickly and intuitively recognize which food he is at which position in the recording room, namely when looking into the recording room on this specific set-up device, so that it can then be easily recognized by the electronic management system.

It can also be provided that, depending on the size and / or the color of this mat, the food is recognized as the first food when evaluating the image.

In an advantageous embodiment, the electronic management system stores which first food is to be applied to this first set-up device. It can thus also be made possible that when the first set-up device is recognized during the image evaluation and it is recognized that foods are applied to it, it is automatically known that these foods are first foods. In this case, an actual recognition by image evaluation that a first food item is present no longer has to be carried out. It is then assumed that these are actually the first foods.

In an advantageous embodiment it can be provided that such an assignment stored in the electronic management system can be changed individually by a user. Thus, a set-up device can be used individually for the user in such a way that, depending on its specification and storage in the electronic management system, different foods for different situations are applied and recognized on this first set-up device.

The same thing that was said in the above-mentioned explanations for the first set-up device advantageously also applies to at least one second set-up device.

It can be provided that the set-up device, in particular if it is designed as a mat, is designed on the underside and / or on the top with a non-slip surface. In this way, undesired slipping of the entire installation device in the receiving space can be prevented in an improved manner. Likewise, the undesired slipping of food items placed on the stand-up device can be avoided in an improved manner.

Another aspect of the invention relates to a household refrigerator with a housing in which at least one receiving space for food is formed. The household refrigeration device has at least one acquisition unit, in particular an image acquisition unit for, in particular pictorial, acquisition of at least a portion of the receiving space. The household refrigerator also has at least one set-up device for a food. In addition, the household refrigerator has an electronic management system. The household refrigeration device is preferably designed to carry out a method according to the above-mentioned aspects or an advantageous embodiment thereof. In particular, this method is carried out with the household refrigerator.

The household refrigerator can also be a shelf or a door rack or a drawer as a further storage area exhibit. These are separate physical components to the set-up device. A set-up device can, for example, be applied to a shelf. An image acquisition unit can be a camera, for example. The domestic refrigerator can be a refrigerator or a freezer or a fridge-freezer. It is designed to store and preserve food. A recording room can be a refrigerator compartment or a freezer compartment.

In a further advantageous embodiment, the electronic management system of the household refrigeration device is designed as a machine self-learning system. This means that learning effects regarding the placement of food and / or the creation of a note and / or re-ordering are also evaluated and taken into account for future scenarios. For example, such a machine learning process can be carried out by so-called “deep learning”. For example, a CNN (Convolutional Neural Network) can be used as the algorithm. The acquisition unit can be designed as an image acquisition unit. However, it can also be designed, for example, as an RFID (Radio Frequency Identification) unit.

It can advantageously be provided that the electronic characterization system automatically adjusts the first characterization threshold and / or the second characterization threshold. This can be dependent, for example, on the food that is to be set up and recorded on a set-up device. In addition or instead of this, however, this can also be taken into account, for example, depending on scenarios recorded in the past with regard to the loading and unloading of such food on an associated set-up device.

In particular, such an at least one set-up device specifies a locally defined and limited and controllable environment on which a specific foodstuff is to be applied locally, in order to improve it with respect to electronic evaluation, in particular with regard to the detection and determination of the currently available quantity to be able to judge, especially if this is done by means of visual recording and evaluation In particular, this avoids finding undesired overlaps or concealments with one another or with other foods, which would limit the detection.

It can be provided, in particular in order to increase the detection accuracy and thus the reliability, not to make an exact determination of the value of a quantity in a special embodiment, for example an exact number of an existing beverage container, such as a bottle, but, depending on the case, for example a binary response to the decision to specify whether a specific threshold value, in particular a threshold value range was undershot. These threshold values can be the characterization threshold values advantageously mentioned.

With the information "top", "bottom", "front", "rear," horizontal "," vertical "," depth direction "," width direction "," height direction "are the given positions and when the device is used and arranged as intended Orientations given.

Further features of the invention result from the claims, the figures and the description of the figures. The features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figures, can be used not only in the combination indicated in each case, but also in other combinations or on their own, without the frame to leave the invention. Embodiments of the invention are thus also to be regarded as encompassed and disclosed, which are not explicitly shown and explained in the figures, but which emerge from the explanations explained and can be generated by separate combinations of features. Designs and combinations of features are also to be regarded as disclosed, which therefore do not have all the features of an originally formulated independent claim.

• 1 eine schematische Darstellung eines Ausführungsbeispiels eines erfindungsgemäßen Haushaltskältegeräts; und
• 2 ein vereinfachtes schematisches Diagramm im Hinblick auf eine im zeitlichen Verlauf variierende Menge eines Lebensmittels auf einer Aufstellvorrichtung des Haushaltskältegeräts .

Exemplary embodiments of the invention are explained in more detail below with the aid of schematic drawings. Show it:

• 1 a schematic representation of an embodiment of a household refrigerator according to the invention; and
• 2 a simplified schematic diagram with regard to an amount of food that varies over time on a set-up device of the household refrigeration device.

Identical or functionally identical elements are provided with the same reference symbols in the figures.

In 1 is a schematic representation of a household refrigerator 1 shown, which is designed for storing and preserving food. The household refrigerator 1 can be a refrigerator or a freezer or a fridge-freezer combination.

The household refrigerator 1 has a housing 2 on. In the case 2 is at least a recording room 3 trained for food. The recording room 3 can in particular be a refrigerator compartment. The recording room 3 is through walls of an inner container 4 limited. The inner container 4 has a loading opening in the depth direction (z direction) on the front. This is through a door 5 of the household refrigerator 1 closable. The door 5 is on the case 2 pivotally arranged.

In 1 is the door 5 shown in the open state. It can be provided that on an inside 6 the door 5 that in the closed state of the door 5 the recording room 3 facing, for example at least one door rack 7 is arranged. The door rack 7 is designed to take in food. Here, for example, is the inclusion of a beverage container 7a , for example a bottle.

This door rack 7 is thus arranged on the door side.

In addition, the household refrigerator shows 1 housing side in the recording room 3 arranged a shelf 8th on. In the exemplary embodiment it is provided that a first shelf 8th and a second shelf 9 housing side in the recording room 3 are arranged. These plate-like shelves are arranged at different heights in the height direction (y direction). In addition, another food storage container can be used as an example 10 be provided, which here is a bowl or a drawer, the housing side in the depth direction in the receiving space 3 can be pushed in and pulled out.

The household refrigerator 1 also has at least one detection unit 11 on. This registration unit 11 is in particular an image acquisition unit, such as a camera. The registration unit 11 is in position and number in 1 to be understood only as an example. In particular, this registration unit 11 at the door 5 , especially on the inside 6 , be arranged so that when the door is closed 5 the recording room 3 can be recorded. In particular, it is then possible for the detection area of the detection unit, which is designed in particular as an image detection unit 11 is oriented such that, for example, at least that area of the recording area 3 can be recorded, which is viewed from the very top to the lower shelf 9 extends.

It can be provided that the camera is designed with a fisheye lens in order to be able to take such a wide-angle shot.

The household refrigerator 1 preferably also has a control unit 12 on. The control unit 12 is particularly part of an electronic management system 13 of the household refrigerator 1 , The at least one registration unit 11 is in particular part of this electronic administration unit or this electronic administration system 13 , The electronic management system 13 can, for example, also at least partially outside the household refrigerator 1 located, for example, in a computer cloud (cloud).

It can be provided that the information of the registration unit 11 to the control unit 12 transferred and processed and evaluated there. Control unit functions 12 can also be stored in a computer cloud in one embodiment.

In the exemplary embodiment shown, the household refrigerator has 1 an objective separate first installation device 14 on. This first stand 14 is one for the door rack 7 and to the shelves 8th and 9 separate objective component. The first set-up device is in the exemplary embodiment 14 designed as a mat. In the exemplary embodiment, it is on the top of the shelf 8th and when viewed from the front on the left in the recording room 3 positioned. In particular, the first set-up device 14 Non-destructively removable on the shelf 8th arranged. As a result, it can be used by a user in a variety of different positions in the recording space 3 to be ordered. As can be seen in this regard, the first set-up device 14 viewed in the depth direction in the front area of the shelf 8th arranged, in particular such that no other objects viewed in the depth direction in front of this first set-up device 14 can be arranged. This enables the detection of first foods on the first set-up device 14 are applied by the registration unit 11 when the door is closed 5 enables particularly precisely.

The stand 14 is designed in such a way that a specific first foodstuff is to be applied to it, in particular for example also by means of a predetermined assignment. Such an assignment can in particular also be specified individually for the user. For example, this can be done by appropriate programming or storage. Such an assignment is then in the electronic management system 13 , especially in the control unit 12 , deposited. It can also be changed advantageously for individual users.

Through the first installation device 14 is also visually symbolized by a physical component for a user, where he has a first food item associated with this in the recording room 3 to position in order to then be targeted by the registration unit 11 to be recorded and evaluated. In the exemplary embodiment shown, it is provided that beverage containers are used as the first food 15 , especially bottles, on the first stand 14 are upset. In particular, the first installation device 14 also the respective set-up position and / or the set-up orientation of such a first food 15 preferably given. In the embodiment shown here, these are beverage containers 15 arranged side by side and stacked and positioned horizontally. They are preferably mounted with the container bottoms facing the loading opening. This can be done by the registration unit 11 in a particularly advantageous manner and very precisely the amount of the first food on the first set-up device 14 be recorded. In particular, it is then provided that the detection unit is dependent on this information 11 by means of the mechanical, in particular electronic, management system 13 , especially the control unit 12 , this quantity is determined. It is also preferably determined electronically depending on whether a sufficient amount of this first food is on the first set-up device 14 is available. Such a decision as to whether there is a sufficient amount of first food in the household refrigerator 1 , especially on the first installation device 14 is present is decided by a corresponding comparison with at least one characterization threshold.

The electronic management system is advantageous 13 formed in such a way that the at least one image, which is associated with the detection unit 11 , which is preferably an image acquisition unit, was recorded to determine whether the first set-up device is on this image 14 is recognized. In a further image evaluation step, it depends on whether the first set-up device 14 is recognized, then, if applicable, that on this first set-up device 14 existing amount of first foods determined by evaluating the image.

In particular, as has already been explained above in an advantageous embodiment, the at least one image which is recorded with the image capture unit is such that not only that area of the recording space is on the image 3 with the first stand 14 is recorded, but a much larger area of the household refrigerator in this regard 1 is captured pictorially. With an image generated in this way, the image processing algorithm in the image initially moves after the first positioning device 14 searched. If this is recognized, only the image section of the entire image that shows the first set-up device and the first foodstuffs possibly applied to it is considered in the further evaluation. Therefore, only the image section that has this first set-up device is considered for further evaluation 14 and an area formed in particular upwards and backwards on this first installation device 14 forms. Such a document area 16 is in 1 shown as an example.

Such an image evaluation procedure allows a quantity of a first food item to be determined which is locally specific in the recording space 3 is arranged, can be made particularly precise.

Even if in the recording room 3 , for example on the shelf 8th , next to the first stand 14 further objects, in particular food, 17 and, for example, another first food 15 this is particularly not taken into account. Through the first installation device in question 14 becomes a very defined area in the recording room 3 predefined, onto which the first foodstuff to be applied, if applicable, can then be specifically recorded and evaluated via the image evaluation. So it should be with this system, in particular also the at least first set-up device 14 , a situation is created in which only the quantity of associated foodstuffs is assessed specifically by electronic recording and evaluation, which is local on this first set-up device 14 are upset.

In the advantageous embodiment already mentioned, in which the first set-up device 14 preferably non-destructively detachable in the recording room 3 is arranged and at different positions in the recording room 3 can still be positioned due to the design of the at least one detection unit 11 , in particular when an image is recorded, then this first positioning device in the image regardless of the respective position 14 be recognized and the placement of the first foodstuffs can be further evaluated locally depending on this.

In particular, the first set-up device 14 recognizable on the basis of their geometry and / or size and / or coloring, in particular recognizable in the image evaluation.

In an advantageous embodiment it can be provided that the household refrigerator 1 one to the first set-up device 14 separate second representational stand 18 having. This can be a mat, for example. Not in that finally to be understood example in 1 is this second stand 18 for example on an upper side of the further shelf 9 arranged. In particular, when viewed from the front, it is arranged on the left and viewed in the depth direction in the front area of the shelf 9 applied. It can be provided that on the second set-up device 18 a second food 19 to be set up. As with the first set-up device, this can also be done 14 explained, for example, by a user specification and in the electronic management system 13 be saved. In the example shown, the second food can also be a beverage container, but here not a bottle with its specific shape, but an angular, in particular cuboid, packaging. Here too is due to the design of the second set-up device 18 , in particular through specific recesses in the top of the second set-up device 18 , a defined specification of installation positions and / or installation orientations for these second foods 19 specified. Here too, as with the first set-up device 14 , which can have corresponding recesses, a very defined and structured positioning specification and thus a positioning pattern for the food 15 and 19 on the stands 14 and 18 be specified. This is the acquisition with the acquisition unit 11 improved again and can therefore be done more precisely.

Here too, as with the first set-up device 14 , provided that the size of the stand 14 . 18 is significantly smaller than the area of a shelf 8th and 9 ,

Even on the shelf 9 is to be understood only as an example in addition to the second set-up device 18 the arrangement of other foods 20 shown as an example.

It can be provided that with one detection unit 11 at the same time the area above where the first shelf 8th and also the first installation device 14 are arranged, can be recorded and at the same time the area in which the second shelf 9 is arranged and the second set-up device 18 is arranged, can be detected. For example, this can be done by a single image. It can also be provided that the household refrigerator 1 at least two separate registration units 11 , in particular two image capture units, the first of which comprises the upper region of the recording space 3 and the other the lower area of the recording room 3 can capture, so that the recording space in particular through these two detection units 3 can be fully captured.

Here too, the electronic management system can be used 13 depending on the information, the respective amount of first foods 15 and the respective amount of second foods 19 that are locally locally only on the mounting devices 14 and 18 are arranged to be determined.

Depending on a certain amount of a food 15 and or 19 can then advantageously through the electronic management system 13 a notice to a user and / or an automatic reordering of this food by the electronic management system 13 respectively. The household refrigerator 1 , especially the electronic management system 13 , can for example via a communication network 21 , especially over the Internet, with a provider 22 of such a foodstuff.

The electronic management system 13 can, for example, query and evaluate delivery times and / or prices for a food item to be re-ordered. Depending on this, it can then select a specific supplier and initiate a corresponding reorder. This can also be done in a machine, so that the management system 13 can train.

It is advantageously provided that the electronic management system 13 is self-learning. This means that machine training can be carried out when a corresponding notification and / or a reordering of a first food item 15 and / or a second food 19 should be done. In this context, it is then also possible for a specific characterization threshold value, which is to be adapted automatically for the decision as to whether a reference should be made to a user and / or a reordering of a specific foodstuff, is automatically adapted.

It can be provided that, as a hint to a user, for example the information of a shifting of a food item from another, in particular from the detection unit 11 non-detectable, storage area of the household refrigerator 1 on the respective installation device 14 . 18 can be made. For example, this can be the case when a user has a first food 15 , as in 1 shown on the shelf 8th next to the first stand 14 has set up and / or for example in the door rack 7 has set up. Through the stand 14 and or 18 is also symbolized to a user where he has an assigned food 15 . 19 must position to capture via the registration unit 11 and an assessment through the electronic management system 13 to enable automatically.

In 2 a diagram is shown in a simplified representation, in which a change in an amount of a food 15 exemplary on the first set-up device 14 is explained. There are two characterization threshold values here by way of example Z2 and Z4 given that in particular characterize an individual amount of first foods. For example, is there a situation in which at the time t1 an assembly of the first set-up device 14 with first foods 15 is carried out and in the context of an orderly list with a lot Z5 can take place in particular, for example, from this point in time t1 monitoring the amount of the first food 15 on the first stand 14 respectively. As you can see, the amount is Z5 larger than that due to the characterization threshold values Z2 and Z4 given quantities.

For example, at a time t2 a specific amount of the first food 15 from the first installation device 14 taken and, for example, the amount of the higher second characterization threshold Z4 is achieved via the electronic management system 13 found that there was still a sufficient amount of this first food 15 on the first stand 14 is available. In the further course of time, the first foodstuffs are removed again 15 from the first installation device 14 at the times t3 and t4 , it is recognized, for example, that at the time t4 the amount of first foods 15 on the first stand 14 the lower characterization threshold Z2 has reached.

In the following, at a further point in time t5, a further removal of a first food item will take place 15 from the first installation device 14 this lower characterization threshold Z2 is below and then a message to the user and / or a reorder of the first food 15 initiated.

At a further point in time t6, the first set-up device is filled 14 with first foods 15 in that at least the lower characterization threshold Z2 is exceeded again, this is also done by the electronic management system 13 recognized.

In an advantageous embodiment, it can be provided that when starting from a degree of filling of the first set-up device 14 greater of both characterization thresholds Z2 to Z4 a note is generated and / or a reorder is made when the quantity of first foodstuffs 15 both characterization thresholds Z2 and Z4 has fallen below.

This gives a higher level of accuracy and a more precise statement as to whether, for example, a reorder is actually required.

For example, a removal and loading of the first set-up device 14 with first foods 15 to the extent that there is a slight fluctuation in the respective quantity around a characterization threshold, for example around the characterization threshold Z2 , takes place, if necessary, no generation of a notice and / or a reorder is carried out. This is due to the fact that it can then be determined that such a relatively small fluctuation of the amount around this characterization threshold value occurs, in particular in a specific time interval, and that there may also be a certain error tolerance with regard to the detection accuracy in the context. In order to avoid an unwanted or unnecessary reorder in this context, such an action is then prevented.

LIST OF REFERENCE NUMBERS

1

Household refrigerator

2

casing

3

accommodation space

4

inner container

5

door

6

inside

7

door racks

7a

beverage containers

8th

first shelf

9

second shelf

10

Food storage container

11

acquisition unit

12

control unit

13

electronic management system

14

first installation device

15

first food

16

receiving area

17

other items

18

second stand

19

Food

20

Food

21

communication network

22

providers

t1

time

t2

time

t3

time

t4

time

Z2

Characterization threshold

Z4

Characterization threshold

QUOTES INCLUDE IN THE DESCRIPTION

This list of documents listed by the applicant has been generated automatically and is only included for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• DE 112016003769 T5 [0002]
• DE 102016209441 A1 [0003]

Claims (15)

Method for holding food in a household refrigeration device (1), in which a food (15, 19) is captured in a receiving space (3) of the household refrigeration device (1) with at least one image acquisition unit (11) of the household refrigeration device (1), and depending thereon it is determined whether the food (15, 19) is available in sufficient quantity, characterized in that at least one separate first positioning device (14) is introduced locally specifically in the receiving space (3), by means of which a locally defined position for a defined first food item is specified, the first food item (15) being able to be applied to the first set-up device (14) in the receiving space (3), and the at least one image which is recorded with the image capturing unit (11) is being evaluated accordingly, whether the first set-up device (14) has been detected and if the first set-up device (14) is recognized in the image, the amount of the first food (15) thereon is determined. Procedure according to Claim 1 , characterized in that the image acquisition unit (11) captures an area which is larger than the topping area (16) occupied by the first set-up device (14) and the first foodstuffs (14) possibly placed thereon, the evaluation of the at least one image of the document area (16) is recognized and only the image section of the image with this document area (16) is taken into account for determining the amount of first foodstuffs (15) on the first set-up device (14). Procedure according to Claim 1 or 2 , characterized in that the first set-up device (14) can be positioned locally variably in the receiving space (3), and when evaluating the image the first set-up device (14) is recognized regardless of its position. Method according to one of the preceding claims, characterized in that set-up positions and / or set-up orientations for first foods (15) are predefined in a defined manner by the first setting-up device (14), so that the first foods (15) are applied to them in a defined order. Procedure according to Claim 4 , characterized in that the set-up positions and / or set-up orientations are predetermined by shape-specific recesses in the first set-up device (14). Method according to one of the preceding claims, characterized in that a second set-up device (18) is introduced locally specifically in the receiving space (3), by means of which a locally defined set-up position for a second food is specified for a user, and one for the first food ( 15) different second foodstuffs (19) can be placed on the second set-up device (18) separate from the first set-up device (14) in the receiving space (3), and the at least one image that is recorded with the image capture unit (11) is evaluated accordingly whether the second set-up device (18) has been detected, and if the second set-up device (18) is recognized in the image, the amount of the second food (19) on it is determined. Method according to one of the preceding claims, characterized in that, depending on the detected quantity of at least one food (15, 19), a message is issued to a user and / or an automatic reordering of this food (15, 19) by an administration system (13) of the household refrigerator (1) is generated. Procedure according to Claim 7 , characterized in that a user specifies a supplier for a food (15, 19), in particular is stored by a user, and the specified supplier is contacted in the case of an automatic reordering. Procedure according to Claim 7 , characterized in that the electronic administration system (13) searches for delivery times and / or prices for the food to be re-ordered (15, 19) via a communication network (21), in particular the Internet, and selects a supplier depending thereon. Procedure according to one of the Claims 7 to 9 , characterized in that a necessary reordering is generated as a hint and / or as a hint a necessary shifting of the food in question (15, 19) from another storage area (7) of the household refrigeration device (1 ) is generated on the installation device (14, 18). Method according to one of the preceding Claims 7 to 10 , characterized in that, for generating an indication, it is checked whether the amount of the food (15, 19) recorded is a first characterization characterizing the amount of the food (15, 19) to be assessed. Has fallen below the threshold value (Z4) and / or a second characterization threshold value (Z2), and / or a re-order is made if the amount of the foodstuffs (15, 19) recorded is a first, the amount of the foodstuffs to be assessed (15, 19) characterizing first characterization threshold (Z4) and / or a second characterization threshold (Z2). Procedure according to Claim 11 , characterized in that a notification and / or a reorder occurs only if, starting from the start of monitoring a quantity of food (15, 19) on a set-up device (14, 18), at least the first and the second characterization threshold value ( Z4, Z2) is undershot. Method according to one of the preceding claims, characterized in that a flexible mat is introduced into the receiving space (3) as the first set-up device (14). Procedure according to Claim 13 , characterized in that, depending on its size and / or color, the mat symbolizes the placement of the first food (15) for a user, and, depending on the size and / or color, the food is recognized as the first food (15) when the image is evaluated becomes. Household refrigeration device (1) with a housing (2), in which at least one receiving space (3) for food is formed, and with at least one capturing unit, in particular an image capturing unit (11) for, in particular pictorial, capturing at least a partial area of the accommodating space (3) , with at least one shelf (8, 9) or a door rack (7) or a drawer (10), in particular for a shelf (8, 9) or a door rack (7) for a foodstuff, and with an electronic management system (13), wherein the household refrigerator (1) is designed to carry out a method according to one of the preceding claims.

Images