WO2022156707A1 - 用于洗碗机的补光方法、补光装置以及洗碗机 - Google Patents
用于洗碗机的补光方法、补光装置以及洗碗机 Download PDFInfo
- Publication number
- WO2022156707A1 WO2022156707A1 PCT/CN2022/072725 CN2022072725W WO2022156707A1 WO 2022156707 A1 WO2022156707 A1 WO 2022156707A1 CN 2022072725 W CN2022072725 W CN 2022072725W WO 2022156707 A1 WO2022156707 A1 WO 2022156707A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- brightness
- light
- image
- value
- brightness value
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 128
- 230000001502 supplementing effect Effects 0.000 title claims abstract description 38
- 238000004140 cleaning Methods 0.000 claims abstract description 58
- 239000013589 supplement Substances 0.000 claims description 54
- 238000005406 washing Methods 0.000 claims description 26
- 238000004590 computer program Methods 0.000 claims description 19
- 238000003860 storage Methods 0.000 claims description 17
- 230000002829 reductive effect Effects 0.000 claims description 10
- 230000009469 supplementation Effects 0.000 abstract 2
- 230000001276 controlling effect Effects 0.000 description 26
- 238000010586 diagram Methods 0.000 description 10
- 230000008859 change Effects 0.000 description 9
- 238000013461 design Methods 0.000 description 8
- 230000003247 decreasing effect Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000005286 illumination Methods 0.000 description 5
- 238000006073 displacement reaction Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000001105 regulatory effect Effects 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000003313 weakening effect Effects 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 238000005265 energy consumption Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000000153 supplemental effect Effects 0.000 description 2
- 239000011324 bead Substances 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000003631 expected effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 230000001795 light effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/42—Details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
Definitions
- the present application relates to the technical field of kitchen and bathroom appliances, and in particular, to a light-filling method, a light-filling device and a dishwasher for dishwashers.
- the washing area of the inner cavity of the dishwasher is usually provided with a fill light.
- the current common design scheme is to make the camera and the fill light into an integral component, that is, the inner hole is the opening of the camera, and the outer ring is the design of the fill light. This not only facilitates the leads, but also reduces the number of openings.
- this design also has disadvantages, because its size cannot be made very large, and its proportion is too small relative to the inner cavity of the dishwasher, which is equivalent to a point light source. Due to the structural characteristics of the fill light, it is easy to cause the edge area to be relatively dark, which leads to the loss of part of the information in the collected image, which eventually leads to inaccurate image recognition and does not meet the user's expected experience.
- the purpose of the present application is to provide a light-filling method, a light-filling device and a dishwasher for a dishwasher.
- a method for supplementing light for a dishwasher includes an image acquisition device for acquiring an image of a cleaning area in the dishwasher; a main supplementary light , used to fill light on the image; at least one secondary fill light is used to fill the edge area of the image; the fill light method includes: acquiring an image; obtaining a first brightness value of the image according to the image; In the case of being within the preset first brightness range, obtain the second brightness value of the edge area of the image according to the image; when the second brightness value is outside the preset second brightness range, adjust the secondary fill light brightness to adjust the second brightness value.
- the method further includes: when the first brightness value is outside the first brightness range, adjusting the brightness of the main fill light to adjust the first brightness value.
- adjusting the brightness of the main fill light to adjust the first brightness value includes: when the first brightness value is smaller than the first brightness range In the case of the limit value, increase the brightness of the main fill light to increase the first brightness value; when the first brightness value is greater than the upper limit of the first brightness range, reduce the brightness of the main fill light to reduce the first brightness value. a brightness value.
- obtaining the first brightness value of the image according to the image includes: obtaining a brightness histogram of the image; and weighting and summing the brightness values of each pixel in the brightness histogram to obtain the first brightness value.
- the at least one auxiliary supplementary light includes a first auxiliary supplementary light and a second auxiliary supplementary light, and the first auxiliary supplementary light and the second auxiliary supplementary light are respectively disposed on the left and right sides of the image capturing device.
- adjusting the brightness of the auxiliary fill light to adjust the second brightness value includes: In the case where the second brightness value on the left side of the left edge area is outside the second brightness range, adjust the brightness of the first auxiliary light to adjust the second brightness value on the left side; in the right edge area, the second brightness value on the right side is adjusted When the value is outside the second brightness range, adjust the brightness of the second auxiliary light to adjust the second brightness value on the right.
- obtaining the second brightness value of the edge region of the image according to the image includes: dividing the image into multiple regions; extracting edge regions in the multiple regions according to the field of view angle of the main fill light; determining the edge region The second brightness value of ; wherein the second brightness value is the average value of the brightness values of the edge region.
- the main supplementary light and the auxiliary supplementary light are individually controlled through different pulse width modulation signals.
- a light supplement device for a dishwasher comprising: an image acquisition device for acquiring an image of a cleaning area; a main supplement light lamp, arranged around the image acquisition device and used for cleaning In the area, the area corresponding to the central area of the image is filled with light; at least one auxiliary fill light is arranged on at least one side of the main fill light, and is used to fill in the area corresponding to the edge area of the image in the cleaning area; a processor configured to: acquire an image; obtain a first brightness value of the image according to the image; and obtain a second brightness value of an edge region of the image according to the image when the first brightness value is within a preset first brightness range ; In the case that the second brightness value is outside the preset second brightness range, adjust the brightness of the auxiliary light to adjust the second brightness value.
- the processor is further configured to adjust the brightness of the main fill light to adjust the first brightness value when the first brightness value is outside the first brightness range.
- the processor being configured to adjust the brightness of the main fill light to adjust the first brightness value includes that the processor is configured to: in the case that the first brightness value is less than the lower limit value of the first brightness range, The brightness of the main fill light is increased to increase the first brightness value; when the first brightness value is greater than the upper limit value of the first brightness range, the brightness of the main fill light is decreased to reduce the first brightness value.
- the processor is configured to obtain the first brightness value of the image according to the image, and is configured to: obtain a brightness histogram of the image; weight and sum the brightness values of each pixel in the brightness histogram to obtain the first brightness value of the image. a brightness value.
- the supplementary light device includes: a first secondary supplementary light, which is arranged on the left side of the image acquisition device; a second supplementary supplementary light, which is provided on the right side of the image acquisition device; the processor is configured to In the case where the second brightness value is not located in the second brightness range, adjusting the brightness of the secondary fill light to adjust the second brightness value includes that the processor is configured to: the second brightness value on the left side of the left edge area is located in the second brightness range If the brightness is outside the range of the second brightness, adjust the brightness of the first auxiliary light to adjust the second brightness value on the left; if the second brightness value on the right edge of the right edge area is outside the second brightness range, adjust the second brightness The brightness of the fill light to adjust the second brightness value on the right.
- the configuration of the processor to acquire the second brightness value of the edge region of the image includes that the processor is configured to: divide the image into a plurality of regions; extract a plurality of an edge region in the region; determining a second brightness value of the edge region; wherein the second brightness value is an average value of the brightness values of the edge region.
- it further includes: a first pulse width modulation device, which is electrically connected to the main supplementary light and used to adjust the brightness of the main supplementary light by controlling the duty ratio; a second pulse width modulation device, which is electrically connected to The first auxiliary light is used to adjust the brightness of the first auxiliary light by controlling the duty ratio; the third pulse width modulation device, which is electrically connected to the second auxiliary light, is used to adjust the first auxiliary light by controlling the duty cycle.
- the brightness of the second fill light is electrically connected to the main supplementary light and used to adjust the brightness of the main supplementary light by controlling the duty ratio.
- a dishwasher including the above-mentioned light supplement device for a dishwasher.
- a machine-readable storage medium is provided, and instructions are stored on the machine-readable storage medium, and when executed by a processor, the instructions are used to enable the processor to execute the above-mentioned method for a dishwasher. fill light method.
- a computer program product including a computer program, wherein the computer program, when executed by a processor, implements the above-mentioned light supplement method for a dishwasher.
- the supplementary light method provided by the embodiments of the present application uses a secondary supplementary light to supplement light in the washing area of the dishwasher, thereby solving the existing problems in the design of using supplementary light to surround the image acquisition device in the prior art.
- the edge area is dark, by acquiring the image of the cleaning area, first obtain the first brightness value of the image according to the image, and when the first brightness value is within the preset first brightness range, the brightness of the edge area is checked.
- Evaluation that is, obtaining the second brightness value, and in the case that the second brightness value is outside the preset second brightness range, adjust the second brightness value through the brightness of the sub-fill light, so as to improve the brightness balance of the image, so that The information of image recognition is not missing, the accuracy of image recognition is improved, and the user experience is improved.
- FIG. 1 schematically shows a schematic structural diagram of a dishwasher under conventional conditions
- FIG. 2 schematically shows a schematic structural diagram of a dishwasher light-filling device to which the light-filling method for dishwashers provided according to the first embodiment of the present application is applied;
- FIG. 3 is a flow chart of a light supplement method for a dishwasher provided by the first embodiment of the present application
- FIG. 4 is a flowchart of step S12 in the light supplement method for a dishwasher provided by the first embodiment of the application;
- FIG. 5 is a flowchart of step S15 in the light supplement method for a dishwasher provided by the first embodiment of the application;
- FIG. 6 is a flowchart of step S13 in the light supplement method for a dishwasher provided by the first embodiment of the present application;
- FIG. 7 is a schematic diagram of an exemplary demonstration step S13 in the light supplement method for a dishwasher provided by the first embodiment of the present application;
- FIG. 8 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the present application.
- FIG. 9 is a flowchart of step S23 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
- FIG. 10 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the application.
- FIG. 11 is another flowchart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the application;
- step S24 is a further flow chart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the application;
- FIG. 13 is a flowchart of step S26 in the light supplement method for a dishwasher provided by the second embodiment of the application;
- FIG. 14 schematically shows a schematic structural diagram of a dishwasher light-filling device applied by a light-filling method for a dishwasher provided according to the third embodiment of the present application;
- FIG. 15 is a flowchart of a light supplement method for a dishwasher provided by the third embodiment of the application.
- FIG. 16 is a flowchart of step S35 in the light supplement method for a dishwasher provided by the third embodiment of the application;
- FIG. 17 is a flowchart of step S38 in the light supplement method for a dishwasher provided by the third embodiment of the present application.
- FIG. 18 is a flowchart of a light supplement method for a dishwasher provided by the fourth embodiment of the present application.
- FIG. 19 is another flowchart of the light supplement method for a dishwasher provided by the fourth embodiment of the present application.
- FIG. 20 is a further flow chart of the light supplement method for dishwashers provided by the fourth embodiment of the present application; and FIG. 21 is the light supplement method for dishwashers provided by the fourth embodiment of the present application. It is a schematic diagram for demonstrating step S494.
- Lighting device 11. Image acquisition equipment;
- the embodiments of the present application provide a solution for fill light and image recognition for a dishwasher, the solution includes multiple embodiments, respectively including image acquisition of the cleaning area in the dishwasher, image discrimination, and control of fill lights Various aspects such as supplementary light are performed, and various aspects in the embodiments of the present application are described in detail below.
- the first embodiment of the present application provides a fill light method for a dishwasher, which can fill light in a washing area in the dishwasher to better capture images, and the method aims to solve the problem of existing dishwashers.
- the fill light surrounding the image acquisition device is used for fill light
- the structural characteristics of the fill light easily lead to the problem that the edge area is relatively dark. This problem will lead to the lack of some information in the collected images, and the final image recognition process will be inaccurate, which will not meet the user's expected experience.
- FIG. 1 schematically shows a schematic structural diagram of a dishwasher in a conventional situation.
- the dishwasher 100 includes an image capture device 11 and a fill light 12 .
- the image capturing device 11 and the fill light 12 are formed into an integral annular assembly.
- the lead wires are convenient, and the number of openings in the inner wall of the dishwasher 100 can be reduced.
- the inner hole is the opening of the image acquisition device 11
- the outer ring is the fill light 12 .
- this design also has disadvantages, because its size cannot be designed as large as the rectangular fill light.
- the proportion of the fill light 12 is very small.
- the light lamp 12 is equivalent to a point light source. Because the light has an incident angle (field of view) relative to the object rather than a parallel light, but the image capture device 11 captures the overall image of the cleaning area, this way of filling light will make the captured image of the cleaning area filled with
- the central area covered by the light lamp 11 will be brighter than the peripheral area of the central area, that is, the central area is brighter than the peripheral area. If tableware is placed in the edge area, the image capturing device 11 may not be able to capture the image of the edge area well, which may result in partial information loss of the captured image.
- FIG. 2 schematically shows a schematic structural diagram of a light supplementing device for a dishwasher to which the light supplementing method for a dishwasher provided according to the first embodiment of the present application is applied.
- the supplementary light device 1 of the dishwasher 100 may include:
- the image acquisition device 11 is used to acquire the image of the cleaning area in the dishwasher 100;
- the main fill light 121 is used to emit light to the cleaning area to fill the cleaning area of the dishwasher 100;
- the area corresponding to the central area (which can be called the central area) is filled with light;
- At least one auxiliary supplementary light 122 is used for emitting light to the edge of the cleaning area to fill in the area (may be referred to as the edge area) in the cleaning area corresponding to the edge area of the image captured by the image acquisition device 11 .
- the edge regions may be peripheral regions of the central region.
- the main fill light 121 may be disposed around the image capturing device 11 , and the auxiliary fill light 122 may be disposed on one side of the main fill light 121 .
- a general inventive concept provided by the embodiments of the present application is to add a secondary supplementary light 122 around the main supplementary light 121 to brighten the darker edge areas of the cleaning area not covered by the main supplementary light 121 .
- the number of auxiliary supplementary lights 122 may not be limited, and the more auxiliary supplementary lights 122 are, the more uniform the illumination will be.
- the secondary fill light 122 may face the same direction as the image capturing device 11 . In one example, the image acquisition device 11 may be on 4 sides of the lumen.
- the image capturing device 11 may include a visible light camera; the main fill light 121 and the auxiliary fill light 122 may be white lights.
- the image acquisition device 11 can be an infrared camera, and the main fill light 121 and the auxiliary fill light 122 can be infrared fill lights.
- the applicable image acquisition device 11 described in this embodiment adopts a visible light camera, and the main fill light 121 and the auxiliary fill light 122 use white lights.
- the supplementary light device 1 may include:
- the first auxiliary light 122a is arranged on the left side of the image capturing device
- the second auxiliary light 122b is arranged on the right side of the image capturing device.
- the edge area can be filled with light by the first auxiliary light 122a and the second auxiliary light 122b, wherein the first auxiliary light 122a and the second auxiliary light 122b can be relative to the image acquisition device 11. They are arranged at intervals to prevent excessive interference between the light of the first supplementary light 122a and the second supplementary light 122b and the light of the main supplementary light 121 .
- FIG. 3 is a flowchart of a method for supplementing light for a dishwasher provided by the first embodiment of the present application; based on the structure of the dishwasher described in the above embodiments, Light methods can include:
- Step S11 acquiring an image
- Step S12 obtaining the first brightness value of the image according to the image
- Step S13 in the case that the first brightness value is within the preset first brightness range, obtain the second brightness value of the edge region of the image according to the image;
- Step S14 In the case that the second brightness value is outside the preset second brightness range, adjust the brightness of the secondary fill light to adjust the second brightness value.
- the image acquisition device is first initialized, and waits for a signal that triggers the acquisition of the image acquisition device to perform acquisition.
- the first brightness value of the image can be calculated according to the image.
- the brightness distribution of the image can be evaluated, and then the first brightness value of the image can be evaluated.
- the second brightness value and the second brightness range of the edge area can be evaluated according to the second brightness value of the edge area. It is determined that when the second brightness value is outside the preset second brightness range, the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
- the first brightness range can be understood as the image in the first brightness range is neither overexposed nor overdark overall.
- the first brightness range can be set according to requirements. Assume that the first brightness threshold for over-darkness is d1, and the second brightness threshold for over-exposure is d2, that is, when the brightness of the image is less than the first brightness threshold d1, the image as a whole is too dark, and when the brightness is greater than the second brightness threshold d2, At this point the entire image is overexposed. At this time, the first luminance range is d1 to d2. When the first brightness value is within the preset first brightness range, it is only considered that the image as a whole is not overexposed or too dark at this time. The covered edge areas will still be locally too dark.
- the cleaning area can be divided into an area that can be covered by the main fill light (eg, a central area) and an edge area that cannot be covered by the main fill light.
- the overall image of the area that can be covered by the main fill light can be judged, and when the first brightness value of the overall image satisfies the condition, the edge area in the image can be judged whether it is necessary to supplement the edge area. Light.
- FIG. 4 is a flowchart of step S12 in the light supplement method for a dishwasher provided by the first embodiment of the present application.
- Obtaining the first brightness value of the image according to the image in step S12 may include:
- Step S121 obtaining a grayscale histogram of the image
- Step S122 Weighting and summing the luminance values of each pixel in the grayscale histogram to obtain a first luminance value.
- a grayscale histogram can be counted on the overall image, where the "grayscale histogram" reflects the relationship between the frequency of occurrence of each grayscale pixel in an image and the grayscale. Taking the gray level as the abscissa and the frequency as the ordinate, draw the relationship between the frequency and the gray level.
- the initial gray level of the gray histogram is set to 0, the x-axis of the histogram represents the gray value from 0 to 255, which can represent the brightness value, the y-axis of the histogram represents the number of pixels corresponding to the brightness value, and the gray level It is the level division of gray value, which indicates the degree of precision, such as level 8, level 16, level 32.
- the grayscale value has an interval range of 0-255. It can be understood that setting the grayscale range represented by each interval of the histogram represents the number of intervals on the grayscale range of the image to be imaged, and can also be understood as the dimension of the one-dimensional array of the histogram.
- step S122 is entered: weighted summation is performed on the luminance values of each pixel in the grayscale histogram to obtain a first luminance value.
- Weighted summation involves averaging methods that include weights; usually in a set of data, the number of times a piece of data occurs is called a weight. The specific method is as follows: according to each brightness value (gray value) in the histogram, different weights are given; then the weights are multiplied by the number of pixels falling in the area, and all the results are added to obtain the above
- the first brightness value obtained in step S12 is only a brightness reference value for judging the overall image, and can be calculated in other ways. Two mean operations are performed to obtain the first luminance value, which all belong to the protection scope covered by the embodiments of the present application.
- the image can be transformed into an integer multiple of the image by imresize (imresize: zoom processing), so that the image can be easily displayed. identify.
- the supplementary light method further includes: Step S15 : adjusting the brightness of the main supplementary light to adjust the first brightness value when the first brightness value is outside the first brightness range.
- the first brightness value of the image is within the first brightness range
- the first brightness value of the entire image can be calculated, and when the first brightness value is within the first brightness range, the edge region can be discriminated. If the first brightness value is outside the first brightness range, the brightness of the main fill light may continue to be adjusted until the first brightness value falls within the first brightness range.
- step 15 when the first brightness value is outside the first brightness range, adjusting the brightness of the main fill light to adjust the first brightness value includes:
- Step S151 when the first brightness value is less than the lower limit value of the first brightness range, increase the brightness of the main fill light to increase the first brightness value;
- Step S152 When the first brightness value is greater than the upper limit value of the first brightness range, reduce the brightness of the main fill light to reduce the first brightness value.
- steps S151 to S152 when the image is overexposed or too dark, the overall image is filled or reduced by adjusting the brightness of the main fill light.
- the adjustment method may be to adjust the brightness of the main fill light. Input voltage or adjust the duty cycle of the PWM signal used to control the main fill light.
- FIG. 6 is a flowchart of step S13 in the light supplement method for a dishwasher provided by the first embodiment of the present application;
- step S13 obtaining the second brightness value of the edge region of the image according to the image includes:
- Step S131 Divide the image into multiple regions
- Step S132 extracting edge regions in multiple regions according to the field of view of the main fill light
- Step S133 Determine the second brightness value of the edge area.
- the image is divided into multiple areas through image segmentation, and the range that can be covered by the main fill light is determined according to the field of view of the main fill light (you can obtain the cleaning area after the main fill light is lit separately. image, so as to obtain the range that the main fill light can cover), and according to the area covered by the main fill light, it will be removed from the entire area (multiple areas), thereby extracting multiple edge areas. Then, the second luminance value of the edge area is counted.
- the second luminance value may be a weighted summation of the luminance values of each of the edge regions, and then an average value of the edge regions is calculated.
- step S14 is performed: in the case that the second brightness value is outside the preset second brightness range, adjust the brightness of the auxiliary light to adjust the second brightness value.
- the first auxiliary fill light 122a and the second auxiliary fill light 122b are respectively arranged on the left and right sides of the image acquisition device, and are respectively used for image acquisition.
- the left edge area and the right edge area of are filled with light.
- adjusting the brightness of the sub-fill light to adjust the second brightness value includes: at the left side of the left edge area where the second brightness value is outside the second brightness range
- adjust the brightness of the first auxiliary fill light 122a to adjust the second brightness value on the left side
- adjust the second auxiliary fill light The brightness of the lamp 122b is adjusted to the right second brightness value.
- the left second brightness value may refer to the second brightness value of the left edge region
- the right second brightness value may refer to the second brightness value of the right edge region.
- the adjustment method may include: if the second brightness value on the left is outside the second brightness range, in the case that the second brightness value on the left is less than the lower limit value of the second brightness range, adding a first auxiliary light When the brightness of 122a is greater than the lower limit of the second brightness range, the brightness of the first auxiliary light 122b is reduced.
- the second auxiliary light 122b on the right can be adjusted according to the second brightness value and the second brightness range on the right, so as to keep the second brightness value of the edge area not too dark and not overexposed.
- the main fill light and the auxiliary fill light are individually controlled by different pulse width modulation signals, and the brightness is controlled by controlling the duty ratio of the pulse width modulation signals.
- the pulse width modulation signal is abbreviated as PWM signal, which modulates the bias of the transistor base or the gate of the MOS tube according to the change of the corresponding load, so as to realize the change of the conduction time of the transistor or MOS tube, so as to realize the switching regulated power supply. Changes in output.
- the adjustment is the adjustment of the duty cycle. By controlling the main fill light and the auxiliary fill light separately, it can adjust multiple areas of the cleaning area.
- An embodiment of the present application further provides a light supplementing device for a dishwasher, where the supplementary light device includes an image acquisition device, a main supplementary light lamp, at least one auxiliary supplementary light lamp, and a processor.
- the supplementary light device includes an image acquisition device, a main supplementary light lamp, at least one auxiliary supplementary light lamp, and a processor.
- the image acquisition device is used to acquire the image of the washing area of the dishwasher
- the main supplementary light is arranged around the image acquisition device and used to supplement the image
- at least one auxiliary supplementary light is provided at least one of the main supplementary lights.
- One side used to fill the edge area of the image.
- the processor is configured to execute all or part of the steps of the light supplement method of the above embodiments.
- the at least one auxiliary supplementary light includes: a first auxiliary supplementary light, which is arranged on the left side of the image acquisition device; and a second supplementary supplementary light, which is arranged on the right side of the image acquisition device.
- the supplementary light device further includes an independently set first pulse width modulation device, which is electrically connected to the main supplementary light and used to adjust the brightness of the main supplementary light by controlling the duty ratio; the second pulse width modulation The device is electrically connected to the first auxiliary supplementary light for adjusting the brightness of the first auxiliary supplementary light by controlling the duty cycle; the third pulse width modulation device is electrically connected to the second auxiliary supplementary light for controlling the The duty cycle adjusts the brightness of the second supplementary light.
- the independently set first pulse width modulation device, second pulse width modulation device, and third pulse width modulation device the brightness of the main supplementary light, the first auxiliary supplementary light and the second supplementary supplementary light are respectively independent. control.
- the supplementary light method provided by the embodiment of the present application uses the auxiliary supplementary light to supplement the light in the washing area of the dishwasher, thereby solving the problem of the existing edge area in the design of using supplementary light to surround the image acquisition device in the prior art.
- For the problem of darkness by obtaining the image of the cleaning area, first obtain the first brightness value of the image according to the image, and when the first brightness value is within the preset first brightness range, evaluate the brightness of the edge area, that is, obtain The second brightness value, when the second brightness value is outside the preset second brightness range, adjust the second brightness value through the brightness of the auxiliary light, thereby improving the brightness balance of the image, so that the information of image recognition can be improved. Not missing, improve the accuracy of image recognition, thereby improving the user experience.
- the second embodiment of the present application provides a light supplement method for a dishwasher, which can supplement light in a washing area in the dishwasher faster and save energy.
- the cameras of dishwashers Due to cost considerations in existing dishwashers, the cameras of dishwashers generally use ordinary cameras without AI auto-focus and exposure adaptive algorithms.
- image processing technology is usually used to fine-tune the image, such as image brightness balance adjustment, so that the brightness of the image is more balanced to prevent overexposure or too dark, but the processing technology used for the image is often prone to distortion, resulting in poor results. And it cannot adapt to all environments, especially the inner cavity of the dishwasher is a closed environment. For example, when the user places the dishwasher in an environment with poor light, it is difficult for the image processing to achieve the expected effect, which is not expected by the user. experience.
- the embodiments of the present application provide a method for supplementing light for a dishwasher, wherein the dishwasher includes a supplementary light for supplementing light in a washing area of the dishwasher.
- FIG. 8 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the present application.
- the fill light method may include:
- Step S21 controlling the fill light to fill light with the initial brightness
- Step S22 acquiring an image of the cleaning area in the dishwasher
- Step S23 perform gray histogram statistics on the image to determine whether the image is too dark or overexposed
- Step S24 when the image is overexposed or too dark, control the fill light to adjust the initial brightness
- Step S25 in the case that the image is not overexposed or too dark, determine the current initial brightness as the target fill light brightness
- Step S26 take the target fill light brightness as the next initial brightness default value.
- the supplementary light is controlled to perform supplementary light with a default initial brightness, and when the supplementary light is the initial brightness, an image of the cleaning area in the dishwasher is acquired.
- the initial brightness may be the median value of the maximum brightness of the fill light, which may be a more appropriate value obtained through experiments based on the dishwasher being located in different environments, so as to adapt to most environments and increase the number of dishwashers. scope of application.
- the image acquisition device may acquire an image of the cleaning area, and the image acquisition device may be set in the same direction as the fill light to obtain a better fill light effect.
- step S23 the grayscale histogram statistics are performed on the image, wherein the "grayscale histogram" reflects the relationship between the frequency of occurrence of each grayscale pixel in an image and the grayscale. Taking the gray level as the abscissa and the frequency as the ordinate, draw the relationship between the frequency and the gray level.
- the starting gray level of the grayscale histogram is set to 0, the x-axis of the histogram represents the grayscale value from 0 to 255, which can represent the brightness value, the y-axis of the histogram represents the number of pixels corresponding to the brightness value, and the grayscale level It is the level division of gray value, which indicates the degree of precision, such as level 8, level 16, level 32.
- the grayscale value has an interval range of 0-255. It can be understood that setting the grayscale range represented by each interval of the histogram indicates the number of intervals on the grayscale range of the image to be imaged, which can also be understood as the dimension of the one-dimensional array of the histogram.
- step S23 is a flowchart of step S23 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
- performing histogram statistics on the image to determine whether the image is too dark or overexposed may include:
- Step S231 Determine the ratio of the number of pixels whose gray value corresponds to the white area in the gray histogram to the average number of pixels;
- Step S232 in the case that the ratio is smaller than the first ratio threshold, determine that the image is too dark;
- Step S233 When the ratio is greater than the second ratio threshold, determine that the image is overexposed.
- the grayscale value corresponding to the horizontal axis coordinate in the grayscale histogram is 250 ⁇ x (that is, the ordinate (number of pixels) corresponding to the white area in step S231 ) accounts for the average number of pixels (the total number of pixels divided by the grayscale value)
- the ratio of is much larger than other gray values, it proves that the white area of the image accounts for a large proportion, and the image corresponds to overexposure.
- the proportion of the ordinate (number of pixels) near the grayscale coordinate 250 is very low, and the number of pixels at the coordinate 50 (corresponding to the black area of the grayscale histogram) is relatively high, such an image is not bright enough, that is, the above image is too dark.
- the first ratio threshold is 1:3, and the second ratio threshold is 3:1
- the grayscale value corresponds to 250 ⁇ x, that is, the number of pixels in the white area is
- the ratio of the average number of pixels is between 1:3 and 3:1.
- the image is not exposed and not too dark. If the ratio is greater than 3:1, the image is considered to be overexposed, and if it is less than 1:3, the image is considered bright. Too dark, that is, the above-mentioned steps S232 to S233.
- FIG. 10 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the present application.
- controlling the fill light to adjust the initial brightness includes:
- Step S241 when the image is overexposed, control the fill light to increase the initial brightness
- Step S242 When the image is too dark, control the fill light to reduce the initial brightness.
- the brightness of the fill light can be adjusted by adjusting the duty cycle of the pulse width modulation signal used to control the fill light.
- Pulse width modulation modulates the bias voltage of the controllable switch (for example, transistor base or MOS transistor gate) according to the change of the corresponding load, so as to realize the change of the conduction time of the transistor or MOS transistor, so as to realize the output of the switching regulated power supply. Change.
- the method of controlling the fill light to increase or decrease the initial brightness may include: periodically increasing or decreasing the duty cycle of the pulse width modulation signal according to time, for example, it may increase or decrease the pulse width modulation signal at a rate of 10% every 1 second. duty cycle.
- the brightness can be changed by changing the voltage of the fill light.
- the image capture device is controlled to capture the image again, and the loop goes to step S23 until the image is not overexposed or too dark, and then goes to step S25.
- step S23 the process proceeds directly from step S23 to step S25.
- FIG. 11 is another flowchart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
- controlling the fill light to adjust the initial brightness in step 24 includes:
- Step S241' Divide the brightness of the fill light into multiple levels from zero to the maximum
- Step S242' Decrease or increase the brightness level sequentially from the level corresponding to the initial brightness.
- the brightness of the fill light can be divided into multiple levels from zero to the maximum brightness of the rated power, and the levels can be adjusted by controlling the duty cycle of the pulse width modulation signal, for example, the brightness from zero to the maximum brightness of the rated power can be divided into is 10 levels, the maximum brightness corresponds to the duty cycle of the pulse width modulation signal is 100%, the brightness is 0 corresponds to the duty cycle of the pulse width modulation signal is 0%, then the first level corresponds to the duty cycle of the pulse width modulation signal is 10%, and so on.
- the initial brightness may correspond to the fifth level, that is, the duty cycle corresponding to the PWM signal is 50%, and the level may be increased or decreased in turn according to whether the image is overexposed or too dark, such as increasing to the duty cycle corresponding to the PWM signal.
- the sixth level with a ratio of 60% can be adjusted in this way to speed up the adjustment of the brightness of the fill light, thereby speeding up the response of subsequent image recognition.
- FIG. 12 is a further flowchart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
- the fill light method can also include:
- Step S243' after reducing or increasing the initial brightness each time, acquire the image of the cleaning area in the dishwasher again;
- Step S244' Circularly perform grayscale histogram statistics on the image, and when the ratio is between the first proportional threshold and the second proportional threshold, determine the current initial brightness as the target fill light brightness.
- the image acquisition device is controlled to acquire the image again, and the process jumps to step S23 again until the image is not overexposed or too dark, at which time the currently adjusted initial brightness is used as the target fill light brightness.
- step S26 is a flowchart of step S26 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
- the target fill light brightness is used as the next initial brightness default value including:
- Step S261 record the target fill light brightness and the adjustment time corresponding to the target fill light brightness
- Step S262 take the target fill light brightness as the default initial brightness value corresponding to the next adjustment time.
- this step mainly considers that when users use the dishwasher, they usually place the dishwasher in a fixed position. In most cases, the lighting environment of the same position is the same. Based on this feature, By recording the target brightness value and the adjustment time corresponding to the target fill light brightness, such as 100cd/ m2 and 12:00, 150cd/ m2 and 9:00, the next time the dishwasher is used, if the user uses the washing machine at 9:00 In the bowl machine, the default value of the initial brightness of the fill light is the target fill light brightness corresponding to the last time, that is, 150cd/m 2 .
- steps S21 to S23 if the fill light is the initial brightness
- the images captured under the default value are not overexposed or too dark, so there is no need to adjust, thereby reducing the time to obtain a suitable image, and the fill light does not need to be adjusted multiple times, which can save energy and be more intelligent.
- the fill light method controls the fill light to fill light with the initial brightness and acquires an image of the cleaning area, and adjusts the output brightness of the fill light to a certain level by making statistics on the grayscale histogram of the image. Determine the appropriate target fill light brightness, and finally achieve that the image is not overexposed and not too dark.
- the target fill light brightness as the next initial brightness default value
- the number of times the dishwasher adjusts the brightness of the fill light can be reduced, thereby reducing the time to obtain a suitable image, saving energy consumption, and speeding up the response of image recognition.
- the third embodiment of the present application also provides a light supplement method for a dishwasher, which can perform more energy-efficient and fast supplement light for the cleaning area in the dishwasher.
- Existing dishwashers generally include lighting lamps, and when a user opens the door of the dishwasher, the lighting lamps are automatically turned on to facilitate the user to place tableware.
- Some dishwashers are also equipped with a fill light, but the fill light and the lighting only realize the switch function, and the brightness cannot be adjusted linearly. Therefore, the brightness provided by the lighting lamp and the fill light is a fixed brightness, and cannot be adjusted intelligently and adaptively according to the actual brightness of the washing area inside the dishwasher. Therefore, whether it is day or night, its brightness is the same, and the lack of intelligence leads to poor user use.
- FIG. 14 exemplarily shows a schematic structural diagram of a light-filling device for a dishwasher to which the light-filling method for a dishwasher provided according to the third embodiment of the present application is applied.
- the light-filling device may include: :
- the image acquisition device 11 is used to acquire the image of the cleaning area in the dishwasher 100;
- the fill light 12 is used to emit light to the cleaning area to fill the image collected by the image acquisition device 11;
- the lighting lamp 13 is used for emitting light to the cleaning area to achieve lighting effect.
- the processor (not shown) is electrically connected to the fill light 12 and the lighting lamp 13 for controlling the fill light 12 and the lighting lamp 13 to emit light.
- the light 13 and the fill light 12 may be located on the same side of the interior space of the dishwasher.
- the illumination light 13 and the supplementary light 12 may be located on different sides to provide illumination from multiple directions, so as to facilitate the image capturing device 11 to obtain a more complete and clearer image.
- the fill light 12 can be in the shape of a ring, and is arranged around the image capture device 11 to facilitate lead wires, and the number of openings in the inner wall of the dishwasher can also be reduced, thereby increasing the washing area of the dishwasher Space.
- FIG. 15 is a flowchart of a light supplement method for a dishwasher provided by a third embodiment of the present application.
- the dishwasher includes a fill light and an illuminating lamp for fill light in the cleaning area, the dishwasher further includes a cabinet door, and the fill light method includes:
- Step S31 determine the opening and closing state of the cabinet door
- Step S32 when the open and closed state is determined to be that the cabinet door is opened, the lighting lamp is controlled to be turned on, and the supplementary light is controlled to be turned off.
- Step S33 acquiring the first image of the cleaning area
- Step S34 obtaining the first brightness value of the first image according to the first image
- Step S35 determining the fill light brightness required by the fill light according to the first brightness value
- Step S36 controlling the fill light to fill the cleaning area with the required fill light brightness
- Step S37 acquiring a second image of the cleaning area after the supplementary light
- Step S38 determining a second brightness value according to the second image
- Step S39 when the second brightness value is outside the preset brightness value range, control the fill light to perform secondary adjustment on the fill light brightness.
- the opening and closing state of the cabinet door may be detected by arranging a limiter or a displacement sensor at the cabinet door.
- the opening and closing status of the cabinet door detected by the limiter or displacement sensor can be read. If the cabinet door is opened, it can be considered that the user places tableware in the washing area.
- the supplementary light can be controlled to keep off, and the lighting lamp can be controlled to be turned on, so as to illuminate the cleaning area and facilitate the user to place the tableware.
- a first image of the cleaning area is acquired under the condition that the fill light is kept off.
- the first image may be acquired by an image acquisition device (eg, a camera).
- the first luminance value of the first image may be obtained according to the first image.
- the first luminance value may be an average luminance of pixels in the first image.
- the fill light brightness required by the fill light lamp may be determined according to the first brightness value.
- the first brightness value may be the brightness value of the image captured under the condition that the supplementary light is not turned on and only relies on the light of the illuminating lamp for illumination.
- the target brightness value can be preset.
- the target brightness value may be the brightness value required to provide ideal illumination.
- the target brightness value can be set according to actual applications or user preferences. Through the difference between the first brightness value and the target brightness value, the fill light brightness required by the fill light lamp can be determined.
- FIG. 16 is a flowchart of step S35 in the light supplement method for a dishwasher provided by the third embodiment of the present application.
- step S35 determining the fill light brightness required by the fill light according to the first brightness value includes:
- Step S331 Divide the fill light brightness of the fill light into multiple levels from zero to the maximum
- Step S332 Determine the difference between the first brightness value and the preset target brightness value
- Step S333 Determine the brightness level of the supplementary light required by the supplementary light according to the difference.
- the brightness of the fill light can be divided into multiple levels from zero to the maximum brightness of the rated power, and the levels can be adjusted by controlling the duty cycle of the pulse width modulation signal provided to the fill light.
- the maximum brightness from zero to rated power can be divided into 10 levels, the maximum brightness corresponds to the duty cycle of the pulse width modulation signal is 100%, the brightness is 0 corresponds to the duty cycle of the pulse width modulation signal is 0%, Then, the duty cycle of the pulse width modulation signal corresponding to the first level may be 10%, and so on.
- the target luminance value may correspond to the fifth level, that is, the duty cycle corresponding to the pulse width modulation signal is 50%.
- the level of the fill light brightness required by the fill light can be determined.
- the level corresponding to the first brightness value is the first level, at this time If the difference from the target brightness value is four levels, the required level of fill light brightness can be four levels.
- step S36 to step S39 control the fill light to turn on and fill the cleaning area with the required fill light brightness.
- a second image of the cleaned area after supplemented light may be acquired, and a second brightness value may be determined according to the second image.
- the second brightness value may be an average brightness value of pixels in the second image. Then, it can be determined whether the second brightness value is within the preset brightness value range, and when the second brightness value is outside the brightness value range, the supplementary light is controlled to perform secondary adjustment of the supplementary light brightness.
- the image acquisition device can be controlled again to obtain the second image, and whether the fill light brightness needs to be determined by judging whether the second brightness value is within the range of brightness values Secondary adjustment.
- the brightness value range may be a brightness value within which the image acquired by the image acquisition device will not be overexposed (overexposed) or too dark.
- an upper luminance value of a range of luminance values may be associated with overexposure, and a lower luminance value may be associated with overdark. If the second brightness value is outside the brightness value range, that is, it is considered that the acquired second image is overexposed or too dark, it is necessary to control the fill light to perform a secondary adjustment of the fill light brightness.
- FIG. 17 is a flowchart of step S38 in the light supplement method for a dishwasher provided by the third embodiment of the present application.
- the range of brightness values in step S38 includes a lower limit value of brightness and an upper limit value of brightness, and when the second brightness value is outside the preset range of brightness values, the fill light is controlled to adjust the brightness of the fill light.
- Making secondary adjustments can include:
- Step S381 when the second brightness value is greater than the upper limit value of brightness, reduce the brightness of the supplementary light;
- Step S382 when the second brightness value is less than the lower limit value of brightness, increase the brightness of the supplementary light.
- the adjustment method may include adjusting the input voltage of the supplementary light.
- the input voltage can be adjusted, for example, by adjusting the duty cycle of the pulse width modulated signal.
- the upper luminance value may be a critical value for determining whether the second image is overexposed, and the lower luminance value may be a critical value for determining whether the second image is too dark.
- reducing the fill light brightness includes sequentially decreasing the fill light brightness levels
- increasing the fill light brightness includes sequentially increasing the fill light brightness levels.
- the level of fill light brightness is decreased in turn.
- the fill light brightness is adjusted to the third level, and the first For the second image, if the second brightness value is still greater than the upper limit of brightness, continue to reduce the brightness of the fill light, and adjust the brightness of the fill light to the second level until the second brightness value is within the range of brightness values.
- the current fill light brightness can be determined. Fill light brightness for the target.
- the supplementary light is controlled to be turned off after a preset first time has elapsed after it is turned on.
- step S38 After finding the target fill light brightness through step S38, wait for the door closing information, and after a preset delay time, turn off the lighting.
- the fill light method on the basis of turning on the lighting lamp to facilitate the user to place tableware, adjusts the fill light brightness of the fill light according to the line of the lighting light, so as to perform the lighting according to the actual brightness of the cleaning area inside the dishwasher.
- Intelligent adaptive adjustment When the user opens the door, the lighting is automatically turned on, which is convenient for the user to place tableware. At the same time, the brightness of the fill light is adjusted according to the brightness of the lighting, which is more intelligent and user-friendly, and can bring users a better experience.
- the fourth embodiment of the present application provides a method for supplementing light for a dishwasher, which can control the brightness of the supplementary light in the dishwasher.
- the lamp beads of the fill light will age, resulting in a weakening of its brightness, so that the image acquired during the image collection will appear too much. dark.
- image recognition it is easy to cause the image to be too dark, and the user feels that the brightness is not enough, which affects the experience of the product.
- the supplementary light method can solve the above problems.
- FIG. 18 is a flowchart of a light supplement method for a dishwasher provided in Embodiment 4 of the present application; in this embodiment of the present application, the light supplement method may include:
- Step S41 when the dishwasher is in the factory state, control the fill light to fill the washing area of the dishwasher with a first brightness corresponding to a preset first duty ratio;
- Step S42 acquiring the first image of the cleaning area
- Step S43 obtaining a first brightness value of the first image according to the first image
- Step S44 when the dishwasher is in the calibration state, control the fill light to fill the washing area of the dishwasher with the second brightness corresponding to the first duty cycle;
- Step S45 acquiring a second image of the cleaning area
- Step S46 obtaining a second brightness value of the second image according to the second image
- Step S47 Determine the difference between the second brightness value and the first brightness value
- Step S48 when the difference is greater than a preset threshold, increase the duty cycle to increase the brightness of the fill light.
- a pulse width modulation (PWM) signal may be used to control the fill light.
- the brightness of the fill light can be controlled by adjusting the duty cycle of the PWM signal.
- the PWM signal can modulate the bias of the transistor base or the gate of the MOS transistor according to the change of the corresponding load, so as to realize the change of the conduction time of the transistor or the MOS transistor, thereby realizing the change of the output of the switching regulated power supply.
- a better brightness of the fill light can be set first, and the brightness can correspond to the duty cycle of the PWM signal (which can be referred to as set the duty cycle or the first duty cycle described above).
- the duty cycle of the PWM signal used to control the fill light can be adjusted to the first duty cycle, so that the fill light can wash dishes at the first brightness corresponding to the first duty cycle. Fill light in the cleaning area of the machine.
- a first image of the cleaning area under the first brightness can be captured by an image acquisition device (eg, a camera), a first brightness value of the first image can be obtained according to the first image, and the above-mentioned data can be saved, for example, referring to the first brightness value , the first duty cycle.
- an image acquisition device eg, a camera
- a first brightness value of the first image can be obtained according to the first image
- the above-mentioned data can be saved, for example, referring to the first brightness value , the first duty cycle.
- the fill light When the dimming calibration of the fill light is required, that is, when the dishwasher is in the calibration state, the fill light can be controlled to be turned on with the same first duty cycle pulse width modulation signal, and the image acquisition device can be started to The cleaning area is photographed and collected to obtain a second image, and a second brightness value of the second image can be obtained according to the second image. The second brightness value is then compared with the first brightness value from the factory. If the difference between the first brightness and the second brightness exceeds a certain threshold, the brightness of the fill light can be adjusted so that the second brightness value reaches the first brightness value.
- the fill light can be controlled to enter the calibration state at a preset first time period and/or when there is no utensils in the washing area.
- the first time period may be, for example, half a year, a year, that is, calibration may be performed every half year or year. It can also enter the calibration state according to the user's own trigger, so as to maintain the fill light.
- the fill light by calibrating the fill light, the brightness difference of the fill light under the same duty cycle of the PWM signal can be obtained, and the fill light can be adaptively adjusted according to the difference, thereby preventing the fill light from being caused by
- the influence of the service life leads to the weakening of its brightness, which affects the subsequent image recognition effect and lighting effect, and brings a better experience to the user.
- obtaining the first brightness value of the first image according to the first image and obtaining the second brightness value of the second image according to the second image can both be weighted and summed or averaged through a statistical grayscale histogram. Brightness value.
- the first luminance value is obtained by weighting and summing the luminance values of each pixel in the grayscale histogram.
- Weighted summation is an averaging method that takes weights into account; usually in a set of data, the number of times a piece of data occurs is called a weight.
- the difference between the first brightness value and the second brightness value is 3. If the preset threshold is 2, and the difference is greater than the threshold at this time, the duty cycle of the pulse width modulation signal can be increased to maximize the brightness of the fill light.
- the manner of increasing the duty cycle may include increasing the duty cycle by a certain percentage at a preset time. For example, every t seconds, the duty cycle of the PWM signal is increased at a rate of 5%, thereby increasing or decreasing the brightness of the fill light.
- the image acquisition device can be controlled to acquire an image again, and the second brightness value of the image can be calculated until the difference between the second brightness value and the first brightness value is smaller than the threshold.
- the supplementary light method for a dishwasher provided by the embodiments of the present application may further include:
- Step S49 In the case that the difference value is smaller than the preset threshold value, determine the second duty ratio currently corresponding to the fill light.
- the second duty cycle does not need to be adjusted, and can be Determine the adjusted second duty cycle.
- FIG. 19 is another flowchart of the light supplement method for a dishwasher provided in Embodiment 4 of the present application. According to the determined second duty cycle, the light supplement method may further include the following steps:
- Step S491 determine the ratio of the second duty cycle to the first duty cycle
- Step S492 Adjust the duty cycle of the fill light and the coefficient of brightness according to the ratio.
- the ratio of the second duty cycle to the first duty cycle if the first duty cycle is 50% and the second duty cycle is 60%, it represents the same brightness. Due to the attenuation of the fill light , brightness that previously only required a 40% duty cycle now requires a 50% duty cycle, a 60/50 ratio of 1.2.
- FIG. 20 is a further flowchart of the light supplement method for a dishwasher provided by the fourth embodiment of the present application;
- the method for supplementing light for a dishwasher is a schematic diagram illustrating step S494.
- the supplementary light method provided in the embodiment of the present application also includes:
- Step S493 Determine the difference between the second duty cycle and the first duty cycle
- Step S494 Determine the service life of the fill light according to the difference.
- the remaining service life of the fill light can be calculated by the following formula: Proportion:
- T is the percentage of the remaining service life of the fill light.
- indication information can be sent to the user.
- Indication information can be sent through indicator lights or other early warning devices, such as buzzers.
- the instruction information can be displayed on the display screen to prompt the user to replace the fill light, or the instruction information can be sent to the user terminal through the wireless network to prompt the user to replace the fill light. In this way, the dishwasher can be maintained and the reliability of the dishwasher can be guaranteed.
- the fill light method controls the fill light of the dishwasher to fill light in the washing area of the dishwasher with the first brightness corresponding to the preset first duty cycle in the factory state of the dishwasher, And carry out image acquisition to obtain the first brightness value.
- the fill light is controlled to fill light with the same duty cycle of the pulse width modulation signal, and image acquisition is performed to obtain the second brightness value. If the difference between the first brightness and the second brightness exceeds a certain threshold, the brightness of the fill light is adjusted until the first brightness value is reached.
- the fill light By calibrating the fill light in this way, the brightness difference of the fill light under the same duty cycle of the PWM signal can be obtained, and the fill light can be adaptively adjusted according to the difference, so as to prevent the fill light due to The influence of the service life will lead to the weakening of its brightness, which will affect the subsequent image recognition effect and lighting effect, and bring a better experience to the user.
- a fifth embodiment of the present application provides a dishwasher, including the light supplementing device described in the foregoing embodiments.
- Embodiments of the present application provide a machine-readable storage medium, on which a program is stored, and when the program is executed by a processor, implements a light supplement method for a dishwasher.
- Examples of machine-readable storage media may include memory.
- the memory may include non-persistent memory in a computer readable medium, in the form of random access memory (RAM) or non-volatile memory, such as read only memory (ROM) or flash memory (flash RAM), the memory including at least one memory chip .
- RAM random access memory
- ROM read only memory
- flash RAM flash memory
- Embodiments of the present application provide a processor for running a program, wherein, when the program is executed, the processor is configured to execute the light supplement method for a dishwasher described in the foregoing embodiments.
- Embodiments of the present application further provide a computer program product, including a computer program, when the computer program is executed by a processor, the method for a dishwasher of the foregoing embodiments is implemented.
- a method for supplementing light for a dishwasher includes an image acquisition device for acquiring an image of a washing area in the dishwasher; a main supplementary light for supplementing the image. light; at least one auxiliary fill light, used to fill the edge area of the image; the fill light method includes:
- the first brightness value is within the preset first brightness range, obtain the second brightness value of the edge region of the image according to the image;
- the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
- the supplementary light method further includes:
- the brightness of the main fill light is adjusted to adjust the first brightness value.
- adjusting the brightness of the main fill light to adjust the first brightness value includes:
- the first brightness value is less than the lower limit value of the first brightness range, increase the brightness of the main fill light to increase the first brightness value;
- the brightness of the main fill light is reduced to reduce the first brightness value.
- obtaining the first brightness value of the image according to the image includes:
- the luminance values of each pixel in the luminance histogram are weighted and summed to obtain a first luminance value.
- the at least one auxiliary fill light includes a first auxiliary fill light and a second auxiliary fill light, and the first auxiliary fill light and the second auxiliary fill light are respectively disposed on the left and right sides of the image capturing device. , respectively used to fill the left edge area and right edge area of the image: when the second brightness value is outside the second brightness range, adjusting the brightness of the secondary fill light to adjust the second brightness value includes:
- the brightness of the second auxiliary fill light is adjusted to adjust the second brightness value on the right side.
- obtaining the second brightness value of the edge region of the image according to the image includes:
- the second brightness value is the average value of the brightness values of the edge regions.
- the main fill light and the auxiliary fill light are individually controlled through different pulse width modulation signals.
- a supplementary light device for a dishwasher comprising:
- Image acquisition equipment for acquiring images of the washing area of the dishwasher
- the main fill light which is set around the image acquisition device, is used to fill light in the area corresponding to the central area of the image in the cleaning area;
- At least one auxiliary supplementary light which is arranged on at least one side of the main supplementary light, is used for supplementing light in the area corresponding to the edge area of the image in the cleaning area;
- the processor configured as:
- the first brightness value is within the preset first brightness range, obtain the second brightness value of the edge region of the image according to the image;
- the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
- the processor is further configured to:
- the brightness of the main fill light is adjusted to adjust the first brightness value.
- the processor being configured to adjust the brightness of the main fill light to adjust the first brightness value includes the processor being configured to:
- the first brightness value is less than the lower limit value of the first brightness range, increase the brightness of the main fill light to increase the first brightness value;
- the brightness of the main fill light is reduced to reduce the first brightness value.
- the processor is configured to obtain the first luminance value of the image from the image and is configured to:
- the luminance values of each pixel in the luminance histogram are weighted and summed to obtain a first luminance value.
- the at least one auxiliary fill light includes:
- the first pair of fill light is set on the left side of the image acquisition device
- the second supplementary light is set on the right side of the image acquisition device
- the processor is configured to adjust the brightness of the secondary fill light to adjust the second brightness value when the second brightness value is not located in the second brightness range.
- the processor is configured to:
- the brightness of the second auxiliary fill light is adjusted to adjust the second brightness value on the right side.
- the processor being configured to obtain the second luminance value of the edge region of the image comprises the processor being configured to:
- the second brightness value is the average value of the brightness values of the edge regions.
- the supplementary light device further includes:
- the first pulse width modulation device is electrically connected to the main fill light, and is used to adjust the brightness of the main fill light by controlling the duty ratio;
- the second pulse width modulation device is electrically connected to the first auxiliary light and is used for adjusting the brightness of the first auxiliary light by controlling the duty ratio;
- the third pulse width modulation device is electrically connected to the second supplementary light, and is used for adjusting the brightness of the second supplementary light by controlling the duty ratio.
- a dishwasher includes the above-mentioned light-filling device for a dishwasher.
- a machine-readable storage medium having instructions stored on the machine-readable storage medium for enabling the processor to execute the above-mentioned fill light for dishwashers when executed by the processor method.
- a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a dishwasher.
- a method for supplementing light for a dishwasher includes a supplementary light for supplementing light in a washing area of the dishwasher, and the method for supplementing light includes:
- performing gray histogram statistics on the image to determine whether the image is too dark or overexposed includes:
- the ratio is less than the first ratio threshold, it is determined that the image is too dark
- controlling the fill light to adjust the initial brightness includes:
- controlling the fill light to adjust the initial brightness includes:
- using the target fill light brightness as the next initial brightness default value includes:
- the brightness of the fill light is adjusted by adjusting the duty cycle of the pulse width modulation signal.
- a supplementary light device for a dishwasher comprising:
- an image acquisition element configured to acquire images of the wash area of the dishwasher
- the processor configured as:
- the processor is configured to perform grayscale histogram statistics on the image to determine whether the image is too dark or overexposed, comprising the processor being configured to:
- the ratio is less than the first ratio threshold, it is determined that the image is too dark
- the processor is configured to control the fill light to adjust the initial brightness when the image is overexposed or too dark.
- the processor is configured to:
- the processor being configured to control the fill light to adjust the initial brightness includes the processor being configured to:
- configuring the processor to use the target fill light brightness as the next initial brightness default value includes that the processor is configured to:
- the supplementary light device further includes:
- the pulse width modulation signal adjustment device is used for adjusting the duty ratio of the pulse width modulation signal input to the fill light, so as to adjust the brightness of the fill light.
- a dishwasher includes the above-mentioned light-filling device for a dishwasher.
- a machine-readable storage medium having instructions stored on the machine-readable storage medium is used to enable the processor to perform the above-mentioned fill light for the fill light when executed by the processor. method.
- a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a supplementary light.
- a method for supplementing light for a dishwasher includes: a lighting lamp for illuminating a cleaning area; a supplementary light for supplementing the cleaning area in the dishwasher.
- Light; fill light methods include:
- the lighting lamp is controlled to be turned on, and the fill light is turned off;
- the fill light is controlled to adjust the fill light brightness twice.
- the supplementary light method further includes:
- the first brightness value is an average brightness value of pixels in the first image
- the second brightness value is an average brightness value of pixels in the second image
- determining the fill light brightness required by the fill light according to the first brightness value includes:
- the brightness value range includes an intensity lower limit value and an intensity upper limit value
- the fill light is controlled to perform secondary adjustment on the fill light brightness.
- the brightness of the fill light is increased.
- reducing the brightness of the supplementary light includes: sequentially decreasing the level of the brightness of the supplementary light; increasing the brightness of the supplementary light includes: sequentially increasing the level of the brightness of the supplementary light.
- a supplementary light device for a dishwasher comprising:
- the displacement sensor is used to obtain the opening and closing status of the cabinet door according to the displacement of the cabinet door;
- an image capture device for capturing images of the washing area within the dishwasher
- Illuminators for illuminating the wash area
- the processor configured as:
- the lighting lamp is controlled to be turned on, and the fill light is turned off;
- the supplementary light is controlled to perform a secondary adjustment of the supplementary light brightness.
- the first brightness value is an average brightness value of pixels in the first image
- the second brightness value is an average brightness value of pixels in the second image
- the processor being configured to determine the fill light brightness required by the fill light according to the first brightness value includes the processor being configured to:
- the brightness value range includes an intensity lower limit value and an intensity upper limit value
- the processor is configured to control the fill light to fill light when the second brightness value is outside the preset brightness value range.
- the secondary adjustment of brightness includes including the processor being configured to:
- the brightness of the fill light is increased.
- the processor being configured to reduce the fill light brightness includes the processor being configured to: sequentially reduce the fill light brightness levels;
- the processor being configured to increase the brightness of the fill light includes the processor being configured to: sequentially increase the level of the brightness of the fill light.
- a dishwasher includes the above-mentioned light-filling device for a dishwasher.
- a machine-readable storage medium having instructions stored on the machine-readable storage medium for enabling the processor to execute the above-mentioned fill light for dishwashers when executed by the processor method.
- a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a dishwasher.
- a method for supplementing light for a dishwasher the brightness of the supplementary light is adjusted by adjusting the duty cycle of a pulse width modulation signal, and the supplementary light method includes:
- the fill light is controlled to fill the washing area of the dishwasher with the first brightness corresponding to the preset first duty ratio
- the first duty cycle is increased to increase the second brightness.
- the method for supplementing light further includes:
- the second duty ratio corresponding to the current second brightness is determined.
- the supplementary light method further includes:
- the supplementary light method further includes:
- the method for supplementing light further includes: in the case that the service life is less than a preset service life threshold, sending indication information to the user.
- the method for supplementing light further includes: controlling the supplementary light to enter a calibration state within a preset first time period and/or when there is no tableware in the washing area.
- a supplementary light device for a dishwasher comprising:
- an image acquisition element configured to acquire images of the wash area within the dishwasher
- a pulse width modulation signal conditioning device for controlling the duty cycle of the pulse width modulation signal input to the fill light
- the processor configured as:
- the fill light is controlled to fill the washing area of the dishwasher with the first brightness corresponding to the preset first duty ratio
- the first duty cycle is increased to adjust the second brightness.
- the processor is further configured to: determine a second duty cycle corresponding to the current second brightness when the difference is less than a preset threshold.
- the processor is further configured to:
- the processor is further configured to: send indication information to the user when the service life is less than a preset lifespan threshold.
- the processor is further configured to: control the fill light to be in a calibration state for a preset first time period and/or when there is no tableware in the washing area.
- a dishwasher includes the above-mentioned light-filling device for a dishwasher.
- a machine-readable storage medium having instructions stored on the machine-readable storage medium for enabling the processor to execute the above-mentioned fill light for dishwashers when executed by the processor method.
- a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a dishwasher.
- the embodiments of the present application may be provided as a method, a system, or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
- computer-usable storage media including, but not limited to, disk storage, CD-ROM, optical storage, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
一种用于洗碗机的补光方法、补光装置以及洗碗机(100),洗碗机(100)包括图像采集设备(11),用于采集洗碗机(100)内的清洗区域的图像;主补光灯(121),用于对图像进行补光;至少一个副补光灯(122),用于对图像的边缘区域进行补光;补光方法包括:获取图像(S11);根据图像得到图像的第一亮度值(S12);在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值(S13);在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯(122)的亮度以调节第二亮度值(S14)。
Description
相关申请的交叉引用
本申请要求2021年01月19日提交的中国专利申请202110071269.9,202110069559.X,202110071263.1以及202110071265.0的权益,该申请的内容通过引用被合并于本文。
本申请涉及厨卫电器技术领域,具体涉及一种用于洗碗机的补光方法、补光装置以及洗碗机。
随着生活水平的提高,洗碗机的使用越来越多。智能化的应用越来越广泛,相应的对洗碗机的要求也越来越高。
洗碗机内腔的清洗区域通常设置有补光灯。为了兼顾成本和空间,目前常用的设计方案是将摄像头和补光灯做成一个整体的组件,即内孔是摄像头的开孔,外环则是补光灯的设计。这样既方便引线,也减少开孔的个数。但是这种设计也有缺点,因为它的尺寸不能做的很大,相对于洗碗机内腔来说它的占比太小,就相当于点光源。由于补光灯的结构特性容易导致边缘区域比较暗,从而导致所采集的图像部分信息缺失,最终导致图像识别不精准,达不到用户预期的体验。
发明内容
为解决上述技术问题,本申请的目的是提供一种用于洗碗机的补光方法、补光装置以及洗碗机。
为了实现上述目的,在本申请第一方面,提供一种用于洗碗机的补光方法,洗碗机包括图像采集设备,用于采集洗碗机内的清洗区域的图像;主补光灯,用于对图像进行补光;至少一个副补光灯,用于对图像的边缘区域进行补光;补光方法包括:获取图像;根据图像得到图像的第一亮度值;在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。
在本申请实施例中,还包括:在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。
在本申请实施例中,在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值包括:在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。
在本申请实施例中,根据图像得到图像的第一亮度值包括:获取图像的亮度直方图;对亮度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。
在本申请实施例中,至少一个副补光灯包括第一副补光灯和第二副补光灯,第一副补光灯和第二副补光灯分别设置于图像采集设备的左右两侧,分别用于对图像的左边缘区域和右边缘区域进行补光:在第二亮度值位于第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值包括:在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯的亮度以调节左侧第二亮度值;在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯的亮度以调节右侧第二亮度值。
在本申请实施例中,根据图像得到图像的边缘区域的第二亮度值包括:将图像分割成 多个区域;根据主补光灯的视场角提取多个区域中的边缘区域;确定边缘区域的第二亮度值;其中第二亮度值为边缘区域的亮度值的平均值。
在本申请实施例中,主补光灯和副补光灯分别通过不同的脉冲宽度调制信号单独控制。
在本申请第二方面,还提供一种用于洗碗机的补光装置,包括:图像采集设备,用于获取清洗区域的图像;主补光灯,环绕图像采集设备设置,用于对清洗区域中与图像的中心区域对应的区域进行补光;至少一个副补光灯,设置于主补光灯的至少一侧,用于对清洗区域中与图像的边缘区域对应的区域进行补光;处理器,被配置成:获取图像;根据图像得到图像的第一亮度值;在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。
在本申请实施例中,处理器还被配置成:在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。
在本申请实施例中,处理器被配置成调节主补光灯的亮度以调节第一亮度值包括处理器被配置成:在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。
在本申请实施例中,处理器被配置成根据图像得到图像的第一亮度值被配置成:获取图像的亮度直方图;对亮度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。
在本申请实施例中,补光装置包括:第一副补光灯,设置于图像采集设备的左侧;第二副补光灯,设置于图像采集设备的右侧;处理器被配置成在第二亮度值不位于第二亮度范围的情况下,调节副补光灯的亮度以调节第二亮度值包括处理器被配置成:在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯的亮度以调节左侧第二亮度值;在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯的亮度以调节右侧第二亮度值。
在本申请实施例中,处理器被配置成获取图像的边缘区域的第二亮度值包括处理器被配置成:将图像分割成多个区域;根据主补光灯的视场角,提取多个区域中的边缘区域;确定边缘区域的第二亮度值;其中第二亮度值为边缘区域的亮度值的平均值。
在本申请实施例中,还包括:第一脉冲宽度调制设备,电性连接主补光灯,用于通过控制占空比调节主补光灯的亮度;第二脉冲宽度调制设备,电性连接第一副补光灯,用于通过控制占空比调节第一副补光灯的亮度;第三脉冲宽度调制设备,电性连接第二副补光灯,用于通过控制占空比调节第二副补光灯的亮度。
在本申请第三方面,提供一种洗碗机,包括上述的用于洗碗机的补光装置。
在本申请第四方面,提供一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于洗碗机的补光方法。
在本申请第五方面,提供一种计算机程序产品,包括计算机程序,其特征在于,计算机程序在被处理器执行时实现上述的用于洗碗机的补光方法。
通过上述技术方案,本申请实施例所提供的补光方法通过采用副补光灯对洗碗机的清洗区域进行补光,解决现有技术下采用补光灯环绕图像采集设备设计下所存在的边缘区域较暗的问题,通过获取清洗区域的图像,先根据图像获取图像的第一亮度值,在第一亮度值满足位于预设的第一亮度范围内的情况下,对边缘区域的亮度进行评估,即获取第二亮度值,在第二亮度值位于预设的第二亮度范围之外的情况下,通过副补光灯的亮度调节第二亮度值,从而提高图像的亮度均衡性,使得图像识别的信息不缺失,提高图像识别的精度,提高用户的体验。
本申请实施例的其它特征和优点将在随后的具体实施方式部分予以详细说明。
附图是用来提供对本申请实施例的进一步理解,并且构成说明书的一部分,与下面的具体实施方式一起用于解释本申请实施例,但并不构成对本申请实施例的限制。在附图中:
图1示意性示出了传统情况下洗碗机的结构示意图;
图2示意性示出根据本申请第一实施例所提供的用于洗碗机的补光方法所应用的洗碗机补光装置的结构示意图;
图3为本申请第一实施例所提供的用于洗碗机的补光方法的流程图;
图4为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S12的流程图;
图5为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S15的流程图;
图6为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S13的流程图;
图7为本申请第一实施例所提供的用于洗碗机的补光方法中为示例性演示步骤S13的示意图;
图8为本申请第二实施例所提供的用于洗碗机的补光方法的流程图;
图9为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S23的流程图;
图10为本申请第二实施例所提供的用于洗碗机的补光方法的流程图;
图11为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S24的另一流程图;
图12为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S24进一步的流程图;
图13为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S26的流程图;
图14示意性示出根据本申请第三实施例所提供的用于洗碗机的补光方法应用的洗碗机补光装置的结构示意图;
图15为本申请第三实施例所提供的用于洗碗机的补光方法的流程图;
图16为本申请第三实施例所提供的用于洗碗机的补光方法中步骤S35的流程图;
图17为本申请第三实施例所提供的用于洗碗机的补光方法中步骤S38的流程图;
图18为本申请第四实施例所提供的用于洗碗机的补光方法的流程图;
图19为本申请第四实施例所提供的用于洗碗机的补光方法的另一流程图;
图20为本申请第四实施例所提供的用于洗碗机的补光方法的进一步的流程图;以及图21是本申请第四实施例所提供的用于洗碗机的补光方法中为演示步骤S494的示意图。
附图标记说明
1、补光装置; 11、图像采集设备;
12、补光灯; 121、主补光灯;
122、副补光灯; 13、照明灯。
以下结合附图对本申请实施例的具体实施方式进行详细说明。应当理解的是,此处所描述的具体实施方式仅用于说明和解释本申请实施例,并不用于限制本申请实施例。
以下结合附图对本申请实施例的具体实施方式进行详细说明。应当理解的是,此处所描述的具体实施方式仅用于说明和解释本申请实施例,并不用于限制本申请实施例。
需要说明,本申请实施例中所有方向性指示(诸如上、下、左、右、前、后……)仅用于解释在某一特定姿态(如附图所示)下各部件之间的相对位置关系、运动情况等,如果该特定姿态发生改变时,则该方向性指示也相应地随之改变。
另外,在本申请中涉及“第一”、“第二”等的描述仅用于描述目的,而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、 “第二”的特征可以明示或者隐含地包括至少一个该特征。另外,全文中出现的“或”的含义为,包括三个并列的方案,以“A或B”为例,包括A方案,或B方案,或A和B同时满足的方案。另外,各个实施例之间的技术方案可以相互结合,但是必须是以本领域普通技术人员能够实现为基础,当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在,也不在本申请要求的保护范围之内。
本申请实施例提供一种用于洗碗机的补光和图像识别方案,该方案包括多个实施例,分别包括对洗碗机中清洗区域的图像获取,图像的判别,以及控制补光灯进行补光等多个方面,以下具体阐述本申请实施例中的各个方面。
本申请第一实施例提供一种用于洗碗机的补光方法,其可以对洗碗机内的清洗区域进行补光以更好地获取图像,该方法旨在解决现有的洗碗机采用环绕图像采集设备的补光灯在进行补光时,由于补光灯的结构特征容易导致边缘区域比较暗的问题。该问题会导致采集的图像部分信息缺失,最终图像识别的过程不精准,达不到用户预期的体验。
请参阅图1,图1示意性示出了传统情况下洗碗机的结构示意图。洗碗机100包括图像采集设备11以及补光灯12。在现有技术中,为了兼顾成本和空间以及设计上的复杂度,洗碗机100中最常见的设计方案是图像采集设备11和补光灯12做成一个整体的环状组件。这样既方便引线,也可以减少在洗碗机100内壁开孔的个数。如图1中所示,内孔是图像采集设备11的开孔,外环则是补光灯12。但是这种设计也有缺点,因为它的尺寸不能像矩形补光灯一样设计较大,相对于洗碗机100的内腔(清洗区域)来说补光灯12的占比很小,此时补光灯12就相当于点光源。因为光线相对于物体是有入射角度(视场角)而非平行光线,但是图像采集设备11采集的是清洗区域的整体图像,这种补光方式会使得所采集的清洗区域的图像中被补光灯11所覆盖的中心区域会比中心区域外围的边缘区域要亮,也就是中心区域比边缘区域要亮。如果在边缘区域放置有餐具,图像采集设备11可能不能很好地采集到边缘区域的图像,会导致采集的图像部分信息缺失。
请参阅图2,图2示意性示出了根据本申请第一实施例所提供的用于洗碗机的补光方法应用的洗碗机的补光装置的结构示意图。洗碗机100的补光装置1可以包括:
图像采集设备11,用于采集洗碗机100内清洗区域的图像;
主补光灯121,用于向清洗区域发射光线,以对洗碗机100的清洗区域进行补光;具体地,主补光灯121用于对清洗区域中与图像采集设备11采集的图像的中心区域对应的区域(可以称为中心区域)进行补光;
至少一个副补光灯122,用于向清洗区域的边缘发射光线,以对清洗区域中与图像采集设备11采集的图像的边缘区域对应的区域(可以称为边缘区域)进行补光。边缘区域可以是中心区域的外围区域。
在一个示例中,主补光灯121可以环绕图像采集设备11设置,副补光灯122可以设置于主补光灯121的一侧。
本申请实施例所提供的一个总发明构思在于在主补光灯121的周边再增加副补光灯122,使得清洗区域未被主补光灯121光线所覆盖较暗的边缘区域变亮。在本申请实施例中,副补光灯122数量可以不予限定,副补光灯122越多,光照就会越均匀。副补光灯122可以与图像采集设备11朝向同一个方向。在一个示例中,图像采集设备11可以在内腔的4个侧面上。
在可选的实施例中,图像采集设备11可以包括可见光摄像头;主补光灯121和副补光灯122可为白光灯。为满足夜晚的清晰度,图像采集设备11可以为红外摄像头,主补光灯121和副补光灯122可以为红外补光灯。可选地,本实施例所阐述所适用的图像采集设备11采用可见光摄像头以及主补光灯121和副补光灯122采用白光灯。
在一个示例中,补光装置1可以包括:
第一副补光灯122a,设置于图像采集设备的左侧;
第二副补光灯122b,设置于图像采集设备的右侧。
可以理解,通过第一副补光灯122a和第二副补光灯122b可以对边缘区域进行补光,其中第一副补光灯122a和第二副补光灯122b可以相对于图像采集设备11间隔设置,以防止第一副补光灯122a和第二副补光灯122b的光线和主补光灯121的光线产生过多干涉。
请参阅图3,图3为本申请第一实施例所提供的用于洗碗机的补光方法的流程图;基于以上实施例描述的洗碗机的结构,本申请实施例所提供的补光方法可以包括:
步骤S11:获取图像;
步骤S12:根据图像得到图像的第一亮度值;
步骤S13:在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;
步骤S14:在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。
具体地,首先初始化图像采集设备,等待触发采集图像采集设备进行采集的信号。在接收到信号后图像采集设备获取清洗区域的图像后,可以根据图像计算图像的第一亮度值。可以对图像进行亮度的分布评估,然后对图像的第一亮度值进行评估,当第一亮度值在预设的第一亮度范围内时,再根据边缘区域的第二亮度值和第二亮度范围进行判定,在第二亮度值位于预设的第二亮度范围之外时,调节副补光灯的亮度以调节第二亮度值。
第一亮度范围可以理解为图像在该第一亮度范围内既处于不整体过曝,也不整体过暗。第一亮度范围可以根据需求来设定。假定过暗的第一亮度阈值为d1,过曝的第二亮度阈值为d2,即当图像的亮度小于第一亮度阈值d1时,则图像整体过暗,当亮度大于第二亮度阈值d2时,此时图像整体过曝。此时第一亮度范围即为d1至d2。在第一亮度值位于预设的第一亮度范围内时,仅认为此时图像整体没有过曝或者过暗,但是由于上述的主补光灯121的结构设计,在无法被主补光灯121所覆盖的边缘区域还是会局部过暗。
可以理解,可以将清洗区域分为能被主补光灯覆盖的区域(例如,中心区域)以及不能被主补光灯覆盖的边缘区域。可以对能被主补光灯所覆盖的区域的整体的图像进行判别,在整体的图像的第一亮度值满足条件的情况下,再对图像中的边缘区域进行判别是否需要对边缘区域进行补光。
请参阅图4,图4为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S12的流程图。步骤S12中根据图像得到图像的第一亮度值可以包括:
步骤S121:获取图像的灰度直方图;
步骤S122:对灰度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。
具体地,可以对整体的图像进行灰度直方图统计,其中“灰度直方图”是反映一幅图像中各灰度级像素出现的频率与灰度级的关系。以灰度级为横坐标,频率为纵坐标,绘制频率与灰度级的关系图。通常情况下,灰度直方图起始灰度设为0,直方图x轴代表0~255的灰度值,即可以代表亮度值,直方图y轴代表对应亮度值的像素数,灰度级为灰度值的等级划分,其表示了精密程度,如8级,16级,32级。本实施例中可以为256级,因此灰度值有0~255的区间范围。可以理解,设置直方图每个间隔代表的灰度范围,表示要图像灰度范围上的间隔数目,也可以理解为直方图一维数组的维数。
得到直方图后,进入步骤S122:对灰度直方图中各个像素的亮度值进行加权求和以得到第一亮度值。加权求和包括将权重计算在内的平均方法;通常在一组数据里,一个数据出现的次数称为权。具体方式如下:根据直方图中每个亮度值(灰度值)给予不同的权值;然后就将权值和落在该区域的像素数相乘,并把所有结果相加,即可得到上述的第一亮度值;例如,亮度值250对应权值1,亮度值100对应权值0.3。如果一张图像仅仅在亮度值250 和亮度值100处分别有10个像素点,则第一亮度值为10*1+0.3*10=13。如果第一亮度范围为8到12,则此时图像整体过曝。
需要说明的是,步骤S12所得到的第一亮度值仅为判断整体图像的一个亮度参考值,可以通过其他方式进行计算,如求取各个区域亮度值的平均值,可以通过对图像的L分量进行两次mean运算,以得到第一亮度值,这些均属于本申请实施例所涵盖的保护范围。
在一些实施例中,如果图像较小难以统计直方图,即为了使其能够最大程度地显示出图像,可通过imresize(imresize:缩放处理)先将图像变成其整数倍的图像以便于图像被识别。
进一步地,该补光方法还包括:步骤S15:在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。
如果图像的第一亮度值在第一亮度范围之内,可以计算图像整体的第一亮度值,在第一亮度值在第一亮度范围内则可以判别边缘区域。如果第一亮度值位于第一亮度范围之外,则可以继续调整主补光灯的亮度,直至第一亮度值落入第一亮度范围。
请参阅图5,图5为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S15的流程图。在步骤15中在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值包括:
步骤S151:在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;
步骤S152:在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。
可以理解,步骤S151至步骤S152中,当图像过曝或者过暗时,通过调整主补光灯的亮度,对整体图像进行补光或者减光,其中调整的方式可以是调节主补光灯的输入电压或者调整用于控制主补光灯的脉冲宽度调制信号的占空比。
请参阅图6以及图7,图6为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S13的流程图;图7为本申请第一实施例所提供的用于洗碗机的补光方法中示例性演示步骤S13的示意图。步骤S13中根据图像得到图像的边缘区域的第二亮度值包括:
步骤S131:将图像分割成多个区域;
步骤S132:根据主补光灯的视场角提取多个区域中的边缘区域;
步骤S133:确定边缘区域的第二亮度值。
可以理解,通过图像分割将图像分割成多个区域,根据主补光灯的视场角,确定主补光灯所能覆盖的范围(可以根据主补光灯单独点亮后,获取清洗区域的图像,从而得到主补光灯所能覆盖的范围),将根据主补光灯覆盖的范围所在的区域从整个区域(多个区域)中剔除,从而提取出多个边缘区域。继而统计边缘区域的第二亮度值。
同样地,第二亮度值可以是对边缘区域中的每个区域的亮度值进行加权求和,然后计算边缘区域的平均值。
随后执行步骤S14:在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。
以第一副补光灯122a和第二副补光灯122b为示例,第一副补光灯122a和第二副补光灯122b分别设置于图像采集设备的左右两侧,分别用于对图像的左边缘区域和右边缘区域进行补光。在第二亮度值位于第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值包括:在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯122a的亮度以调节左侧第二亮度值;在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯122b的亮度以调节右侧第二亮度值。这里,左侧第二亮度值可以指左边缘区域的第二亮度值,右侧第二亮度值可以指右边缘区域的第二亮度 值。
其中,调节的方式可以包括:如果左侧第二亮度值位于第二亮度范围之外,在左侧第二亮度值小于第二亮度范围的下限值的情况下,增加第一副补光灯122a的亮度,在左侧第二亮度值大于第二亮度范围的下限值的情况下,减少第一副补光灯122b的亮度。同样地,右侧的第二副补光灯122b可以根据右侧第二亮度值和第二亮度范围进行调节,从而保持边缘区域的第二亮度值保持不过暗并且不过曝。
进一步地,本申请实施例中主补光灯和副补光灯分别通过不同的脉冲宽度调制信号单独控制,并通过控制脉冲宽度调制信号的占空比来控制亮度。
可以理解,脉冲宽度调制信号简称为PWM信号,其根据相应载荷的变化来调制晶体管基极或MOS管栅极的偏置,来实现晶体管或MOS管导通时间的改变,从而实现开关稳压电源输出的改变。占空比是指高电平在一个周期之内所占的时间比率,例如,周期T=64us,脉冲宽度D=32us,则占空比=D/T=32/64=50%,脉冲宽度调整就是占空比的调整,通过单独控制主补光灯和副补光灯,从而实现对清洗区域的多个区域进行调节。
本申请实施例还提供一种用于洗碗机的补光装置,该补光装置包括图像采集设备,主补光灯,至少一个副补光灯,及处理器。
其中,图像采集设备用于获取洗碗机的清洗区域的图像,主补光灯环绕图像采集设备设置,用于对图像进行补光,至少一个副补光灯,设置于主补光灯的至少一侧,用于对图像的边缘区域进行补光。处理器被配置成执行上述实施例的补光方法的全部步骤或者部分步骤。
在一个实施例中,可选地,至少一个副补光灯包括:第一副补光灯,设置于图像采集设备的左侧;第二副补光灯,设置于图像采集设备的右侧。
在一个实施例中,该补光装置还包括独立设置的第一脉冲宽度调制设备,电性连接主补光灯,用于通过控制占空比调节主补光灯的亮度;第二脉冲宽度调制设备,电性连接第一副补光灯,用于通过控制占空比调节第一副补光灯的亮度;第三脉冲宽度调制设备,电性连接第二副补光灯,用于通过控制占空比调节第二副补光灯的亮度。通过独立设置的第一脉冲宽度调制设备、第二脉冲宽度调制设备、第三脉冲宽度调制设备,以实现对主补光灯、第一副补光灯、第二副补光灯分别独立的亮度控制。
综上,本申请实施例所提供的补光方法通过采用副补光灯对洗碗机的清洗区域进行补光,解决现有技术中采用补光灯环绕图像采集设备设计所存在的边缘区域较暗的问题,通过获取清洗区域的图像,先根据图像获取图像的第一亮度值,在第一亮度值位于预设的第一亮度范围内的情况下,对边缘区域的亮度进行评估,即获取第二亮度值,在第二亮度值位于预设的第二亮度范围之外的情况下,通过副补光灯的亮度调节第二亮度值,从而提高图像的亮度均衡性,使得图像识别的信息不缺失,提高图像识别的精度,从而提高用户的体验。
本申请第二实施例提供一种用于洗碗机的补光方法,其可以对洗碗机内的清洗区域进行补光且更快更节能。由于现有的洗碗机为了成本考虑,洗碗机的摄像头一般都是使用普通功能的摄像头,不带AI自动调焦以及曝光自适应算法。实现图像识别通常采用图像处理技术对图像进行微调,如图像亮度均衡调节,使得图像的亮度更为均衡以防止过曝或者过暗,但是对图像采用的处理技术往往容易失真从而导致效果不佳,且并不能适应所有的环境,特别是洗碗机内腔为封闭环境,如用户将洗碗机摆放在光线较差的环境时,图像处理很难达到预期的效果,达不到用户预期的体验。
由此,本申请实施例为解决上述问题,提供一种用于洗碗机的补光方法,洗碗机包括补光灯,用于对洗碗机的清洗区域进行补光。请参阅图8,图8为本申请第二实施例所提供的用于洗碗机的补光方法的流程图。该补光方法可以包括:
步骤S21:控制补光灯以初始亮度进行补光;
步骤S22:获取洗碗机内清洗区域的图像;
步骤S23:对图像进行灰度直方图统计,以确定图像是否过暗或者过曝;
步骤S24:在图像过曝或过暗的情况下,控制补光灯调节初始亮度;
步骤S25:在图像没有过曝或过暗的情况下,确定当前的初始亮度为目标补光亮度;
步骤S26:将目标补光亮度作为下一次的初始亮度默认值。
具体地,在步骤S21中,首先通过控制补光灯以默认的初始亮度进行补光,在补光灯为初始亮度下,获取洗碗机内清洗区域的图像。在一个示例中,初始亮度可以是补光灯的最大亮度的中值,具体可以根据洗碗机位于不同的环境下通过实验得到的一个较为合适的值,以适应大多数环境,增加洗碗机的适用范围。
在步骤S22中,图像采集设备可以获取清洗区域的图像,图像采集设备可以和补光灯同向设置,以获得更好的补光效果。
在步骤S23中,对图像进行灰度直方图统计,其中“灰度直方图”是反映一幅图像中各灰度级像素出现的频率与灰度级的关系。以灰度级为横坐标,频率为纵坐标,绘制频率与灰度级的关系图。通常情况下,灰度直方图起始灰度设为0,直方图x轴代表0~255的灰度值,即可以代表亮度值,直方图y轴代表对应亮度值的像素数,灰度级为灰度值的等级划分,其表示了精密程度,如8级,16级,32级。本实施例中可以为256级,因此灰度值有0~255的区间范围。可以理解,设置直方图每个间隔代表的灰度范围,表示要图像灰度范围上的间隔数目,也可以理解为直方图一维数组的维数。
请参阅图9,图9为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S23的流程图。在步骤S23中,对图像进行直方图统计,以确定图像是否过暗或者过曝可以包括:
步骤S231:确定灰度直方图中灰度值对应为白色区域的像素数与平均像素数的比值;
步骤S232:在比值小于第一比例阈值的情况下,确定图像过暗;
步骤S233:在比值大于第二比例阈值的情况下,确定图像过曝。
可以理解,当灰度直方图中横轴坐标对应的灰度值为250±Δx(即对应步骤S231的白色区域)的纵坐标(像素数)占平均像素数(总像素数除以灰度值)的比值远远大于其他的灰度值时,此时证明图像白色区域占比较多,图像对应为过曝。相反如果灰度坐标250附近的纵坐标(像素数)占比非常低,而坐标50(对应为灰度直方图的黑色区域)的像素数占比较高,这样的图像则是亮度不够,即上述的图像过暗。当250±Δx坐标的纵轴的值和平均像素数的占比不高时,此时白色区域在整张图像中的占比不高且图像亮度整体分布较为均衡,则认为不是过曝也没有过暗。
利用上述特性,在本申请实施例中,可选地第一比例阈值为1:3,第二比例阈值为3:1,则其灰度值对应在250±Δx,即白色区域的像素数在平均像素数的比在1:3至3:1之间,此时图像是不过曝且不过暗的,如果是比值大于3:1则认为图像过度曝光,如果是小于1:3则认为图像亮度过暗,即上述的步骤S232至步骤S233。
请参阅图10,图10为本申请第二实施例所提供的用于洗碗机的补光方法的流程图。步骤S24中在图像过曝或过暗的情况下,控制补光灯调节初始亮度括:
步骤S241:在图像过曝的情况下,控制补光灯增加初始亮度;
步骤S242:在图像过暗的情况下,控制补光灯减少初始亮度。
进一步地,可以通过调节用于控制补光灯的脉冲宽度调制信号的占空比来调节补光灯的亮度。脉冲宽度调制根据相应载荷的变化来调制可控开关(例如,晶体管基极或MOS管栅极)的偏置电压,来实现晶体管或MOS管导通时间的改变,从而实现开关稳压电源输出的改变。占空比是指高电平在一个周期之内所占的时间比率,例如周期T=64us,脉冲宽度D=32us,则占空比=D/T=32/64=50%。脉冲宽度调整就是占空比的调整。
控制补光灯增加或者减少初始亮度的方式可以包括:按照时间周期性增加或者减少脉 冲宽度调制信号的占空比,例如可以按照每1秒,以10%的速度增加或者减少脉冲宽度调制信号的占空比。
在一些实施例中,可以通过改变补光灯的电压来改变亮度。
进一步地,在每次改变亮度时,控制图像采集设备重新采集图像,循环至步骤S23,直到图像无过曝或者过暗后进入步骤S25。
可以理解,如果初始亮度无需调节此时图像已经没有过暗或者过曝,此时则直接从步骤S23进入步骤S25。
请参阅图11,图11为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S24的另一流程图。在一个实施例中,步骤24中控制补光灯调节初始亮度包括:
步骤S241':将补光灯的亮度从零至最大分为多个等级;
步骤S242':从初始亮度对应的等级依次减少或者增加亮度的等级。
具体地,可以将补光灯的亮度从零到额定功率的最大亮度分为多个等级,通过控制脉冲宽度调制信号的占空比来调节等级,例如将亮度从零到额定功率的最大亮度分为10个等级,最大亮度对应脉冲宽度调制信号的占空比为100%,亮度为0对应脉冲宽度调制信号的占空比为0%,则第一等级对应脉冲宽度调制信号的占空比为10%,依次类推。
例如,初始亮度可以对应第五等级,即对应脉冲宽度调制信号的占空比为50%,根据图像过曝或者过暗,依次提高等级或者减少等级,如增加至对应脉冲宽度调制信号的占空比为60%的第六等级,通过该类方式进行调节,可以加快补光灯亮度调节的速度,从而加快后续图像识别的响应。
请参阅图12,图12为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S24进一步的流程图。补光方法还可以包括:
步骤S243':在每次减少或者增加初始亮度后,再次获取洗碗机内清洗区域的图像;
步骤S244':循环对图像进行灰度直方图统计,在比值位于第一比例阈值和第二比例阈值之间的情况下,确定当前的初始亮度为目标补光亮度。
即在每次减少或者增加初始亮度后,控制图像采集设备再次获取图像,并重新跳至步骤S23,直到图像没有过曝或者过暗,此时将当前调节后的初始亮度作为目标补光亮度。
请参阅图13,图13为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S26的流程图。步骤S26中将目标补光亮度作为下一次的初始亮度默认值包括:
步骤S261:记录目标补光亮度和对应目标补光亮度的调整时间;
步骤S262:将目标补光亮度作为下一次对应调整时间的初始亮度默认值。
可以理解,该步骤主要是考虑用户在使用洗碗机时,通常都是将洗碗机摆放在固定位置,在大多数情况下,同一位置的光照环境都是相同的,基于这一特点,通过记录目标亮度值以及对应目标补光亮度的调整时间,如100cd/m
2和12:00,150cd/m
2和9:00,在下一次使用洗碗机时,用户如果在9:00使用洗碗机,此时补光灯的初始亮度默认值为对应上次该时间的目标补光亮度,即150cd/m
2,此时再根据步骤S21至步骤S23,如果在补光灯为该初始亮度默认值下所采集的图像没有过曝或者过暗,则无需调整,从而减少获取合适图像的时间,且补光灯无需多次调解,可以节约能耗,更智能化。
综上,本申请实施例提供的补光方法通过控制补光灯以初始亮度进行补光并获取清洗区域的图像,通过对图像的灰度直方图进行统计,对补光灯的输出亮度调节以确定合适的目标补光亮度,最终实现图像不过曝且不过暗。另外通过确定目标补光亮度作为下一次的初始亮度默认值,可以减少洗碗机调节补光灯的亮度的次数,从而减少获取合适图像的时间,节约能耗,加快图像识别的响应。
本申请第三实施例还提供一种用于洗碗机的补光方法,可以对洗碗机内的清洗区域进 行更节能快速补光。现有的洗碗机中通常包括照明灯,当用户开洗碗机的门时,照明灯自动开启,以方便用户放置餐具。有的洗碗机还配置有补光灯,但是补光灯和照明灯仅仅实现开关功能,不能进行亮度的线性调节。所以照明灯和补光灯提供的亮度是一个固定的亮度,无法根据洗碗机内部清洗区域的实际亮度进行智能地自适应调节。因此无论是白天还是黑夜,其亮度都是一样,缺乏智能感导致用户使用效果不佳。
请参阅图14,图14示例性示出根据本申请第三实施例所提供的用于洗碗机的补光方法所应用的洗碗机的补光装置的结构示意图,该补光装置可以包括:
图像采集设备11,用于采集洗碗机100内清洗区域的图像;
补光灯12,用于对清洗区域发射光线,以对图像采集设备11所采集的图像进行补光;
照明灯13,用于对清洗区域发射光线,以实现照明效果。
处理器(未图示),电性连接补光灯12以及照明灯13,用于控制补光灯12和照明灯13发射光线。
在一个示例中,照明灯13和补光灯12可以位于洗碗机内部空间的同一面。在另一示例中,照明灯13和补光灯12可以位于不同面,以从多个方位提供照明,从而方便图像采集设备11获取更完整和清晰的图像。
在一个示例中,补光灯12可以采用环形的形状,并围绕图像采集设备11设置,以方便引线,也可以减少在洗碗机内壁开孔的个数,从而增大洗碗机的清洗区域的空间。
请参阅图15,图15为本申请第三实施例所提供的用于洗碗机的补光方法的流程图。在本申请实施例中,洗碗机包括补光灯以及照明灯,以用于对清洗区域进行补光,洗碗机还包括柜门,该补光方法包括:
步骤S31:确定柜门的开闭状态;
步骤S32:在开闭状态被确定为柜门被开启的情况下,控制照明灯开启,以及控制补光灯处于关闭状态。
步骤S33:获取清洗区域的第一图像;
步骤S34:根据第一图像得到第一图像的第一亮度值;
步骤S35:根据第一亮度值确定补光灯所需的补光亮度;
步骤S36:控制补光灯以所需的补光亮度对清洗区域进行补光;
步骤S37:获取经补光后的清洗区域的第二图像;
步骤S38:根据第二图像确定第二亮度值;
步骤S39:在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整。
具体地,在步骤S31至步骤S32中,可以通过在柜门处设置限位器或者位移传感器来检测柜门的开闭状态。可以读取限位器或者位移传感器检测的柜门的开闭状态。如果柜门被开启,则可以认为用户向清洗区域放置餐具,此时可以控制补光灯保持关闭,控制照明灯开启,以照明清洗区域,方便用户放置餐具。
在步骤S33中,在补光灯保持关闭的情况下下获取清洗区域的第一图像,例如可以通过图像采集设备(例如相机)来采集第一图像。在步骤S34中,可以根据第一图像得到第一图像的第一亮度值。例如,第一亮度值可以是第一图像中像素点的亮度平均值。在步骤S35中可以根据第一亮度值确定补光灯所需的补光亮度。具体地,例如第一亮度值可以是在没有开启补光灯仅依靠照明灯的光线照明的情况下所采集的图像的亮度值。可以预先设定目标亮度值。该目标亮度值可以为能够提供理想照明所需的亮度值。该目标亮度值可以根据实际应用或用户偏好进行设置。通过第一亮度值和目标亮度值的差值,可以确定补光灯所需的补光亮度。
请参阅图16,图16为本申请第三实施例所提供的用于洗碗机的补光方法中步骤S35 的流程图。步骤S35中根据第一亮度值确定补光灯所需的补光亮度包括:
步骤S331:将补光灯的补光亮度从零至最大分为多个等级;
步骤S332:确定第一亮度值和预设的目标亮度值的差值;
步骤S333:根据差值确定补光灯所需的补光亮度的等级。
具体地,可以将补光灯的亮度从零到额定功率的最大亮度分为多个等级,可以通过控制提供给补光灯的脉冲宽度调制信号的占空比来调节等级。例如,可以将亮度从零到额定功率的最大亮度分为10个等级,最大亮度对应脉冲宽度调制信号的占空比为100%,亮度为0对应脉冲宽度调制信号的占空比为0%,则第一等级对应的脉冲宽度调制信号的占空比可以为10%,依次类推。
例如,目标亮度值可以对应第五等级,即对应脉冲宽度调制信号的占空比为50%。根据当前的第一亮度值所处的等级和目标亮度值的等级的等级差,可以确定补光灯所需的补光亮度的等级,如第一亮度值对应的等级为第一等级,此时和目标亮度值差距为四个等级,则所需的补光亮度的等级可以四个等级。通过该类方式进行调节,可以利用照明灯光线的影响来调控补光灯,从而加快补光灯进行调节的响应,且节省补光灯的能耗。
在步骤S36至步骤S39,控制补光灯开启并以所需的补光亮度对清洗区域进行补光。可以获取经补光后的清洗区域的第二图像,可以根据第二图像确定第二亮度值。例如,第二亮度值可以为第二图像中像素点的亮度平均值。然后可以判断第二亮度值是否位于预设的亮度值范围内,在第二亮度值位于亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整。
具体地,控制补光灯以所需补光亮度进行补光后,可以再次控制图像采集设备获取第二图像,通过判断第二亮度值是否在亮度值范围内来确定是否需要对补光亮度进行二次调整。这里,亮度值范围可以是亮度在该亮度值范围内图像采集设备获取的图像不会存在过曝(过度曝光)或者过暗。例如,亮度值范围的亮度上限值可以与过曝相关联,亮度下限值可以与过暗相关联。如果第二亮度值在亮度值范围之外,即认为获取的第二图像存在过曝或者过暗,则需要控制补光灯对补光亮度进行二次调整。
请参阅图17,图17为本申请第三实施例所提供的用于洗碗机的补光方法中步骤S38的流程图。在一个具体实施例中,步骤S38中亮度值范围包括亮度下限值和亮度上限值,在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整可以包括:
步骤S381:在第二亮度值大于亮度上限值时,减少补光亮度;
步骤S382:在第二亮度值小于亮度下限值时,增加补光亮度。
可以理解,通过二次调整补光灯的亮度,对整体图像进行补光或者减光,调整的方式可以包括调节补光灯的输入电压。例如可以通过调整脉冲宽度调制信号的占空比来调节输入电压。亮度上限值可以为判断第二图像是否过曝的临界值,亮度下限值可以为判断第二图像是否过暗的临界值。
通过上述将补光灯的补光亮度从零至最大分为多个等级的策略,减少补光亮度包括:依次减少补光亮度的等级,增加补光亮度包括:依次增加补光亮度的等级。
例如,假设当前对应补光亮度为第四等级,此时如果第二亮度值大于亮度上限值,则依次减少补光亮度的等级,如将补光亮度调整到第三等级,再获取一次第二图像,如果第二亮度值仍然大于亮度上限值,继续降低补光亮度,将补光亮度调整到第二等级,直到第二亮度值位于亮度值范围内,此时可以确定当前补光亮度为目标补光亮度。
其中,在开闭状态被确定为柜门被开启的情况下,控制所述补光灯开启后经过预设的第一时间后关闭。
进一步地,在经过步骤S38找到目标补光亮度后,等待关门信息,经过预设的延迟时 间后,关闭照明灯。
进一步地,在接收到关门信息后,关闭补光灯,保存该次补光灯输出的目标补光亮度作为下一次的默认值。
综上,本申请实施例提供的补光方法,在开启照明灯方便用户放置餐具的基础上,根据照明灯光线调整补光灯的补光亮度,从而根据洗碗机内部清洗区域的实际亮度进行智能地自适应调节。在用户开门时自动打开照明灯,方便用户放置餐具,同时根据照明灯的亮度调节补光灯的亮度,更智能、人性化,能给用户带来更好的使用体验。
本申请第四实施例提供一种用于洗碗机的补光方法,可以对洗碗机内的补光灯进行亮度控制。现有技术采用补光灯进行补光下,随洗碗机使用的时间变化,其补光灯的灯珠会老化,导致其亮度变弱,以至于在图像采集的时候获取的图像会出现过暗。在进行图像识别时容易导致图像过暗,且用户觉得亮度不够,影响产品使用的体验。该补光方法可以解决上述问题。
请参阅图18,图18为本申请实施例四所提供的用于洗碗机的补光方法的流程图;在本申请实施例中,补光方法可以包括:
步骤S41:在洗碗机位于出厂状态的情况下,控制补光灯以预设的第一占空比对应的第一亮度对洗碗机的清洗区域进行补光;
步骤S42:获取清洗区域的第一图像;
步骤S43:根据第一图像得到第一图像的第一亮度值;
步骤S44:在洗碗机位于校准状态的情况下,控制补光灯以第一占空比对应的第二亮度对洗碗机的清洗区域进行补光;
步骤S45:获取清洗区域的第二图像;
步骤S46:根据第二图像得到第二图像的第二亮度值;
步骤S47:确定第二亮度值和第一亮度值的差值;
步骤S48:在差值大于预设的阈值的情况下,增大占空比以增大补光灯亮度。
具体地,可以使用脉冲宽度调制(PWM)信号来控制补光灯。通过调节PWM信号的占空比可以控制补光灯的亮度。
可以理解,PWM信号可以根据相应载荷的变化来调制晶体管基极或MOS管栅极的偏置,来实现晶体管或MOS管导通时间的改变,从而实现开关稳压电源输出的改变。占空比是指高电平在一个周期之内所占的时间比率。例如,周期T=64us,脉冲宽度D=32us,则占空比=D/T=32/64=50%。通过调整用于控制补光灯的脉冲宽度调制信号的占空比,可以实现亮度控制。
具体地,在洗碗机位于出厂状态的情况下,即洗碗机刚开始出厂时,可以先设置好补光灯较佳的亮度,该亮度可以对应于PWM信号的占空比(可以称为设定占空比或上述的第一占空比)。在洗碗机出厂时,可以将用于控制补光灯的PWM信号的占空比调整为该第一占空比,使得补光灯可以以第一占空比对应的第一亮度对洗碗机的清洗区域进行补光。然后可以通过图像采集设备(例如相机)拍摄在第一亮度下的清洗区域的第一图像,根据第一图像得到第一图像的第一亮度值,以及可以保存上述数据,例如指第一亮度值、第一占空比。
当需要对补光灯进行调光校准的时候,即在洗碗机处于校准状态的情况下,可以控制补光灯以同样的第一占空比的脉冲宽度调制信号打开,启动图像采集设备对清洗区域进行拍照采集,以获取第二图像,根据第二图像可以得到第二图像的第二亮度值。然后将第二亮度值与出厂时的第一亮度值进行比较。如果第一亮度和第二亮度之间的差值超过一定的阈值,则可以调整补光灯的亮度,以使得第二亮度值达到第一亮度值。
可以以预设的第一时间周期和/或在清洗区域没有餐具的情况下,控制补光灯进入校准 状态。例如,第一时间周期可以是例如半年、一年,即可以每隔半年或者一年进行一次校准。也可以根据用户自行触发进入校准状态,从而对补光灯进行维护。
可以理解,通过对补光灯进行校准,可以获取补光灯在同样脉冲宽度调制信号的占空比下的亮度差异,根据该差异可以对补光灯进行适应性调整,从而防止补光灯由于使用寿命的影响导致其亮度变弱,影响后续的图像识别效果及照明效果,给用户带来更好的体验。
在本申请实施例中,根据第一图像得到第一图像的第一亮度值以及根据第二图像得到第二图像的第二亮度值,均可以通过统计灰度直方图加权求和,或者求平均亮度值。
可以理解,对灰度直方图中各个像素的亮度值进行加权求和以得到第一亮度值。加权求和是将权重计算在内的平均方法;通常在一组数据里,一个数据出现的次数称为权。具体方式如下:根据直方图中每个亮度值(灰度值)给予不同的权值;然后就将权值和落在该区域的像素数相乘,并把所有结果相加,即可得到上述的第一亮度值;例如:亮度值250对应为权值1,亮度值100对应为权值0.3,如果一张图像仅仅在亮度值250和亮度值100处分别有10个像素点,则第一亮度值为10*1+0.3*10=13。
如果在同样的脉冲宽度调制信号的占空比下,第二亮度值为10,则证明补光灯已经发生亮度衰减,此时第一亮度值和第二亮度值的差值为3。如果预设的阈值为2,此时差值大于阈值,则可以增大脉冲宽度调制信号的占空比以最大补光灯的亮度。
增加占空比的方式可以包括在预设的时间将占空比增加一定的比例。例如,每过t秒,以5%的速度增加PWM信号的占空比,从而增加或减少补光灯的亮度。在每次调整后,可以控制图像采集设备重新获取一张图像,计算图像的第二亮度值,直至第二亮度值和第一亮度值的差值小于阈值。
进一步地,本申请实施例提供的用于洗碗机的补光方法还可以包括:
步骤S49:在差值小于预设的阈值的情况下,确定补光灯当前对应的第二占空比。
可以理解,如果对用于控制补光灯的PWM信号的占空比进行调整,直到第二亮度值与第一亮度值的差值小于阈值时,则第二占空比可以无需再调整,可以确定调整后的第二占空比。
请参阅图19,图19为本申请实施例四所提供的用于洗碗机的补光方法的另一流程图。根据所确定的第二占空比,该补光方法还可以包括以下步骤:
步骤S491:确定第二占空比和第一占空比的比值;
步骤S492:根据比值调整补光灯的占空比和亮度的系数。
可以理解,根据第二占空比和第一占空比的比值,如第一占空比为50%,第二占空比为60%,则代表了同样的亮度,由于补光灯的衰减,以前仅需要占空比为40%的亮度现在需要占空比为50%,比值为60/50为1.2。
在步骤S492中,通常情况下,补光灯的亮度=占空比*k,其中k为相关系数,根据该比值可以调整补光灯的占空比和亮度的系数k,如系数k提高至原先的1.2倍,从而使得补光灯在同等的占空比下运行正常。
请参阅图20以及图21,图20为本申请第四实施例所提供的用于洗碗机的补光方法的进一步的流程图;图21是本申请第四实施例四所提供的用于洗碗机的补光方法中为演示步骤S494的示意图。本申请实施例所提供的补光方法还包括:
步骤S493:确定第二占空比和第一占空比的差值;
步骤S494:根据差值确定补光灯的使用寿命。
具体地,在得到校准状态下的补光灯的脉冲宽度调制信号的第二占空比P1,以及出厂状态下的脉冲宽度调制信号P0之后,可以通过以下公式计算补光灯的剩余使用寿命的占比:
T=100-((|P1-P0|*100)/(100-P0)),
其中,T是补光灯的剩余使用寿命的百分比。
进一步地,通过以上得到的使用寿命,可以在使用寿命小于预设的寿命阈值的情况下,向用户发送指示信息。指示信息可以是通过指示灯或者其他预警设备发送,例如蜂鸣器。指示信息可以通过显示屏显示以提示用户更换补光灯,或者可以通过无限网络向用户终端发送指示信息,以提示用户更换补光灯。通过这种方式可以对洗碗机进行维护,从而保障洗碗机的可靠性。
本申请实施例提供的补光方法,在洗碗机的出厂状态下控制洗碗机的补光以预设的第一占空比对应的第一亮度对洗碗机的清洗区域进行补光,并进行图像采集,以得到第一亮度值。当需要进行调光校准的时候,控制补光灯以同样的脉冲宽度调制信号的占空比进行补光,并进行图像采集,以得到第二亮度值。如果第一亮度和第二亮度的差值超过一定的阈值,则调整补光灯的亮度,直到达到第一亮度值。通过这种方式对补光灯进行校准,可以获取补光灯在同样脉冲宽度调制信号的占空比下的亮度差异,根据该差异可以对补光灯进行适应性调整,从而防止补光灯由于使用寿命的影响,导致其亮度变弱,影响后续的图像识别效果及照明效果,给用户带来更好的体验。
本申请第五实施例提供一种洗碗机,包括上述实施例中描述的补光装置。
本领域技术人员也应当理解,只要在不违背物理原理和发明构思的情况下,可以将本申请实施例进行各种组合、变形或替换,这些组合、变形或替换同样落入本申请的保护范围。
本申请实施例提供了一种机器可读存储介质,其上存储有程序,该程序被处理器执行时实现用于洗碗机的补光方法。
机器可读存储介质的示例可以包括存储器。存储器可以包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM),存储器包括至少一个存储芯片。
本申请实施例提供一种处理器,处理器用于运行程序,其中,程序被运行时使得处理器被配置成执行上述实施例描述的用于洗碗机的补光方法。
本申请实施例还提供一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述实施例的用于洗碗机的方法。
在一实施例中,一种用于洗碗机的补光方法,洗碗机包括图像采集设备,用于采集洗碗机内的清洗区域的图像;主补光灯,用于对图像进行补光;至少一个副补光灯,用于对图像的边缘区域进行补光;补光方法包括:
获取洗碗机内的清洗区域的图像;
根据图像得到图像的第一亮度值;
在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;
在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。
在一实施例中,补光方法还包括:
在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。
在一实施例中,在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值包括:
在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;
在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。
在一实施例中,根据图像得到图像的第一亮度值包括:
获取图像的亮度直方图;
对亮度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。
在一实施例中,至少一个副补光灯包括第一副补光灯和第二副补光灯,第一副补光灯和第二副补光灯分别设置于图像采集设备的左右两侧,分别用于对图像的左边缘区域和右边缘区域进行补光:在第二亮度值位于第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值包括:
在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯的亮度以调节左侧第二亮度值;
在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯的亮度以调节右侧第二亮度值。
在一实施例中,根据图像得到图像的边缘区域的第二亮度值包括:
将图像分割成多个区域;
根据主补光灯的视场角提取多个区域中的边缘区域;
确定边缘区域的第二亮度值;
其中第二亮度值为边缘区域的亮度值的平均值。
在一实施例中,主补光灯和副补光灯分别通过不同的脉冲宽度调制信号单独控制。
在一实施例中,一种用于洗碗机的补光装置,包括:
图像采集设备,用于获取洗碗机的清洗区域的图像;
主补光灯,环绕图像采集设备设置,用于对清洗区域中与图像的中心区域对应的区域进行补光;
至少一个副补光灯,设置于主补光灯的至少一侧,用于对清洗区域中与图像的边缘区域对应的区域进行补光;
处理器,被配置成:
获取图像;
根据图像得到图像的第一亮度值;
在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;
在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。
在一实施例中,处理器还被配置成:
在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。
在一实施例中,处理器被配置成调节主补光灯的亮度以调节第一亮度值包括处理器被配置成:
在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;
在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。
在一实施例中,处理器被配置成根据图像得到图像的第一亮度值被配置成:
获取图像的亮度直方图;
对亮度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。
在一实施例中,至少一个副补光灯包括:
第一副补光灯,设置于图像采集设备的左侧;
第二副补光灯,设置于图像采集设备的右侧;
处理器被配置成在第二亮度值不位于第二亮度范围的情况下,调节副补光灯的亮度以 调节第二亮度值包括处理器被配置成:
在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯的亮度以调节左侧第二亮度值;
在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯的亮度以调节右侧第二亮度值。
在一实施例中,处理器被配置成获取图像的边缘区域的第二亮度值包括处理器被配置成:
将图像分割成多个区域;
根据主补光灯的视场角提取多个区域中的边缘区域;
确定边缘区域的第二亮度值;
其中第二亮度值为边缘区域的亮度值的平均值。
在一实施例中,补光装置还包括:
第一脉冲宽度调制设备,电性连接主补光灯,用于通过控制占空比调节主补光灯的亮度;
第二脉冲宽度调制设备,电性连接第一副补光灯,用于通过控制占空比调节第一副补光灯的亮度;
第三脉冲宽度调制设备,电性连接第二副补光灯,用于通过控制占空比调节第二副补光灯的亮度。
在一实施例中,一种洗碗机,包括上述的用于洗碗机的补光装置。
在一实施例中,一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于洗碗机的补光方法。
在一实施例中,一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述的用于洗碗机的补光方法。
在一实施例中,一种用于洗碗机的补光方法,洗碗机包括补光灯,用于对洗碗机的清洗区域进行补光,补光方法包括:
控制补光灯以初始亮度进行补光;
获取清洗区域的图像;
对图像进行灰度直方图统计,以确定图像是否过暗或者过曝;
在图像过曝或过暗的情况下,控制补光灯调节初始亮度;
在图像没有过曝或过暗的情况下,确定当前的初始亮度为目标补光亮度;
将目标补光亮度作为下一次的初始亮度默认值。
在一实施例中,对图像进行灰度直方图统计,以确定图像是否过暗或者过曝包括:
确定直方图中灰度值对应为白色区域的像素数和平均像素数的比值;
在比值小于第一比例阈值的情况下,确定图像过暗;
在比值大于第二比例阈值的情况下,确定图像过曝。
在一实施例中,在图像过曝或过暗的情况下,控制补光灯调节初始亮度包括:
在图像过曝的情况下,控制补光灯增加初始亮度;
在图像过暗的情况下,控制补光灯减少初始亮度。
在一实施例中,控制补光灯调节初始亮度包括:
将补光灯的亮度从零至最大分为多个等级;
从初始亮度对应的等级依次减少或者增加亮度的等级。
在一实施例中,将目标补光亮度作为下一次的初始亮度默认值包括:
记录目标补光亮度和对应目标补光亮度的调整时间;
将目标补光亮度作为下一次对应调整时间的初始亮度默认值。
在一实施例中,补光灯通过调节脉冲宽度调制信号的占空比调节亮度。
在一实施例中,一种用于洗碗机的补光装置,包括:
图像采集元件,被配置为获取洗碗机的清洗区域的图像;
补光灯,用于对清洗区域进行补光;
处理器,被配置为:
控制补光灯以初始亮度进行补光;
获取清洗区域的图像;
对图像进行灰度直方图统计,以确定图像是否过暗或者过曝;
在图像过曝或过暗的情况下,控制补光灯调节初始亮度;
在图像没有过曝或过暗的情况下,确定当前的初始亮度为目标补光亮度;
将目标补光亮度作为下一次的初始亮度默认值。
在一实施例中,处理器被配置为对图像进行灰度直方图统计,以确定图像是否过暗或者过曝包括处理器被配置为:
确定直方图中灰度值对应为白色区域的像素数和平均像素数的比值;
在比值小于第一比例阈值的情况下,确定图像过暗;
在比值大于第二比例阈值的情况下,确定图像过曝。
在一实施例中,处理器被配置为在图像过曝或过暗的情况下,控制补光灯调节初始亮度包括处理器被配置为:
在图像过曝的情况下,控制补光灯增加初始亮度;
在图像过暗的情况下,控制补光灯减少初始亮度。
在一实施例中,处理器被配置为控制补光灯调节初始亮度包括处理器被配置为:
将补光灯的亮度从零至最大分为多个等级;
从初始亮度对应的等级依次减少或者增加亮度的等级。
在一实施例中,将处理器被配置为将目标补光亮度作为下一次的初始亮度默认值包括处理器被配置为:
记录目标补光亮度和对应目标补光亮度的调整时间;
将目标补光亮度作为下一次对应调整时间的初始亮度默认值。
在一实施例中,补光装置还包括:
脉冲宽度调制信号调节设备,用于调节输入至补光灯的脉冲宽度调制信号的占空比,以调节补光灯的亮度。
在一实施例中,一种洗碗机,包括上述的用于洗碗机的补光装置。
在一实施例中,一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于补光灯的补光方法。
在一实施例中,一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述的用于补光灯的补光方法。
在一实施例中,一种用于洗碗机的补光方法,洗碗机包括:照明灯,用于对清洗区域进行照明;补光灯,用于对洗碗机内的清洗区域进行补光;补光方法包括:
确定柜门的开闭状态;
在根据开闭状态确定柜门被开启的情况下,控制照明灯开启,补光灯关闭;
获取清洗区域的第一图像;
根据第一图像得到第一图像的第一亮度值;
根据第一亮度值确定补光灯所需的补光亮度;
控制补光灯以补光亮度对清洗区域进行补光;
获取经补光后的清洗区域的第二图像;
根据第二图像确定第二亮度值;
在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次 调整。
在一实施例中,补光方法还包括:
第一亮度值为第一图像中像素点的亮度平均值,第二亮度值为第二图像中像素点的亮度平均值。
在一实施例中,根据第一亮度值确定补光灯所需的补光亮度包括:
将补光亮度从零至最大分为多个等级;
确定第一亮度值和预设的目标亮度阈值的差值;
根据差值确定补光灯所需的补光亮度的等级。
在一实施例中,亮度值范围包括强度下限值和强度上限值,在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整包括:
在第二亮度值大于强度上限值时,减少补光亮度;
在第二亮度值小于强度下限值时,增加补光亮度。
在一实施例中,减少补光亮度包括:依次减少补光亮度的等级;增加补光亮度包括:依次增加补光亮度的等级。
在一实施例中,一种用于洗碗机的补光装置,包括:
位移传感器,用于根据柜门的位移获取柜门的开闭状态;
图像采集设备,用于采集洗碗机内的清洗区域的图像;
补光灯,用于对清洗区域进行补光;
照明灯,用于对清洗区域进行照明;
处理器,被配置成:
确定柜门的开闭状态;
在根据开闭状态确定柜门被开启的情况下,控制照明灯开启,补光灯关闭;
获取清洗区域的第一图像;
根据第一图像得到第一图像的第一亮度值;
根据第一亮度值确定补光灯所需的补光亮度;
控制补光灯以补光亮度对清洗区域进行补光;
获取经补光后的清洗区域的第二图像;
根据第二图像确定第二亮度值;
在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整。
在一实施例中,第一亮度值为第一图像中像素点的亮度平均值,第二亮度值为第二图像中像素点的亮度平均值。
在一实施例中,处理器被配置成根据第一亮度值确定补光灯所需的补光亮度包括处理器被配置成:
将补光亮度从零至最大分为多个等级;
确定第一亮度值和预设的目标亮度阈值的差值;
根据差值确定补光亮度的等级。
在一实施例中,亮度值范围包括强度下限值和强度上限值,处理器被配置成在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整包括包括处理器被配置成:
在第二亮度值大于强度上限值时,减少补光亮度;
在第二亮度值小于强度下限值时,增加补光亮度。
在一实施例中,处理器被配置成减少补光亮度包括处理器被配置成:依次减少补光亮度的等级;
处理器被配置成增加补光亮度包括处理器被配置成:依次增加补光亮度的等级。
在一实施例中,一种洗碗机,包括上述的用于洗碗机的补光装置。
在一实施例中,一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于洗碗机的补光方法。
在一实施例中,一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述的用于洗碗机的补光方法。
在一实施例中,一种用于洗碗机的补光方法,补光灯通过调节脉冲宽度调制信号的占空比调节亮度,补光方法包括:
在洗碗机位于出厂状态的情况下,控制补光灯以预设的第一占空比对应的第一亮度对洗碗机的清洗区域进行补光;
获取清洗区域的第一图像;
根据第一图像得到第一图像的第一亮度值;
在洗碗机位于校准状态的情况下,控制补光灯以第一占空比对应的第二亮度对洗碗机的清洗区域进行补光;
获取清洗区域的第二图像;
根据第二图像得到第二图像的第二亮度值;;
确定第二亮度值和第一亮度值的差值;
在差值大于预设的阈值的情况下,增大第一占空比以增大第二亮度。
在一实施例中,补光方法,还包括:
在差值小于预设的阈值的情况下,确定当前的第二亮度所对应的第二占空比。
在一实施例中,补光方法还包括:
确定第二占空比和第一占空比的比值;
根据比值调整补光灯的占空比和亮度的系数。
在一实施例中,补光方法还包括:
确定第二占空比和第一占空比的差值;
根据差值确定补光灯的使用寿命。
在一实施例中,补光方法还包括:在使用寿命小于预设的寿命阈值的情况下,向用户发送指示信息。
在一实施例中,补光方法还包括:以预设的第一时间周期和/或在清洗区域没有餐具的情况下,控制补光灯进入校准状态。
在一实施例中,一种用于洗碗机的补光装置,包括:
图像采集元件,被配置成获取洗碗机内清洗区域的图像;
脉冲宽度调制信号调节设备,用于控制输入至补光灯的脉冲宽度调制信号的占空比;
处理器,被配置成:
在洗碗机位于出厂状态的情况下,控制补光灯以预设的第一占空比对应的第一亮度对洗碗机的清洗区域进行补光;
获取清洗区域的第一图像;
根据第一图像得到第一图像的第一亮度值;
在洗碗机位于校准状态的情况下,控制补光灯以第一占空比对应的第二亮度对洗碗机的清洗区域进行补光;
获取清洗区域的第二图像;
根据第二图像得到第二图像的第二亮度值;
确定第二亮度值和第一亮度值的差值;
在差值大于预设的阈值的情况下,增大第一占空比以调节第二亮度。
在一实施例中,处理器还被配置成:在差值小于预设的阈值的情况下,确定当前的第 二亮度所对应的第二占空比。
在一实施例中,处理器还被配置成:
确定第二占空比和第一占空比的差值;
根据差值确定补光灯的使用寿命。
在一实施例中,处理器还被配置成:在使用寿命小于预设的寿命阈值的情况下,向用户发送指示信息。
在一实施例中,处理器还被配置成:以预设的第一时间周期和/或清洗区域没有餐具的情况下,控制补光灯位于校准状态。
在一实施例中,一种洗碗机,包括上述的用于洗碗机的补光装置。
在一实施例中,一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于洗碗机的补光方法。
在一实施例中,一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述的用于洗碗机的补光方法。
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。
以上仅为本申请的实施例而已,并不用于限制本申请。对于本领域技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本申请的权利要求范围之内。
Claims (17)
- 一种用于洗碗机的补光方法,其特征在于,所述洗碗机包括图像采集设备,用于采集所述洗碗机内的清洗区域的图像;主补光灯,用于对所述图像进行补光;至少一个副补光灯,用于对所述图像的边缘区域进行补光;所述补光方法包括:获取所述洗碗机内的清洗区域的图像;根据所述图像得到所述图像的第一亮度值;在所述第一亮度值位于预设的第一亮度范围内的情况下,根据所述图像得到所述图像的边缘区域的第二亮度值;在所述第二亮度值位于预设的第二亮度范围之外的情况下,调节所述副补光灯的亮度以调节所述第二亮度值。
- 如权利要求1所述的补光方法,其特征在于,还包括:在所述第一亮度值位于所述第一亮度范围之外的情况下,调节所述主补光灯的亮度以调节所述第一亮度值。
- 如权利要求2所述的补光方法,其特征在于,所述在所述第一亮度值位于所述第一亮度范围之外的情况下,调节所述主补光灯的亮度以调节所述第一亮度值包括:在所述第一亮度值小于所述第一亮度范围的下限值的情况下,增加所述主补光灯的亮度以增加所述第一亮度值;在所述第一亮度值大于所述第一亮度范围的上限值的情况下,减小所述主补光灯的亮度以减小所述第一亮度值。
- 如权利要求1所述的补光方法,其特征在于,所述根据所述图像得到所述图像的第一亮度值包括:获取所述图像的亮度直方图;对所述亮度直方图中各个像素的亮度值进行加权并求和以得到所述第一亮度值。
- 如权利要求1所述的补光方法,其特征在于,所述至少一个副补光灯包括第一副补光灯和第二副补光灯,所述第一副补光灯和所述第二副补光灯分别设置于所述图像采集设备的左右两侧,分别用于对所述图像的左边缘区域和右边缘区域进行补光:所述在所述第二亮度值位于所述第二亮度范围之外的情况下,调节所述副补光灯的亮度以调节所述第二亮度值包括:在所述左边缘区域的左侧第二亮度值位于所述第二亮度范围之外的情况下,调节所述第一副补光灯的亮度以调节所述左侧第二亮度值;在所述右边缘区域的右侧第二亮度值位于所述第二亮度范围之外的情况下,调节所述第二副补光灯的亮度以调节所述右侧第二亮度值。
- 如权利要求1所述的补光方法,其特征在于,所述根据所述图像得到所述图像的边缘区域的第二亮度值包括:将所述图像分割成多个区域;根据所述主补光灯的视场角提取所述多个区域中的边缘区域;确定所述边缘区域的第二亮度值;其中所述第二亮度值为所述边缘区域的亮度值的平均值。
- 如权利要求1所述的补光方法,其特征在于,所述主补光灯和副补光灯分别通过不同的脉冲宽度调制信号单独控制。
- 一种用于洗碗机的补光装置,其特征在于,包括:图像采集设备,用于获取洗碗机的清洗区域的图像;主补光灯,环绕所述图像采集设备设置,用于对所述清洗区域中与所述图像的中心区域对应的区域进行补光;至少一个副补光灯,设置于所述主补光灯的至少一侧,用于对所述清洗区域中与所述图像的边缘区域对应的区域进行补光;处理器,被配置成:获取所述图像;根据所述图像得到所述图像的第一亮度值;在所述第一亮度值位于预设的第一亮度范围内的情况下,根据所述图像得到所述图像的边缘区域的第二亮度值;在所述第二亮度值位于预设的第二亮度范围之外的情况下,调节所述副补光灯的亮度以调节所述第二亮度值。
- 如权利要求8所述的补光装置,其特征在于,所述处理器还被配置成:在所述第一亮度值位于所述第一亮度范围之外的情况下,调节所述主补光灯的亮度以调节所述第一亮度值。
- 如权利要求9所述的补光装置,其特征在于,所述处理器被配置成调节所述主补光灯的亮度以调节所述第一亮度值包括处理器被配置成:在所述第一亮度值小于所述第一亮度范围的下限值的情况下,增加所述主补光灯的亮度以增加所述第一亮度值;在所述第一亮度值大于所述第一亮度范围的上限值的情况下,减小所述主补光灯的亮度以减小所述第一亮度值。
- 如权利要求8所述的补光装置,其特征在于,所述处理器被配置成根据所述图像得到所述图像的第一亮度值被配置成:获取所述图像的亮度直方图;对所述亮度直方图中各个像素的亮度值进行加权并求和以得到所述第一亮度值。
- 如权利要求8所述的补光装置,其特征在于,所述至少一个副补光灯包括:第一副补光灯,设置于所述图像采集设备的左侧;第二副补光灯,设置于所述图像采集设备的右侧;所述处理器被配置成在所述第二亮度值不位于第二亮度范围的情况下,调节所述副补光灯的亮度以调节所述第二亮度值包括所述处理器被配置成:在所述左边缘区域的左侧第二亮度值位于所述第二亮度范围之外的情况下,调节所述第一副补光灯的亮度以调节所述左侧第二亮度值;在所述右边缘区域的右侧第二亮度值位于所述第二亮度范围之外的情况下,调节所述第二副补光灯的亮度以调节所述右侧第二亮度值。
- 如权利要求8所述的补光装置,其特征在于,所述处理器被配置成获取图像的边缘区域的第二亮度值包括所述处理器被配置成:将所述图像分割成多个区域;根据所述主补光灯的视场角提取所述多个区域中的边缘区域;确定所述边缘区域的第二亮度值;其中所述第二亮度值为所述边缘区域的亮度值的平均值。
- 如权利要求12所述的补光装置,其特征在于,还包括:第一脉冲宽度调制设备,电性连接所述主补光灯,用于通过控制占空比调节所述主补光灯的亮度;第二脉冲宽度调制设备,电性连接第一副补光灯,用于通过控制占空比调节第一副补光灯的亮度;第三脉冲宽度调制设备,电性连接第二副补光灯,用于通过控制占空比调节第二副补光灯的亮度。
- 一种洗碗机,其特征在于,包括根据权利要求8至14任意一项所述的用于洗碗机的补光装置。
- 一种机器可读存储介质,其特征在于,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得所述处理器能够执行根据权利要求1至7中任意一项权利要求所述的用于洗碗机的补光方法。
- 一种计算机程序产品,包括计算机程序,其特征在于,所述计算机程序在被处理器执行时实现根据权利要求1至7中任意一项所述的用于洗碗机的补光方法。
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110069559.X | 2021-01-19 | ||
CN202110071265.0 | 2021-01-19 | ||
CN202110071263.1 | 2021-01-19 | ||
CN202110071265.0A CN112911162B (zh) | 2021-01-19 | 2021-01-19 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
CN202110069559.XA CN112890714A (zh) | 2021-01-19 | 2021-01-19 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
CN202110071269.9 | 2021-01-19 | ||
CN202110071263.1A CN112890727A (zh) | 2021-01-19 | 2021-01-19 | 用于补光灯的补光方法、补光装置以及洗碗机 |
CN202110071269.9A CN112890728A (zh) | 2021-01-19 | 2021-01-19 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022156707A1 true WO2022156707A1 (zh) | 2022-07-28 |
Family
ID=82549292
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/072725 WO2022156707A1 (zh) | 2021-01-19 | 2022-01-19 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2022156707A1 (zh) |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012185728A (ja) * | 2011-03-07 | 2012-09-27 | Isuzu Motors Ltd | 画像認識システム |
CN105222509A (zh) * | 2015-09-30 | 2016-01-06 | 沈阳海尔电冰箱有限公司 | 冰箱的间室照明控制方法与冰箱 |
CN107485356A (zh) * | 2017-09-01 | 2017-12-19 | 佛山市顺德区美的洗涤电器制造有限公司 | 洗碗机的洗涤控制方法和装置以及洗碗机 |
CN110336954A (zh) * | 2019-07-11 | 2019-10-15 | 创新奇智(重庆)科技有限公司 | 自动补光调节方法、系统及存储介质 |
CN112890727A (zh) * | 2021-01-19 | 2021-06-04 | 佛山市顺德区美的洗涤电器制造有限公司 | 用于补光灯的补光方法、补光装置以及洗碗机 |
CN112890728A (zh) * | 2021-01-19 | 2021-06-04 | 佛山市顺德区美的洗涤电器制造有限公司 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
CN112890714A (zh) * | 2021-01-19 | 2021-06-04 | 佛山市顺德区美的洗涤电器制造有限公司 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
CN112911162A (zh) * | 2021-01-19 | 2021-06-04 | 佛山市顺德区美的洗涤电器制造有限公司 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
-
2022
- 2022-01-19 WO PCT/CN2022/072725 patent/WO2022156707A1/zh active Application Filing
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012185728A (ja) * | 2011-03-07 | 2012-09-27 | Isuzu Motors Ltd | 画像認識システム |
CN105222509A (zh) * | 2015-09-30 | 2016-01-06 | 沈阳海尔电冰箱有限公司 | 冰箱的间室照明控制方法与冰箱 |
CN107485356A (zh) * | 2017-09-01 | 2017-12-19 | 佛山市顺德区美的洗涤电器制造有限公司 | 洗碗机的洗涤控制方法和装置以及洗碗机 |
CN110336954A (zh) * | 2019-07-11 | 2019-10-15 | 创新奇智(重庆)科技有限公司 | 自动补光调节方法、系统及存储介质 |
CN112890727A (zh) * | 2021-01-19 | 2021-06-04 | 佛山市顺德区美的洗涤电器制造有限公司 | 用于补光灯的补光方法、补光装置以及洗碗机 |
CN112890728A (zh) * | 2021-01-19 | 2021-06-04 | 佛山市顺德区美的洗涤电器制造有限公司 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
CN112890714A (zh) * | 2021-01-19 | 2021-06-04 | 佛山市顺德区美的洗涤电器制造有限公司 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
CN112911162A (zh) * | 2021-01-19 | 2021-06-04 | 佛山市顺德区美的洗涤电器制造有限公司 | 用于洗碗机的补光方法、补光装置以及洗碗机 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112890714A (zh) | 用于洗碗机的补光方法、补光装置以及洗碗机 | |
CN109640442B (zh) | 一种基于nb-iot的教室光环境控制系统 | |
JP6816097B2 (ja) | 画像についての奥行きマップを決定するための方法及び装置 | |
US20210243353A1 (en) | Image pickup apparatus capable of performing image pickup with reduced flicker influence, method for controlling the same, and storage medium | |
KR100557219B1 (ko) | 자동 노출 보정 방법 및 보정 장치 | |
CN110336954B (zh) | 自动补光调节方法、系统及存储介质 | |
US20150125032A1 (en) | Object detection device | |
US20150305119A1 (en) | Lighting control device and lighting system | |
CN111258158B (zh) | 投影机及亮度调整方法 | |
US11533459B2 (en) | Projector and brightness adjusting method | |
CN104202537A (zh) | 一种红外摄像机的调光方法 | |
Sarkar et al. | Integrated daylight harvesting and occupancy detection using digital imaging | |
CN109140674B (zh) | 一种显示板控制方法、装置及空调器 | |
CN102413280A (zh) | 摄像设备及其控制方法 | |
KR20100097166A (ko) | 파워 절약 투과형 디스플레이 | |
CN112890728A (zh) | 用于洗碗机的补光方法、补光装置以及洗碗机 | |
CN112890727A (zh) | 用于补光灯的补光方法、补光装置以及洗碗机 | |
CN108737740A (zh) | 一种图像补光方法及系统 | |
WO2022156707A1 (zh) | 用于洗碗机的补光方法、补光装置以及洗碗机 | |
CN112911162B (zh) | 用于洗碗机的补光方法、补光装置以及洗碗机 | |
CN113840095A (zh) | 一种补光灯控制方法及相关装置 | |
US8917348B2 (en) | Solid-state imaging device, camera module, and illuminance detection method | |
JP2010004543A (ja) | 撮像装置 | |
US20180352175A1 (en) | Method for improving image quality in images acquired by a near-infrared sensitive video camera and such a camera | |
JP2023001975A (ja) | 情報処理装置、情報処理方法およびプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22742186 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24/11/2023). |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22742186 Country of ref document: EP Kind code of ref document: A1 |