JP7172222B2 - Foot size measurement method, foot size measurement program, and foot size measurement device - Google Patents

Description

The present invention relates to a foot size measuring method, a foot size measuring program, and a foot size measuring device.

For example, when purchasing shoes, the size of the foot, such as the length and width of the foot, is important in order to select shoes that are suitable for the size of the foot. Therefore, there is a demand for a method that can easily measure the size of the foot. As a method of measuring the size of the foot, for example, the foot to be measured is photographed, and the length of the foot to be measured is measured from the contour of the foot in one photographed still image.

JP 2017-75961 A JP 2007-267996 A

However, when capturing a still image of the foot to be measured, blind spots occur near the toes and heels of the foot in one shot, and it is difficult to identify the entire contour of the foot in a single still image. , the foot length of the measurement object cannot be measured accurately.

In one aspect, the present invention is to provide a foot size measuring method or the like that enables the foot length to be calculated simply by photographing.

In one aspect, as a foot size measurement method, a first image including a toe of a foot placed on a platform of a predetermined size and a first feature point of the platform, and the foot placed on the platform a second image containing the heel of the platform and a second feature point of the platform. Furthermore, the first feature point included in the first image, the first length from the edge of the platform to the toe of the foot, the second feature point included in the second image, and the platform The foot length is output as the length of the platform minus the second length from the edge of the foot to the heel of the foot.

As one aspect, it becomes possible to calculate the leg length simply by taking a picture.

FIG. 1 is an explanatory diagram showing an example of the foot size measuring device of this embodiment. FIG. 2 is a block diagram showing an example of the hardware configuration of the mobile terminal. FIG. 3 is a block diagram illustrating an example of the hardware configuration of a server; FIG. 4 is a block diagram illustrating an example of a functional configuration of a server; FIG. 5A is an explanatory diagram showing an example of a method for capturing a first input image. FIG. 5B is an explanatory diagram showing an example of a method for capturing a second input image. FIG. 6 is an explanatory diagram showing an example of processed images up to the completion of acquisition of the first mount area extraction image. FIG. 7 is an explanatory diagram showing an example of processed images up to completion of measurement of the first length. FIG. 8 is an explanatory diagram showing an example of processed images until the acquisition of the second mount area extraction image is completed. FIG. 9 is an explanatory diagram showing an example of processed images until the measurement of the second length is completed. FIG. 10 is an explanatory diagram showing an example of images processed until the measurement of the foot width is completed. FIG. 11 is a flow chart showing an example of the processing operation of the server involved in the foot size measurement process. FIG. 12 is a flow chart showing an example of the processing operation of the server involved in the first mount area extraction process. FIG. 13 is a flow chart showing an example of the processing operation of the server involved in the first clipping process. FIG. 14 is a flowchart illustrating an example of the processing operation of the server involved in the first measurement processing; FIG. 15 is a flow chart showing an example of the processing operation of the server involved in the second board area extraction processing. FIG. 16 is a flow chart showing an example of the processing operation of the server involved in the second clipping process. FIG. 17 is a flowchart illustrating an example of the processing operation of the server involved in the second measurement processing; FIG. 18 is a flowchart showing an example of the processing operation of the server involved in foot width measurement processing. FIG. 19 is an explanatory diagram showing an example of an information processing device that executes a foot size measurement program.

Hereinafter, embodiments of the foot size measuring device and the like disclosed in the present application will be described in detail based on the drawings. Note that the disclosed technology is not limited by the present embodiment. Moreover, each embodiment shown below may be appropriately combined within a range that does not cause contradiction.

FIG. 1 is an explanatory diagram showing an example of a foot size measuring device 1 of this embodiment. A foot size measuring device 1 shown in FIG. The mobile terminal 3 is, for example, a terminal device such as a smart phone or a tablet terminal that incorporates an imaging function and a communication function. The server 4 is, for example, an information processing device such as a computer that executes various measurement processes and is located in a shoe manufacturer, a shoe store, or the like. The mobile terminal 3 and the server 4 are in a state of being able to wirelessly communicate via, for example, a wireless LAN (Local Area Network) router 5 or the like. The mount 2 is a mount such as A4 standard size paper on which the user's foot to be measured is placed. Note that the base is not limited to paper, and may be a base made of plastic or the like, and can be changed as appropriate. The portable terminal 3 captures an image of the foot to be measured placed on the mount 2 and transmits the captured image to the server 4 via the wireless LAN router 5 . The server 4 calculates the size measurement result of the foot from the photographed image received from the mobile terminal 3 and transmits the size measurement result to the mobile terminal 3 .

FIG. 2 is a block diagram showing an example of the hardware configuration of the mobile terminal 3. As shown in FIG. The mobile terminal 3 shown in FIG. 2 includes a communication device 11, an input device 12, an output device 13, a camera device 14, a ROM (Read Only Memory) 15, a RAM (Random Access Memory) 16, a CPU (Central Processing Unit) 17 and a bus 18 . The communication device 11 is, for example, a communication IF (Interface) that wirelessly communicates with the wireless LAN router 5 . The input device 12 is an input interface such as an operation device for inputting various information. The output device 13 is an output IF such as a sound output device or a display device that outputs various information. The camera device 14 acquires, for example, a still image of the foot to be measured. The ROM 15 is an area for storing various information such as programs. The RAM 16 is an area for storing various information. The CPU 17 controls the mobile terminal 3 as a whole. A bus 18 is a bus line that connects the communication device 11 , the input device 12 , the output device 13 , the camera device 14 , the ROM 15 , the RAM 16 and the CPU 17 .

FIG. 3 is a block diagram showing an example of the hardware configuration of the server 4. As shown in FIG. The server 4 shown in FIG. 3 has a communication device 21 , an input device 22 , an output device 23 , a HDD (Hard Disk Drive) 24 , a ROM 25 , a RAM 26 , a CPU 27 and a bus 28 . The communication device 21 is, for example, a communication IF that wirelessly connects with the wireless LAN router 5 . The input device 22 is an input IF such as an operation device for inputting various information. The output device 23 is, for example, an output IF such as a sound output device or a display device that outputs various information. The HDD 24 is an area that stores various information. The ROM 25 is an area for storing various information such as programs. The RAM 26 is an area for storing various information. The CPU 27 controls the server 4 as a whole. A bus 28 is a bus line that connects the communication device 21 , the input device 22 , the output device 23 , the HDD 24 , the ROM 25 , the RAM 26 and the CPU 27 .

FIG. 4 is a block diagram showing an example of the functional configuration of the server 4. As shown in FIG. The server 4 shown in FIG. 3 has a storage unit 30 and a control unit 40 . The storage unit 30 corresponds to, for example, a semiconductor memory device such as the RAM 26 and flash memory, or a storage device such as the HDD 24 and an optical disk. The storage unit 30 has an image memory 31 and a length memory 32 . The image memory 31 stores still images of the foot to be measured, for example, a first input image 61, a second input image 71, a first mount area extraction image 64, a second mount area extraction image 74, etc., which will be described later. This is an area for storing various images. The length memory 32 is an area that stores, for example, a first length T1, a second length T2, a foot length L, a foot width W, and the like, which are related to the foot to be measured. The foot length L is the length of the foot to be measured, and the foot width W is the width of the foot to be measured.

The control unit 40 corresponds to an electronic circuit such as the CPU 27, for example. The control unit 40 has an internal memory for storing programs defining various processing procedures and control data, and executes various processing using these. The CPU 27 expands, for example, programs stored in the ROM 25 onto the RAM 26 . The CPU 27 functions as, for example, a reception unit 41 , a measurement unit 42 and an output unit 43 by executing programs developed on the RAM 26 as processes. The receiving unit 41 receives a first input image 61 that is a first image and a second input image 71 that is a second image. The measurement unit 42 measures the foot length L and the foot width W of the foot to be measured from the first input image 61 and the second input image 71 . The output unit 43 outputs the measurement results of the foot length L, the foot width W, and the like.

The measurement unit 42 includes a first extraction unit 51, a first measurement unit 52, a second extraction unit 53, a second measurement unit 54, a foot length measurement unit 55, and a foot width measurement unit 56. have The first extraction unit 51 extracts a first mount area extraction image 64 that is the area of the mount 2 from the first input image 61 . The first measurement unit 52 identifies the toe of the foot to be measured from the extracted first mount area extraction image 64, and measures a first length T1 from the edge M1 of the mount 2 to the tip A1 of the toe. . The second extraction unit 53 extracts a second mount area extraction image 74 that is the area of the mount 2 from the second input image 71 . The second measurement unit 54 identifies the heel of the foot to be measured from the extracted second mount area extraction image 74, and measures a second length T2 from the edge M2 of the mount 2 to the tip A2 of the heel. . The leg length measurement unit 55 measures the leg length L by L1−(T1+T2) based on the first length T1, the second length T2, and the length L1 of the horizontal side of the mount 2. The foot width measurement unit 56 identifies the base of the big toe Y1 and the base of the little finger Y2 from the first mount area extraction image 64, and measures the foot width W by a straight line connecting the base of the big toe Y1 and the base of the little finger Y2.

FIG. 5A is an explanatory diagram showing an example of a method for capturing the first input image 61. FIG. The user prepares A4 standard paper as the mount 2 and puts the foot to be measured on the mount 2 . The size of the mount 2 is the A4 size, which is larger than the size of the feet, so that the feet can be easily positioned on the mount 2. Then, the user puts the foot to be measured on the mount 2 and, for example, moves the toe of the foot from directly above so that the square X, which is the first characteristic point of the mount 2, can be seen with the camera device 14 of the mobile terminal 3. to shoot. A first input image 61 shown in FIG. 5A is a captured image including a toe and a square X that is the first feature point of the mount 2 .

FIG. 5B is an explanatory diagram showing an example of a method for capturing the second input image 71. As shown in FIG. For example, after photographing the first input image 61, the user takes a step forward with the foot opposite to the foot to be measured, and measures so that three sides M, which are the second feature points of the mount 2, can be seen. The heel of the subject's foot is photographed from directly above with the camera device 14 of the portable terminal 3. - 特許庁A second input image 71 shown in FIG. 5B is a captured image including the heel and three sides M that are the second feature points of the mount 2 . The mobile terminal 3 notifies the server 4 of the first input image 61 and the second input image 71 via the wireless LAN router 5 .

FIG. 6 is an explanatory diagram showing an example of images processed until the acquisition of the first mount area extraction image 64 is completed. The first extraction unit 51 converts the first input image 61 into a binary image 61A by luminance threshold processing. The first extraction unit 51 generates a convex hull 62 from the transformed binary image 61A and detects a straight line 63 from the convex hull 62 . Further, the first extraction unit 51 extracts a first board area extraction image 64 that is the area of the board 2 from the first input image 61 along the detected straight line 63 .

FIG. 7 is an explanatory diagram showing an example of processed images until the measurement of the first length T1 is completed. The first measurement unit 52 converts the first mount area extraction image 64 into a binary image 64A by luminance threshold processing. The first measurement unit 52 identifies the foot region from the converted binary image 64A. The first measurement unit 52 cuts out the tip portion of the foot region from the first mount region extraction image 64 as a tip clipped image 65, and converts the tip clipped image 65 into a tip clipped binary image 65A. The first measurement unit 52 identifies the tip A1 of the toe from the tip-cropped binary image 65A. The first measurement unit 52 obtains a top-cut image 65 equivalent to the top-cut binary image 65A from the first mount area extraction image 64, and measures the distance from the mount side M1 to the toe tip A1 in the top-cut image 65. Measure the length as the first length T1.

FIG. 8 is an explanatory diagram showing an example of processed images until the acquisition of the second mount area extraction image 74 is completed. The second extraction unit 53 converts the second input image 71 into a binary image 71A by luminance threshold processing. The second extraction unit 53 selects two horizontal straight lines 72A and one vertical straight line 72B from the converted binary image 71A. The second extraction unit 53 generates a rectangle 73 by adding a new straight line 72C to the selected straight lines 72A and 72B. The second extraction unit 53 extracts a second mount area extraction image 74 from the second input image 71 with a rectangle 73 .

FIG. 9 is an explanatory diagram showing an example of processed images until the measurement of the second length is completed. The second measurement unit 54 converts the second mount area extraction image 74 into a binary image 74A by luminance threshold processing. The second measurement unit 54 extracts the leading end portion from the converted binary image 74A to obtain a leading end clipped binary image 75A. The second measurement unit 54 acquires a tip clipped image 75 equivalent to the tip clipped binary image 75A from the second mount area extraction image 74, and calculates the tip A2 of the heel from the edge M2 of the side of the mount in the tip clipped image 75. is measured as a second length T2.

The foot length measurement unit 55 adds the first length T1 measured from the first input image 61 and the second length T2 measured from the second input image 71, and calculates the horizontal side of the mount 2. The leg length L is calculated by subtracting (T1+T2) from the length L1.

FIG. 10 is an explanatory diagram showing an example of images processed until the measurement of the foot width W is completed. The foot width measurement unit 56 converts the first mount area extraction image 64 into a binary image 64A by luminance threshold processing. The foot width measurement unit 56 identifies the foot region from the converted binary image 64A. The foot width measurement unit 56 cuts out the tip portion of the foot region from the first mount region extraction image 64 as a tip clipped image 66, and converts the tip clipped image 66 into a tip clipped binary image 66A. The foot width measurement unit 56 deletes x% from the tip-cut binary image 66A to obtain a binary image 66B after deletion. The foot width measurement unit 56 measures the foot width W from the base of the big toe Y1 to the base of the little finger Y2 of the binary image 66C obtained by tilting the binary image 66B after deletion by r degrees. The foot width measurement unit 56 specifies the longest position in the vertical direction of the binary image 66C tilted by r degrees as the base of the big toe Y1 and the base of the little finger Y2, and measures the foot width W using the base of the big toe Y1 and the base of the little finger Y2. do.

The output unit 43 outputs the size measurement results of the foot to be measured, including the foot length L measured by the foot length measurement unit 55 and the foot width W measured by the foot width measurement unit 56 . The output unit 43 notifies the user's portable terminal 3 of the foot size measurement result, for example. As a result, the user of the mobile terminal 3 can recognize the size of the foot to be measured. In addition to the foot size measurement result, the output unit 43 presents to the portable terminal 3 products including shoes corresponding to the foot size measurement result. As a result, the user of the mobile terminal 3 can recognize products suitable for the foot size to be measured.

Next, the operation of the foot size measuring device 1 of this embodiment will be described. FIG. 11 is a flowchart showing an example of the processing operation of the server 4 involved in the foot size measurement process. In FIG. 11, the server 4 determines whether or not the first input image 61 shown in FIG. 5A has been obtained (step S11). The first input image 61 is a captured image captured by the mobile terminal 3 and includes the toe of the foot to be measured and the first characteristic point of the mount 2 . When the server 4 acquires the first input image 61 (Yes at step S11), the server 4 accepts the first input image 61 (step S12).

As shown in FIG. 6, the server 4 executes a first mount area extraction process for extracting a first mount area extraction image 64 from the first input image 61 (step S13). The server 4 determines whether or not the extraction of the first mount area extraction image 64 has succeeded (step S14). When the extraction of the first mount area extraction image 64 is successful (Yes at step S14), the server 4 measures the first length T1 from the first mount area extraction image 64 as shown in FIG. 1 measurement processing is executed (step S15). The first length T1 is the length from the edge M1 of the mount 2 to the tip A1 of the toe. The server 4 determines whether or not the measurement of both the first length T1 and the second length T2 has been completed (step S16).

If the measurement of both lengths has not been completed (No at step S16), the server 4 proceeds to step S11 to determine whether or not the first input image 61 has been acquired. If the server 4 has not acquired the first input image 61 (No at step S11), it determines whether or not the second input image 71 shown in FIG. 5B has been acquired (step S17). It is a captured image captured by the mobile terminal 3 including the second input image 71 wave, the heel of the foot to be measured, and the second feature point of the mount 2 .

When the server 4 acquires the second input image 71 (Yes at step S17), the server 4 accepts the second input image 71 (step S18). The server 4 executes a second mount area extraction process for extracting a second mount area extraction image 74 from the second input image 71 as shown in FIG. 8 (step S19). The server 4 determines whether or not the extraction of the second mount area extraction image 74 has succeeded (step S20).

When the extraction of the second mount area extraction image 74 is successful (Yes at step S20), the server 4 measures the second length T2 from the second mount area extraction image 74 as shown in FIG. is executed (step S21). The second length T2 is the length from the edge M2 of the mount 2 to the tip A2 of the heel. The server 4 proceeds to step S16 to determine whether or not the measurement of both the first length T1 and the second length T2 has been completed.

The server 4 calculates the leg length L by the length L1 of the mount 2-(first length T1+second length T2) (step S22). The server 4 executes foot width measurement processing for measuring the foot width W from the first input image 61 as shown in FIG. 10 (step S23). Further, the server 4 outputs the measurement result of the foot size including the foot width W and the foot length L (step S24), and ends the processing operation shown in FIG.

The server 4 acquires the first input image 61 to extract a new first mount area extraction image 64 if the extraction of the first mount area extraction image 64 is not successful (No at step S14). In order to determine whether or not, the process proceeds to step S11. The server 4 acquires the first input image 61 to extract a new second mount area extraction image 74 if the extraction of the second mount area extraction image 74 is not successful (No at step S20). In order to determine whether or not, the process proceeds to step S11. If the server 4 has not acquired the second input image 71 (No at step S17), the process proceeds to step S11 to determine whether or not the first input image 61 has been acquired.

11, the server 4 executing the foot size measurement process calculates a first length T1 from the edge M1 of the mount 2 to the tip A1 of the toe based on the first input image 61 including the toe and the first feature point. to measure Further, the server 4 measures a second length T2 from the edge M2 of the mount 2 to the heel tip A2 based on the second input image 71 including the heel and the second feature point. As a result, the server 4 can measure the leg length L of the measurement target from the length L1-(T1+T2) of the horizontal side of the mount 2. FIG.

Further, the server 4 measures the foot width W to be measured from the first mount area extraction image 64 of the first input image 61 . Then, the server 4 outputs the foot length L and the foot width W to be measured as the measurement result of the foot size. As a result, the user can easily measure the foot length L and the foot width W only from the photographed image.

FIG. 12 is a flow chart showing an example of the processing operation of the server 4 involved in the first mount area extraction process. 12, the first extraction unit 51 in the server 4 converts the first input image 61 into a binary image 61A by luminance threshold processing as shown in FIG. 6 (step S31). The first extractor 51 executes the first clipping process shown in FIG. 13 to clip the first mount area extraction image 64 from the converted binary image 61A (step S32).

The first extraction unit 51 determines whether or not the extraction of the first mount area extraction image 64 has succeeded in the first extraction process (step S33). When the extraction of the first mount area extraction image 64 is successful (Yes at step S33), the first extraction unit 51 determines that the extraction of the first mount area extraction image 64 is successful (step S34). 12 ends.

If the first extracting process fails to extract the first mount area extracted image 64 (No at step S33), the first extracting unit 51 converts the first input image 61 to 2 by the saturation threshold process. It is converted into the value image 61A (step S35). The first extractor 51 executes the first clipping process shown in FIG. 12 in order to clip the first mount area extracted image 64 from the converted binary image 61A (step S32A).

The first extraction unit 51 determines whether or not the first mount area extraction image 64 has been successfully extracted in the first extraction process of step S32A (step S36). When the extraction of the first mount area extraction image 64 is successful (Yes at step S36), the first extraction unit 51 proceeds to step S34 to determine that the first mount area extraction image 64 has been successfully extracted. do.

When the extraction of the first mount area extraction image 64 is not successful (No at step S36), the first extraction unit 51 determines that the extraction of the first mount area extraction image 64 has failed (step S37), The processing operation shown in FIG. 12 ends.

The server 4 that executes the first mount area extraction process shown in FIG. 12 converts the first input image 61 into a binary image 61A using the luminance threshold, and extracts the first mount area from the converted binary image 61A. It is determined whether or not the image 64 has been cut out successfully. As a result, the server 4 can extract the first mount area extraction image 64 from the first input image 61 using the brightness threshold.

The server 4 converts the first input image 61 into a binary image with a saturation threshold when the clipping of the first mount area extraction image 64 fails with the binary image 61A with the luminance threshold, and It is determined whether or not the first mount area extraction image 64 has been successfully cut out from the image. As a result, the server 4 can extract the first mount area extraction image 64 from the first input image 61 using the saturation threshold.

FIG. 13 is a flowchart showing an example of the processing operation of the server 4 related to the first clipping process. The first extraction unit 51 in the server 4 shown in FIG. 13 extracts a region having the largest area in the converted binary image 61A (step S41). The largest area is the white area in the binary image 61A shown in FIG. The first extraction unit 51 generates a convex hull of the extracted area (step S42). The first extraction unit 51 determines whether the generated convex hull is a quadrangle (step S43).

If the convex hull is a quadrangle (Yes at step S43), the first extraction unit 51 cuts out the quadrangle region from the first input image 61 and performs trapezoidal correction (step S44). In trapezoidal correction, the clipped image is corrected so that the aspect ratio of the rectangle matches the size of the mounting paper 2 . After the trapezoidal correction of the clipped image, the first extraction unit 51 determines that the clipping of the first mount area extraction image 64 has succeeded (step S45), and terminates the processing operation shown in FIG.

If the convex hull is not a quadrilateral (No at step S43), the first extraction unit 51 detects straight lines in the extracted region (step S46). The first extraction unit 51 determines whether or not a quadrangle can be created from the detected straight lines (step S47). When the rectangle cannot be created (No at step S47), the first extraction unit 51 determines that the extraction of the first mount area extraction image 64 has failed (step S48), and terminates the processing operation shown in FIG.

If a quadrangle can be created from the detected straight lines (Yes at step S47), the first extraction unit 51 proceeds to step S44 to extract a quadrangle region from the first input image 61 and perform trapezoidal correction.

The server 4 that executes the first extraction process shown in FIG. 13 extracts a region having the largest area in the binary image 61A, generates a convex hull of the extracted region, and if the convex hull is a quadrilateral, Keystone correct the region. Further, the server 4 obtains a first mount area extraction image 64 by extracting the quadrangle after keystone correction from the first input image 61 . As a result, the server 4 can extract from the first input image 61 the first mount area extraction image 64 on which the foot width can be measured.

If the convex hull is not quadrilateral, the server 4 detects straight lines in the extracted area, and if the detected straight lines can form a quadrilateral, trapezoidally corrects the quadrilateral area. Further, the server 4 obtains a first mount area extraction image 64 by extracting the quadrangle after keystone correction from the first input image 61 . As a result, the server 4 can extract from the first input image 61 the first mount area extraction image 64 on which the foot width can be measured.

FIG. 14 is a flowchart showing an example of processing operations of the server 4 related to the first measurement processing. 14, the first measurement unit 52 in the server 4 converts the first mount area extraction image 64 into a binary image 64A by threshold processing as shown in FIG. 7 (step S51). The first measurement unit 52 extracts a region having the largest area from the converted binary image 64A and identifies it as the first foot region (step S52). The region with the largest area is the white first leg region in the binary image 64A. The first measurement unit 52 cuts out a clipped image 65 of the tip portion of the first foot region from the edge M1 of the mount 2 from the first mount region extraction image 64, and converts the cutout image 65 into a binary image 65A ( step S53).

The first measurement unit 52 identifies the point of the first foot region closest to the edge M1 of the mount 2 in the converted binary image 65A as the toe tip A1 (step S54). The first measuring unit 52 measures the length from the edge M1 of the mount 2 to the tip A1 of the toe as the first length T1 (step S55), and ends the processing operation shown in FIG.

The server 4 that executes the first measurement process shown in FIG. to the tip of the toe A1 can be measured as a first length T1.

FIG. 15 is a flow chart showing an example of the processing operation of the server 4 involved in the second board area extraction process. 15, the second extraction unit 53 in the server 4 converts the second input image 71 shown in FIG. 8 into a binary image 71A by luminance threshold processing (step S61). The second extraction unit 53 executes the second extraction process shown in FIG. 16 in order to extract the second mount area extraction image 74 from the converted binary image 71A (step S62).

The second extraction unit 53 determines whether or not the extraction of the second mount area extraction image 74 has succeeded in the second extraction process (step S63). When the extraction of the second mount area extraction image 74 is successful (Yes at step S63), the second extraction unit 53 determines that the extraction of the second mount area extraction image 74 is successful (step S64). 16 ends.

If the extraction of the second mount area extraction image 74 is not successful in the second extraction process (No in step S63), the second extraction unit 53 converts the second input image 71 to 2 by the saturation threshold process. It is converted into the value image 71A (step S65). The second extractor 53 executes the second clipping process shown in FIG. 16 to clip the second mount area extracted image 74 from the converted binary image 71A (step S62A).

The second extraction unit 53 determines whether or not the extraction of the second mount area extraction image 74 has succeeded in the second extraction processing of step S62A (step S66). When the extraction of the second mount area extraction image 74 is successful (Yes at step S66), the second extraction unit 53 proceeds to step S64 to determine that the extraction of the second mount area extraction image 74 is successful. do.

If the extraction of the second mount area extraction image 74 is not successful (No at step S66), the second extraction unit 53 determines that the extraction of the second mount area extraction image 74 has failed (step S67), The processing operation shown in FIG. 15 ends.

The server 4 that executes the second board area extraction process shown in FIG. 15 converts the second input image 71 into a binary image 71A using the luminance threshold, and extracts the second board area from the converted binary image 71A. It is determined whether or not the image 74 has been cut out successfully. As a result, the server 4 can extract the second mount area extraction image 74 from the second input image 71 using the brightness threshold.

The server 4 converts the second input image 71 into a binary image with a saturation threshold when the clipping of the second mount area extraction image 74 fails with the binary image 71A with the luminance threshold, and It is determined whether or not the extraction of the second mount area extraction image 74 has succeeded from the image. As a result, the server 4 can extract the second mount area extraction image 74 from the second input image 71 using the saturation threshold.

FIG. 16 is a flowchart showing an example of the processing operation of the server 4 related to the second clipping process. The second extraction unit 53 in the server 4 shown in FIG. 16 extracts a region having the largest area in the converted binary image 71A (step S71). The largest area is the white area in the binary image 71A shown in FIG. The second extraction unit 53 detects straight lines in the extracted area (step S72). The second extraction unit 53 selects two horizontal straight lines 72A and one vertical straight line 72B with strong edges from the binary image 71A (step S73), and extracts a straight line 72C so as to include the extracted area. is added (step S74). The second extraction unit 53 determines whether or not a quadrangle can be created from the selected straight lines 72A and 72B and the additional straight line 72C (step S75).

If a quadrangle can be created (Yes at step S75), the second extraction unit 53 extracts the created quadrangle area from the second input image 71 as the second mount area extraction image 74 (step S76). The second extraction unit 53 determines whether or not the extraction of the second mount area extraction image 74 has succeeded (step S77). If a rectangle cannot be created (No at step S75), the second extraction unit 53 determines that the extraction of the second mount area extraction image 74 has failed (step S78), and terminates the processing operation shown in FIG.

The server 4 that executes the second extraction process shown in FIG. 16 extracts a region having the largest area in the binary image 71A, creates a quadrangle with straight lines with strong edges and additional straight lines in the extracted region, A second mount area extraction image 74 is obtained by cutting out a rectangle from the second input image 71 . As a result, the server 4 can extract the second mount area extraction image 74 from the second input image 71 .

FIG. 17 is a flowchart showing an example of the processing operation of the server 4 related to the second measurement process. 17, the second measurement unit 54 in the server 4 converts the second mount area extraction image 74 into a binary image 74A by threshold processing as shown in FIG. 9 (step S81). The second measurement unit 54 extracts a region having the largest area from the converted binary image 74A and identifies it as the second foot region (step S82). The region with the largest area is the white second leg region in the binary image 74A. The second measurement unit 54 cuts out a clipped image of the tip portion of the second foot region from the edge M2 of the mount 2 from the second mount region extraction image 74, and converts the cutout image into a binary image 75A (step S83). ).

The second measurement unit 54 identifies the point of the second foot region closest to the edge M2 of the mount 2 in the converted binary image 75A as the tip A2 of the heel (step S84). The second measuring unit 54 measures the length from the edge M2 of the mount 2 to the tip A2 of the heel as the second length T2 (step S85), and ends the processing operation shown in FIG.

The server 4 that executes the second measurement process shown in FIG. to the heel tip A2 can be measured as a second length T2. As a result, the leg length can be calculated by L1-(T1+T2).

FIG. 18 is a flowchart showing an example of the processing operation of the server 4 relating to the foot width measurement process. In FIG. 18, the foot width measurement unit 56 in the server 4 converts the first mount area extraction image 64 into a binary image 64A by threshold processing (step S91). The foot width measurement unit 56 extracts the region having the largest area in the converted binary image 64A and identifies it as the first foot region (step S92). Note that the area having the largest area in the binary image 64A is, for example, the white first foot area.

The foot width measurement unit 56 converts the clipped image 66 from the edge of the mount 2 to the tip of the first foot region into a binary image 66A (step S93), and calculates the first leg region of the binary clipped image 66A. Exclude x% from the top (step S94). The foot width measurement unit 56 tilts the first foot region after x% exclusion by r degrees to search for the longest position in the vertical direction, and specifies the points at both ends as the base of the big toe Y1 and the base of the little finger Y2 (step S95). ).

The foot width measurement unit 56 identifies the foot width W from the identified thumb base Y1 and little finger base Y2 (step S96), measures the identified foot width W (step S97), and performs the processing operation shown in FIG. exit.

The server 4, which executes the foot width measurement process shown in FIG. The first foot region is tilted at a predetermined angle r, and the longest position in the vertical direction is identified. Furthermore, the server 4 measures the foot width W at these specified positions (the base of the big toe and the base of the little finger). As a result, the foot width of the measurement target can be measured from the captured image.

In the foot size measuring device 1 of the present embodiment, a first input image 61 including the toe of the foot placed on the mount 2 of a predetermined size and the first feature point, and the foot placed on the mount 2 receive a second input image containing the heel of the foot and a second feature point. In the foot size measuring device 1, the first length T1 from the edge M1 of the mount 2 to the tip of the toe A1 in the first input image 61 and the heel from the edge M2 of the mount 2 in the second input image 71 The foot length L is output as the length obtained by subtracting the second length T2 from the length L1 of the mount 2 to the tip A2. As a result, the leg length L can be easily calculated only from the photographed image. In general, the foot to be measured has a shape including a portion overlapping the area in contact with the mount 2 when viewed from above the mount 2, and the entire outline of the area in contact with the mount 2 cannot be photographed in one shot. However, the foot size measuring device 1 of this embodiment does not specify the entire contour of the foot. A second input image 71 containing points is used. As a result, the foot width W and the foot length L can be measured without the entire contour of the foot.

Since the first input image 61 is an image including squares of the mount 2 and the second input image 71 is an image including three sides of the mount 2, the first length T1 and the second Based on the length T2 and the length L1 of the mount 2, the leg length L can be calculated.

The foot size measuring device 1 extracts the foot region from the first input image 61, deletes the tip portion of the extracted foot region, tilts the deleted foot region at a predetermined angle, and determines the longest position in the predetermined direction. Specify (thumb base Y1 and little finger base Y2). The foot size measuring device 1 measures the foot width W at these specified positions. As a result, the foot width W can be easily calculated only from the photographed image.

The foot size measuring device 1 extracts a first mount area extraction image 64 from a first input image 61, extracts a foot area from the first mount area extraction image 64, and measures the toe of the foot from the extracted foot area. identify. Further, the foot size measuring device 1 extracts a second mount area extraction image 74 from the second input image 71, extracts a foot area from the second mount area extraction image 74, and extracts a foot area from the extracted foot area. identify the heel of the As a result, the toe and heel of the foot to be measured can be identified from the captured image.

In the foot size measuring device 1, the first input image 61 is converted into a binary image 61A using a brightness threshold. , the first input image 61 is converted into a binary image using a saturation threshold. Furthermore, the foot size measuring device 1 extracts the first mount area extraction image 64 from the converted binary image. As a result, the first mount area extraction image 64 can be extracted from the first input image 61 with luminance or saturation.

In the foot size measuring device 1, since the size of the mount 2 is a sheet larger than a general foot size, the foot area can be easily extracted simply by placing the foot to be measured on the mount 2, and the size of the foot to be measured can be easily extracted. Positioning becomes easier. Moreover, the mounting paper 2 can be easily obtained because it can be an A4 standard paper. In this embodiment, since the size of the mount 2 is larger than the size of the foot, the foot length L can be accurately measured by reducing the influence of distortion during photographing.

For convenience of explanation, the case where the foot size measuring device 1 of the first embodiment is executed by the server 4 has been exemplified. Foot width W and foot length L may be measured from 71, and can be changed as appropriate. Further, the foot size measuring device 1 measures the foot width W and the foot length L from the first input image 61 and the second input image 71 using an application in the mobile terminal 3 instead of the server 4. is good and can be changed accordingly.

Although the case where the mobile terminal 3 is wirelessly connected to the server 4 via the wireless LAN router 5 has been exemplified, the mobile terminal 3 may be directly connected to the server 4 by wire or wirelessly without via the wireless LAN router 5. , can be changed as appropriate.

Although the mount 2 is, for example, an A4 standard paper, it may be a rectangular mount for magazines, newspapers, flyers, or the like, and can be changed as appropriate. Also, as the table, for example, the A4 standard mount 2 may be set as a default, and an arbitrary table may be selected from a plurality of types of tables according to the user's setting operation. In this case, it is assumed that the server 4 stores the length of the side for each type of base. Also, although the mounting paper 2 has been exemplified as a square rectangle, it may be a square, and can be changed as appropriate.

In the above embodiment, the case where either one of the first measurement process and the second measurement process is executed was exemplified, but the first measurement process and the second measurement process may be executed in parallel. Can be changed.

Furthermore, in the embodiment, the case where the foot width measurement process is executed after measuring the foot length is illustrated, but the foot width measurement process may be executed before measuring the foot length, and can be changed as appropriate.

In the embodiment, the foot width measurement process is executed after the foot length is measured, but the first measurement process and the foot width measurement process may be executed in parallel or serially, and can be changed as appropriate. be.

In the above embodiment, the first input image 61 captured by the camera device 14 of the mobile terminal 3 from directly above the first feature point and the toe of the foot, and the second input image 61 with the second feature point and the heel of the foot photographed directly above The case of obtaining the second input image 71 photographed from . Therefore, in the mobile terminal 3, for example, an application determines whether or not the first input image 61 photographed by the camera device 14 includes the first feature point and the toes. A mechanism may be provided to notify the user of an error when there is no first feature point or the like. Similarly, the mobile terminal 3 determines whether or not the second input image 71 photographed by the camera device 14 includes the second feature point and the heel, and determines whether the second input image 71 includes the second feature point. If there are no points or the like, an error may be notified to the user.

Also, each constituent element of each part illustrated does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution and integration of each part is not limited to the one shown in the figure, and all or part of it can be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions. can be configured as

Furthermore, the various processing functions performed by each device are implemented on a CPU (Central Processing Unit) (or a microcomputer such as an MPU (Micro Processing Unit) or MCU (Micro Controller Unit)), in whole or in part. You can make it run. In addition, various processing functions may be executed in whole or in part on a program analyzed and executed by a CPU (or a microcomputer such as an MPU or MCU) or on hardware based on wired logic. Needless to say.

By the way, various kinds of processing described in this embodiment can be realized by executing a program prepared in advance by an information processing apparatus. Therefore, an example of an information processing apparatus that executes a program having functions similar to those of the above embodiment will be described below. FIG. 19 is an explanatory diagram showing an example of the information processing device 100 that executes the foot size measurement program.

Information processing apparatus 100 for executing the foot size measurement program shown in FIG.

The ROM 140 pre-stores a foot size measurement program that performs the same function as in the above embodiment. The foot size measurement program may be recorded in a recording medium readable by a drive (not shown) instead of the ROM 140 . The recording medium may be, for example, a CD-ROM, a DVD disk, a USB memory, a portable recording medium such as an SD card, or a semiconductor memory such as a flash memory. As shown in FIG. 19, the foot size measurement program includes a reception program 140A and an output program 140B. Incidentally, the programs 140A and 140B may be integrated or distributed as appropriate.

Then, the CPU 160 reads out these programs 140A and 140B from the ROM 140 and expands the read out programs on the work area of the RAM 150. FIG. Then, as shown in FIG. 19, the CPU 160 functions the programs 140A and 140B developed on the RAM 150 as a reception process 150A and an output process 150B.

The CPU 160 generates a first image including the toes of a foot placed on a platform of a predetermined size and a first characteristic point of the platform, and a second image of the heel of the foot placed on the platform and the platform. A second image containing feature points is accepted. The CPU 160 calculates the first feature point included in the first image, the first length from the edge of the platform to the toe of the foot, the second feature point included in the second image, and the length of the foot from the edge of the platform. Output the foot length as the length of the platform minus the second length to the heel. As a result, the leg length can be calculated simply by photographing.

1 foot size measuring device 2 mount 3 mobile terminal 4 server 14 camera device 41 reception unit 42 measurement unit 43 output unit

Claims (7)

the computer
A first image including a toe of a foot placed on a platform of a predetermined size and a first feature point of the platform, and a second feature point of the heel of the foot placed on the platform and the platform. accepts a second image and
A first length from the edge of the platform to the toe of the foot included in the first image and a second length from the edge of the platform to the heel of the foot included in the second image and outputting the length of the foot by subtracting the length from the length of the platform. The platform has a rectangular shape,
The first image is an image containing a square of the platform as the first feature point,
2. The method of measuring foot size according to claim 1, wherein said second image is an image including at least three of the four sides of said platform as said second characteristic point. The computer further comprises:
A foot region is extracted from the first image, the tip portion of the extracted foot region is deleted, the deleted foot region is tilted at a predetermined angle to identify the longest position in a predetermined direction, and these identified positions The foot size measuring method according to claim 1 or 2, wherein the step of measuring the width of the foot is performed. The computer further comprises:
extracting a first extracted image that is the area of the platform from the first image, extracting a foot area from the first extracted image, and specifying the toe of the foot from the extracted foot area;
extracting a second extracted image as the area of the platform from the second image, extracting a foot area from the second extracted image, and specifying the heel of the foot from the extracted foot area. The foot size measuring method according to any one of claims 1 to 3, characterized in that: The computer further comprises:
As processing for extracting the first extracted image from the first image,
When the first image is converted into a binary image with a luminance threshold, and the extraction of the first extracted image from the converted binary image fails, the first image is converted into a binary image with a saturation threshold. 5. The foot size measuring method according to claim 4, further comprising converting the binary image into a value image and extracting the first extracted image from the converted binary image. A first image including a toe of a foot placed on a platform of a predetermined size and a first feature point of the platform, and a second feature point of the heel of the foot placed on the platform and the platform. a reception unit that receives a second image to be included;
A first length from the edge of the platform to the toe of the foot included in the first image and a second length from the edge of the platform to the heel of the foot included in the second image and an output unit for outputting a foot length as a length obtained by subtracting the length from the length of the table. A first image including a toe of a foot placed on a platform of a predetermined size and a first feature point of the platform, and a second feature point of the heel of the foot placed on the platform and the platform. accepts a second image and
A first length from the edge of the platform to the toe of the foot included in the first image and a second length from the edge of the platform to the heel of the foot included in the second image A foot size measurement program for causing a computer to execute a process of outputting a foot length as a length obtained by subtracting the length from the length of the table.

Images