Nothing Special   »   [go: up one dir, main page]

CN103646408A - Image based human foot key part data extraction and measurement method - Google Patents

Image based human foot key part data extraction and measurement method Download PDF

Info

Publication number
CN103646408A
CN103646408A CN201310731335.6A CN201310731335A CN103646408A CN 103646408 A CN103646408 A CN 103646408A CN 201310731335 A CN201310731335 A CN 201310731335A CN 103646408 A CN103646408 A CN 103646408A
Authority
CN
China
Prior art keywords
image
foot
paper
heel
toe
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310731335.6A
Other languages
Chinese (zh)
Other versions
CN103646408B (en
Inventor
谢凤英
李阳
潘琛
孙婉莹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beihang University
Original Assignee
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University filed Critical Beihang University
Priority to CN201310731335.6A priority Critical patent/CN103646408B/en
Publication of CN103646408A publication Critical patent/CN103646408A/en
Application granted granted Critical
Publication of CN103646408B publication Critical patent/CN103646408B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Analysis (AREA)

Abstract

一种基于图像的人脚关键部位的数据提取与测量方法,步骤如下:步骤1:图像获取;步骤2:检测A4纸四个角顶点坐标,对图像进行几何校正;步骤3:正面脚的目标提取与测量;步骤4:侧面脚的目标提取与测量;本发明通过几何校正、图像处理技术能够有效的获取脚的关键部位的数据,可以满足购鞋者选着鞋码和鞋商制鞋时的需求,其误差均在2毫米之内。该方法在网上鞋店可以将得到的数据作为参考,为用户提供更准确的鞋码和款式,提高网上购物的成功率。该数据还可用于制鞋厂商为消费者提供专门的定制服务,即能帮助用户选择或定制到满意的鞋子,又能节约商家在销售环节因退换服务而产生的费用。

Figure 201310731335

An image-based data extraction and measurement method for key parts of the human foot, the steps are as follows: Step 1: Image acquisition; Step 2: Detect the coordinates of the vertices of the four corners of the A4 paper, and perform geometric correction on the image; Step 3: The target of the front foot Extraction and measurement; step 4: target extraction and measurement of the side foot; the present invention can effectively obtain the data of the key parts of the foot through geometric correction and image processing technology, which can meet the needs of shoe buyers when choosing shoe sizes and shoe manufacturers. requirements, the error is within 2 mm. The method can use the obtained data as a reference in online shoe stores to provide users with more accurate shoe sizes and styles and improve the success rate of online shopping. This data can also be used by shoe manufacturers to provide consumers with customized services, which can help users choose or customize shoes to their satisfaction, and can save merchants the cost of returning and exchanging services in the sales process.

Figure 201310731335

Description

A kind of data of the people's pin key position based on image are extracted and measuring method
(1) technical field:
The data that the present invention relates to a kind of people's pin key position based on image are extracted and measuring method, belong to the technical field of image processing and photography dimensional measurement.
(2) background technology:
People needs walking, and shoes comfort level affects quality of life.The brand of footwear is numerous, and each brand can have indoor design parameter and the streamline of own exclusive footwear.For the definite footwear of a pair of number, the width of footwear and height, the shape of sole and parameter of slope design and shoe tree etc., all can exert an influence to the comfort of pin.The footwear that how meet people's physilogical characteristics according to people's pin type design are very professional problems.The style of footwear is numerous, is not but that every a pair of shoes is all applicable to oneself.Buying footwear is bothersome things, especially all the more so for a bit special people of pin type.In shopping at network today prevailing, rely on merely a footwear code information to be difficult to buy comfortable shoes.If the key position data of pin can be extracted, as businessman, for the reference data that user selects footwear code and style, can improve undoubtedly the success ratio of shopping at network, the expense that minimizing produces because of Returns.
The present invention adopts A4 paper as object of reference (standard size is 210 millimeters * 297 millimeters), and user steps down in pin on an A4 paper, and acquisition of image data is extracted pin target, and according to the proportionate relationship of pin and A4 paper, completes extraction and the measurement of foot's critical data.
(3) summary of the invention:
1, object: the object of the present invention is to provide a kind of data of the people's pin key position based on image to extract and measuring method, to adapt to the needs of current shopping at network.The method can be obtained the data of people's pin key position, and the success ratio of shopping online can by the data that obtain as a reference, for user provides footwear code and style more accurately, improve in online shoes store.Further, these data also can be used for shoemaking manufacturer provides special customize services for consumer.Therefore, this invention can help user to select or be customized to satisfied shoes, can save again the expense that businessman produces because of the service of replacing at sales section.
2, technical scheme: the present invention is achieved through the following technical solutions.
The data of a kind of people's pin key position based on image of the present invention are extracted and measuring method, and the method comprises following four steps:
Step 1: Image Acquisition
This programme is wide by proportionate relationship calculating pin length and pin between people's pin and A4 paper, and according to the proportionate relationship between instep height and the length of pin, calculates the true altitude of instep key position.Therefore, need to take two width images, a width is that (hereinafter to be referred as front, shining) shone in the front of pin, as Fig. 1 (a) is positive, shines as shown in image acquisition mode schematic diagram, requires pin to step down on white A4 paper, and camera is taken vertically downward directly over pin; Another width is that (hereinafter to be referred as side, shining) shone in the side of pin, requires camera, from the inner side of pin, pin is carried out to side projection, if Fig. 1 (b) side is according to image acquisition mode schematic diagram.Specific requirement and operation are as follows:
1. the acquisition method of positive photograph: white A4 paper minor face one side is pasted to wall and place; User steps down in pin on A4 paper, makes the axis of pin align with the axis of A4 paper as far as possible; Heel, by wall, makes the alignment of heel position HeA4 paper edge, and the length direction of pin is consistent with the length direction of A4 paper, and it is inner to guarantee that pin drops on A4 paper completely; Camera directly over pin between 50 centimetres to 70 centimetres, take that angle is perpendicular to the ground carries out imaging, keep A4 paper not crooked in image as far as possible, and guarantee to comprise completely in visual field A4 paper region.
2. the acquisition method of side photograph; Side, according to not needing A4 paper, only needs subscriber station before wall or a pure color baffle plate, and the outside of pin is by wall or baffle plate; Camera lens is from the outside imaging of the interior side direction pin of pin, apart from 30 centimetres to 50 centimetres of the distances of side pin, takes angle and is parallel to ground, and keep same height with instep;
3. in visual field, scene will be tried one's best simply: positive as requested only comprises pin, A4 paper and floor in visual field; The background of side photograph should be simple wall or baffle plate, avoids other chaff interference to occur; Require user to wear black or other dark socks, to guarantee that there is enough large contrast contrast on pin, A4 paper and floor simultaneously.
Step 2: detect four angular vertex coordinates of A4 paper, image is carried out to geometry correction
Image tends to produce geometric distortion in the process of obtaining or showing.Geometric distortion comprises translation, convergent-divergent, rotation and perspective and more complicated geometric distortion.The equation that arbitrarily geometric distortion all can transform to distorted coordinates system (x', y') by non-distorted coordinates system (x, y) defines.Suppose that f (x, y) is undistorted original image, g (x', y') is the geometric distortion result of f (x, y), can obtain the fundamental relation formula of geometry correction, as follows:
g ( x ′ , y ′ ) = f ( x , y ) x ′ = h 1 ( x , y ) y ′ = h 2 ( x , y )
In formula, h 1(x, y) and h 2(x, y) is for proofreading and correct transforming function transformation function.In this programme, h 1(x, y) and h 2(x, y) is similar to polynomial expression below:
h 1 ( x , y ) = a 0 x + a 1 y + a 2 a 6 x + a 7 y + 1
h 2 ( x , y ) = a 3 x + a 4 y + a 5 a 6 x + a 7 y + 1
Because the actual relative coordinate of four angular vertexs of standard A 4 paper is known, in this programme using four angular vertexs of A4 paper as reference mark, by image processing techniques, detect the coordinate at four angles of A4 paper in geometric distortion image, and then utilize correction transforming function transformation function and bilinear interpolation method to carry out geometry distrotion correction to distorted image.Specific implementation process is as follows:
1. row rim detection is shone into in front.Utilize Sobel operator according to image, to carry out edge extracting to front, obtain the gradient map of image.In gradient map, the edge of target has become bright band, and target and background region is because grey scale change is more smooth, therefore in gradient map, has formed dark space;
2. to gradient image binaryzation.A4 paper and the formed edge of pin target occupy very little a part of region in image, are made as 0.1 of image area.Gradient map is carried out to statistics with histogram, and the edge pixel gray-scale value of image is higher, will be distributed in histogram position on the right side, but not edge pixel concentrates on the keep left position of side of histogram.The cumulative probability of compute histograms (being the pixels statistics of image border) left from the histogram rightmost side, and be that 0.1 corresponding gray-scale value is set as threshold value by cumulative probability, the pixel that is less than threshold value is set to 255, the pixel that is greater than threshold value is set to 0, thereby extracts the edge that comprises A4 paper and pin target;
3. four of Preliminary detection A4 paper angular vertex position coordinateses.To the aforementioned the bianry image 2. obtaining in step, on transverse axis, in the scope of [5 °, 5 °], take 1 ° image is carried out to Gray Projection as step-length.Because two of the left and right longitudinal edge of A4 paper is the strong edge in image, its can form extreme value on correct projecting direction.And according to priori, A4 paper is in the centre position of image, from image centre position to both sides, detect the extreme value of Gray Projection, just can detect two longitudinal edges in left and right and their deflection.Same way can detect two widthwise edges and their deflection up and down of A4 paper.Calculate the point of crossing between two longitudinal edges in left and right and upper and lower two widthwise edges, can obtain the rough coordinates of four angular vertex positions of A4 paper.
4. accurately detect four angular vertex position coordinateses of A4 paper.3. centered by four the angular vertex position coordinateses of A4 paper that obtain in by step, the subgraph of four 140 * 140 sizes of relevant position intercepting on former gray-scale map.In four subgraphs, the ratio of the shared image area in edge is set to 0.15, repeats step above 1. to 3., can obtain the accurate coordinates of four angular vertex positions of A4 paper.
5. image is carried out to geometry correction.The relative coordinate of actual four angular vertexs of A4 paper is known, utilizes above-mentioned correction transforming function transformation function and bilinear interpolation method to carry out geometry correction to distorted image.
6. intercept A4 paper subgraph, remove useless background.After image rectification, the region at A4 paper place is exactly the rectangle of a standard, and the length breadth ratio of rectangle is exactly the length breadth ratio of A4 paper.We intercept this rectangle from image, remove background.This subgraph inside intercepting is exactly the pin target that we will detect.We carry out for this A4 paper subimage in follow-up processing.
Step 3: the target of front pin is extracted and measured
By step 2, be truncated to A4 paper subimage, we will extract pin length and wide two data of pin from this number of sub images.Specific implementation process is as follows:
(1) detection of toe position
Toe is to drop in the first half region of A4 paper, and heel is to align with the base of A4 paper.Therefore can detect in the first half of A4 paper subgraph the position of toe, and it is long according to the proportionate relationship of pin and A4 paper, to calculate pin.Detailed process is:
1. intercept A4 paper subimage the first half subarea, utilize Sobel operator to carry out rim detection; According to priori, the edge that pin target forms in this subarea accounts for 0.06 of subarea area, and this programme carries out threshold value selection with 0.06 area ratio, and binaryzation is carried out in subarea.
2. in bianry image, have the noise spot being scattered, adopt closing operation of mathematical morphology to carry out filtering to binary map, the size of computing template is 5 * 5
0 0 1 0 0 0 1 1 1 0 1 1 1 1 1 0 1 1 1 0 0 0 1 0 0
3. to the bianry image after denoising, press from the top down each impact point of line search.Centered by this impact point, get 5 * 8 window, by the upper and lower doubling of window, on former gray-scale map, add up the gray scale difference of correspondence position in doubling window, and be averaging.And first meets gray scale difference mean value be greater than 30 impact point be the position of toe, with (x, y), represent.
(2) position probing of first metatarsal bone and fifth metatarsal bone
From professional angle, the width of sole refers to the distance between the first metatarsal bone of pin (inner side of pin) and fifth metatarsal bone (outside of pin).And first metatarsal bone is positioned at 69.5% position from heel to toe, fifth metatarsal bone is positioned at 62.5% position from heel to toe.Because first metatarsal bone and fifth metatarsal bone lay respectively at the both sides of sole, we detect this position of 2 by following process:
1. rim detection filtering are carried out in the subarea at forefoot place.Similar with the process of toe position probing, rim detection is carried out in the region, edge at the wide place of pin, and use closing operation of mathematical morphology filtering;
2. determine the horizontal ordinate position of first metatarsal bone.On A4 paper subgraph, the ordinate of corresponding 69.5% position from heel to toe, with 1 * 16 window, search for from right to left, by the right left doubling of window, on former gray-scale map, add up the gray scale difference of correspondence position in doubling window, it is exactly first metatarsal bone position that the average of gray scale difference is greater than 25 position, and the horizontal ordinate at this some place is designated as to x inner.
3. determine the horizontal ordinate position of fifth metatarsal bone.2. similar with step, at heel, to 62.5% position of toe, with 1 * 16 window, to search for from left to right, first meets window left and right doubling gray scale difference mean value, and to be greater than 25 position be exactly the position of fifth metatarsal bone, and the horizontal ordinate at this some place is designated as to x outer.
(3) pin length and the wide calculating of pin
The normal size of A4 paper is 210 millimeters * 297 millimeters.Suppose that A4 paper subgraph is the capable N row of M, making the A4 paper subimage lower left corner is true origin, if the coordinate of toe position in subimage is (x, y), the physical length of pin is 297 * y/M millimeter.Suppose that the sole width number of pixels of extracting is c on A4 paper subimage, by the abscissa value of first metatarsal bone and fifth metatarsal bone, can obtain c=x inner-x outer, and the developed width of pin is 210 * c/N millimeter.
Step 4: the target of side pin is extracted and measured
The side of pin is for extracting the height of key position instep according to image.From heel to toe 2/5,1/2 and 3/4, the instep height at these positions is shoe last designing important parameters used.While selecting footwear code, the people that instep is high can select than the footwear code of large one of normal foot, or in customization shoes, can suitably increase the height of shoe tree.Side is according in image, and heel to the distance of toe is exactly that pin is long, and from vola to instep just correspondence the pin of relevant position high.Suppose side according in heel in the left side of image, toe is on right side, the instep of key position detect and height measurement method as follows:
(1) detect heel and toe
Heel and toe be in the latter half of image, and in the image left and right sides, formed two edges longitudinally.Therefore at image in 1/2 interval from bottom to height, edge longitudinally in detected image, can navigate to the position of heel and toe.Detailed process is as follows:
1. adopt the gradient template of horizontal direction to carry out rim detection to image, the longitudinal edge of outstanding toe and heel.The template that adopts as follows:
1 0 - 1 3 0 - 3 1 0 - 1
2. the edge of heel and toe area occupied ratio in image is 0.1, with this area ratio as threshold value to image binaryzation, obtain edge binary map;
3. use 5 * 8 windows from left to right by row search, suppose that in window, impact point number is n, first window position that meets (n/ (5 * 8)) >0.9 is exactly the rough position of heel, with (x' 0, y' 0) expression, wherein x' 0for the horizontal ordinate of heel rough position, y' 0for ordinate.
4. with heel position coordinates (x' 0, y' 0) centered by, the subwindow of intercepting 20 * 20 carries out fine searching to heel position in window.Adopt gradient template [1-1] the calculation window inside gradient of x direction, the greatest gradient position of every row in search window, horizontal ordinate statistics is carried out in greatest gradient position to all row, has the accurate horizontal ordinate that maximum horizontal ordinates is heel position, and we use (x 0, y 0) represent the accurate coordinates position of heel.
5. same process, when starting left by row search from image right side, can obtain the coordinate position (x of toe 1, y 1).
(2) detect vola
Vola is positioned at the below of toe and heel ordinate, contacts with floor, has formed horizontal edge.But because there is radian at the arch of foot place of pin, so the edge that the bottom of pin becomes on image is not straight line.Thus, we using the bottom position of forefoot and as position, vola, detect the height at 1/2 and 3/4 place, and the bottom position of hind paw of usining detects 2/5 height as position, vola.Forefoot is generally 1/3 of pin length, and its horizontal ordinate is at [x 0-(x 1-x 0) * 2/3, x 1] in interval, the vola testing process of this position is:
1. with the gradient template of vertical direction, image is carried out to rim detection, outstanding transverse edge, template is;
1 3 1 0 0 0 - 1 3 - 1
2. on transverse edge image, horizontal ordinate is [x 0-(x 1-x 0) * 2/3, x 1], ordinate is [0, min (y 0, y 1)] interval in, the gray-level projection of calculated level direction, the ordinate at the row place of integrated value maximum is the ordinate in vola, is designated as y 2.
Hind paw vola detection method is similar.
(3) key position of instep detects
This sentences 1/2 is example from heel to toe, and the key position of introducing instep detects.Based on experience value, 1/2 place's instep height of people's pin is approximately 1/3 long left and right of pin, and therefore, the horizontal ordinate of 1/2 place's instep is (x 0+ x 1)/2, ordinate are approximately y 2+ (x 1-x 0)/3.Intercept the subarea window at 1/2 instep place, place, adopt region-growing method to cut apart this window area, in region, be divided into target and background two parts.Instep is the separatrix of target and background, and horizontal ordinate is (x 0+ x 1the separation at place)/2 is exactly people's pin 1/2 instep position, place, and we use y 3the ordinate that represents this point.
Same process, we can extract the instep position at 2/5 place and 3/4 place.
(4) the key position true altitude of instep is calculated
By above step, the distance between the toe of side photograph and sufficient heel is x 1-x 0individual pixel, 1/2 place's instep height is y 3-y 1individual pixel.According to pin, the long and pin proportionate relationship between high, can show that the true altitude of 1/2 place's instep is
Figure BDA0000447280430000052
Figure BDA0000447280430000053
we can calculate the instep height at 3/4 place and 2/5 place the same manner.
3, advantage and effect
Advantage of the present invention is: by standard A 4 paper as a reference, can effectively obtain the data of the key position of pin by geometry correction, image processing techniques.In 50 groups of view data that gather, pin is long, pin is wide and the height measurement results error of instep key position all within 2 millimeters.
According to footwear code and the long general computing formula of pin
Figure BDA0000447280430000061
According to half yardage error of calculation, can obtain the long error of pin within 2.5 millimeters, the error that and pin wide in conjunction with pin is high again and shoemaker's shoemaking standard used, pin is long, pin is wide and the measurement result maximum error of crucial instep height fixes on 2 millimeters, demand in the time of can meeting the person that purchases footwear and selecting footwear code and shoemaker's shoemaking, and methods experiment resultant error of the present invention is all within 2 millimeters.
(4) accompanying drawing explanation
Fig. 1 (a) is positive according to image acquisition mode schematic diagram
Fig. 1 (b) side is according to image acquisition mode schematic diagram
Positive, the pin wide measurement procedure figure long according to pin of Fig. 2 (a)
Fig. 2 (b) side is according to instep key position height measurement procedure figure
(5) embodiment
In order to understand better technical scheme of the present invention, below in conjunction with accompanying drawing, embodiments of the present invention are further described:
The present invention realizes in conjunction with opencv1.0 under Microsoft Visual C++6.0 programmed environment.Positive, pin wide measurement procedure long according to pin is as shown in Fig. 2 (a), and process flow diagram 2 (b) is seen according to the measurement of instep key position height in side.Allocation of computer adopts: Intel Core i2E7300 processor, and dominant frequency 2.66GHz, internal memory 3GB, operating system is 32-bit Windows XP professional version.The data of this people's pin key position are extracted with measuring method and are comprised the following steps:
Step 1: press Fig. 1 (a), Fig. 1 (b), the form of image acquisition mode schematic diagram gathers positive photograph and side photograph, and concrete acquisition method is as follows:
1. the acquisition method of positive photograph: white A4 paper minor face one side is pasted to wall and place; User steps down in pin on A4 paper, makes the axis of pin align with the axis of A4 paper as far as possible; Heel, by wall, makes the alignment of heel position HeA4 paper edge, and the length direction of pin is consistent with the length direction of A4 paper, and it is inner to guarantee that pin drops on A4 paper completely; Camera directly over pin between 50 centimetres to 70 centimetres, take that angle is perpendicular to the ground carries out imaging, keep A4 paper not crooked in image as far as possible, and guarantee to comprise completely in visual field A4 paper region.
2. the acquisition method of side photograph; Side, according to not needing A4 paper, only needs subscriber station before wall or a pure color baffle plate, and the outside of pin is by wall or baffle plate; Camera lens is from the outside imaging of the interior side direction pin of pin, apart from 30 centimetres to 50 centimetres of the distances of side pin, takes angle and is parallel to ground, and keep same height with instep;
3. in visual field, scene will be tried one's best simply: positive as requested only comprises pin, A4 paper and floor in visual field; The background of side photograph should be simple wall or baffle plate, avoids other chaff interference to occur; Require user to wear black or other dark socks, to guarantee that there is enough large contrast contrast on pin, A4 paper and floor simultaneously.
Step 2: detect four angular vertex coordinates of A4 paper, image is carried out to geometry correction;
Specific implementation process is as follows:
1. Sobel operator is 3 * 3 the field based on gradient operator.The convolution mask of Sobel operator is by detection level direction gradient template
1 2 1 0 0 0 - 1 - 2 - 1
With detection of vertical direction gradient template
1 0 - 1 2 0 - 2 1 0 - 1
Form.Two templates are applied to respectively the positive image that shines, and root is opened in the horizontal direction of each pixel and square summation of the Grad of vertical direction again, can obtain the positive gradient map according to image;
2. rule of thumb, the area ratio of place, edge gradient map image accounts for 0.1.So, this method is by the histogram of statistical gradient figure, from gray-scale value, be 255 to start to calculate cumulative probability, by cumulative probability, be that 0.1 corresponding gray-scale value is set as threshold value, the pixel that is less than threshold value is set to 255, the pixel that is greater than threshold value is set to 0, thereby extracts the binary image that comprises A4 paper and pin object edge;
3. bianry image step being obtained in 2., on transverse axis, in the scope of [5 °, 5 °], take 1 ° image is carried out to Gray Projection as step-length.A4 paper is in the centre position of image, from image centre position to both sides, detects the extreme value of Gray Projection, detects two longitudinal edges in left and right and their deflection.Same way can detect two widthwise edges and their deflection up and down of A4 paper.Calculate the point of crossing between two longitudinal edges in left and right and upper and lower two widthwise edges, can obtain the rough coordinates of four angular vertex positions of A4 paper.
4. centered by four the angular vertex position coordinateses of A4 paper that obtain in 3. by step, the subgraph of four 140 * 140 sizes of relevant position intercepting on former gray-scale map.In four subgraphs, the ratio of the shared image area in edge is set to 0.15, repeats step above 1. to 3., can obtain the accurate coordinates of four angular vertex positions of A4 paper.
5. the relative coordinate of actual four angular vertexs of A4 paper is known, and transformation for mula is proofreaied and correct in the coordinate figure by four angular vertexs of A4 paper on correcting image and the substitution of actual coordinate value:
x ′ = h 1 ( x , y ) = a 0 x + a 1 y + a 2 a 6 x + a 7 y + 1
y ′ = h 2 ( x , y ) = a 3 x + a 4 y + a 5 a 6 x + a 7 y + 1
Wherein, x is the abscissa value on the summit on correcting image, and x' is corresponding actual abscissa value, and y is the abscissa value on the summit on correcting image, and y' is corresponding actual abscissa value.8 unknown numbers of 8 equations, solve a i(i=0,1,2,3,4,5,6,7), obtain the correction transforming function transformation function of image.
Utilize above-mentioned the correction transforming function transformation function solving and bilinear interpolation method to carry out geometry correction to distorted image.
6. in the image from proofreading and correct, intercept rectangular area, A4 paper place, remove background.Obtain the A4 paper subimage with pin target.
Step 3: the target of front pin is extracted and measured;
By step 2, be truncated to A4 paper subimage, from this number of sub images, extract pin length and wide two data of pin.Specific implementation process is as follows:
(1) detection of toe position
Toe is to drop in the first half region of A4 paper, and sufficient heel is to align with the base of A4 paper.Therefore can detect in the first half of A4 paper subgraph the position of toe, and it is long according to the proportionate relationship of pin and A4 paper, to calculate pin.Detailed process is:
1. intercept A4 paper subimage the first half subarea, utilize Sobel operator to carry out rim detection, the area ratio with 0.06 carries out threshold value selection, and binaryzation is carried out in subarea.
2. in bianry image, have the noise spot being scattered, adopt closing operation of mathematical morphology to carry out filtering to binary map, the size of computing template is 5 * 5
0 0 1 0 0 0 1 1 1 0 1 1 1 1 1 0 1 1 1 0 0 0 1 0 0
3. to the bianry image after denoising, press from the top down each impact point of line search.Centered by this impact point, get 5 * 8 window, by the upper and lower doubling of window, on former gray-scale map, add up the gray scale difference of correspondence position in doubling window, and be averaging.And first meets gray scale difference mean value be greater than 30 impact point be the position of toe, with (x, y), represent.
(2) position probing of first metatarsal bone and fifth metatarsal bone
Because first metatarsal bone and fifth metatarsal bone lay respectively at the both sides of sole, by following process, detect this position of 2:
1. rim detection filtering are carried out in the subarea at forefoot place.Similar with the process of toe position probing, to the region, edge at the wide place of pin, utilize the longitudinal template of Sobel operator to carry out longitudinal edge detection, and use closing operation of mathematical morphology filtering;
2. determine the horizontal ordinate position of first metatarsal bone.On A4 paper subgraph, the ordinate of corresponding 69.5% position from heel to toe, with 1 * 16 window, search for from right to left, by the right left doubling of window, on former gray-scale map, add up the gray scale difference of correspondence position in doubling window, it is exactly first metatarsal bone position that the average of gray scale difference is greater than 25 position, and the horizontal ordinate at this some place is designated as to x inner.
3. determine the horizontal ordinate position of fifth metatarsal bone.2. similar with step, at heel, to 62.5% position of toe, with 1 * 16 window, to search for from left to right, first meets window left and right doubling gray scale difference mean value, and to be greater than 25 position be exactly the position of fifth metatarsal bone, and the horizontal ordinate at this some place is designated as to x outer.
(3) pin length and the wide calculating of pin
The size of A4 paper subimage is M * N, and its actual size is 210 millimeters * 297 millimeters.Toe coordinate is (x, y), and the physical length of pin is 297 * y/M millimeter, and the developed width of pin is 210 * (x inner-x outer)/N millimeter.
Step 4: the target of side pin is extracted and measured;
Suppose side according to mesopodium heel in the left side of image, toe is on right side, the detection of instep key position and height measurement method are as follows:
(1) detect heel and toe
In 1/2 interval at image from bottom to height, edge longitudinally in detected image, can navigate to the position of heel and toe.Detailed process is as follows:
1. adopt the gradient template of vertical direction to carry out rim detection to image, the longitudinal edge of outstanding toe and heel.The template that adopts as follows:
1 0 - 1 3 0 - 3 1 0 - 0
2. the edge of heel and toe area occupied ratio in image is 0.1, with this area ratio as threshold value to image binaryzation, obtain edge binary map;
3. use 5 * 8 window from left to right by row search, suppose that in window, impact point number is n, the position rough position (x' that first window position that meets n/ (5 * 8) >25 is exactly sufficient heel 0, y' 0).With (x' 0, y' 0) centered by 20 * 20 windows in fine searching, determine the exact position (x of heel 0, y 0).
4. same process, when starting left by row search from image right side, navigates to the exact position (x of toe 1, y 1).
(2) detect vola
The bottom position of forefoot of usining detects as position, vola.Forefoot is generally 1/3 of pin length, and its horizontal ordinate is positioned at (x 0-(x 1-x 0) * 2/3, x 1), the vola testing process of this position is:
1. with the gradient template of horizontal direction, image is carried out to rim detection, outstanding transverse edge, template is;
1 3 1 0 0 0 - 1 3 - 1
2. on transverse edge image, horizontal ordinate is (x 0-(x 1-x 0) * 2/3, x 1), ordinate is (0, min (y 0, y 1)) interval in, the gray-level projection of calculated level direction, the ordinate at the row place of integrated value maximum is the ordinate in vola, is designated as y 2.
(3) detection of instep key position
The instep height of 2/5,1/2,3/4 position from heel to toe is the critical data of pin.This sentences 1/2 is example from sufficient heel to toe, introduces the detection of instep key position.
The horizontal ordinate of 1/2 place's instep is (x 0+ x 1)/2, ordinate are approximately y 2+ (x 1-x 0)/3.Intercept the subarea window at 1/2 instep place, place, adopt region-growing method to cut apart this window area, in region, be divided into target and background two parts.Instep is the separatrix of target and background, and horizontal ordinate is (x 0+ x 1the separation at place)/2 is exactly people's pin 1/2 instep position, place, uses y 3represent.
Same process, we can extract the instep position at 2/5 place and 3/4 place.Wherein, the instep height at 2/5 place is usingd hind paw bottom and is calculated as vola.
(4) true altitude of instep key position is calculated
According to pin, the long and pin proportionate relationship between high, can show that the true altitude of 1/2 place's instep is
Figure BDA0000447280430000102
we can calculate the instep height at 3/4 and 3/5 place the same manner.

Claims (5)

1.一种基于图像的人脚关键部位的数据提取与测量方法,其特征在于:该方法具体步骤如下:1. a kind of data extraction and measuring method of key parts of people's foot based on image, it is characterized in that: the method concrete steps are as follows: 步骤1:图像获取Step 1: Image Acquisition 通过人脚与A4纸之间的比例关系计算脚长和脚宽,并根据脚面高度与脚的长度之间的比例关系计算脚面关键部位的实际高度;因此,需要拍摄两幅图像,一幅是脚的正面照脚踩在白色A4纸上,相机从脚的正上方垂直向下拍摄;另一幅是脚的侧面照相机从脚的内侧对脚进行侧面投影;Calculate the foot length and foot width through the proportional relationship between the human foot and the A4 paper, and calculate the actual height of the key parts of the instep according to the proportional relationship between the height of the instep and the length of the foot; therefore, two images need to be taken, one is The frontal photo of the feet is stepped on white A4 paper, and the camera shoots vertically from above the feet; the other is the side view of the feet. The camera projects the feet from the inside of the feet; 步骤2:检测A4纸四个角顶点坐标,对图像进行几何校正Step 2: Detect the coordinates of the vertices of the four corners of the A4 paper, and perform geometric correction on the image 图像在获取及显示的过程中往往会产生几何失真,几何失真包括平移、缩放、旋转和透视以及更为复杂的几何失真;任意几何失真都能由非失真坐标系(x,y)变换到失真坐标系(x',y')的方程来定义;假设f(x,y)是无失真的原始图像,g(x',y')是f(x,y)的几何失真结果,则得到几何校正的基本关系式,如下:Geometric distortions often occur in the process of image acquisition and display. Geometric distortions include translation, scaling, rotation and perspective, as well as more complex geometric distortions; any geometric distortion can be transformed from a non-distorted coordinate system (x, y) to a distortion The equation of the coordinate system (x', y') is defined; assuming f(x, y) is the original image without distortion, and g(x', y') is the geometric distortion result of f(x, y), then we get The basic relationship of geometric correction is as follows: gg (( xx ′′ ,, ythe y ′′ )) == ff (( xx ,, ythe y )) xx ′′ == hh 11 (( xx ,, ythe y )) ythe y ′′ == hh 22 (( xx ,, ythe y )) 式中,h1(x,y)和h2(x,y)为校正变换函数,h1(x,y)和h2(x,y)用下面的多项式来近似:In the formula, h 1 (x, y) and h 2 (x, y) are correction transformation functions, and h 1 (x, y) and h 2 (x, y) are approximated by the following polynomials: hh 11 (( xx ,, ythe y )) == aa 00 xx ++ aa 11 ythe y ++ aa 22 aa 66 xx ++ aa 77 ythe y ++ 11 hh 22 (( xx ,, ythe y )) == aa 33 xx ++ aa 44 ythe y ++ aa 55 aa 66 xx ++ aa 77 ythe y ++ 11 由于标准A4纸四个角顶点的实际相对坐标是已知的,将A4纸的四个角顶点作为控制点,通过图像处理技术检测几何失真图像中A4纸的四个角的坐标,然后再利用校正变换函数以及双线性内插法对失真图像进行几何失真校正;Since the actual relative coordinates of the four corner vertices of the standard A4 paper are known, the four corner vertices of the A4 paper are used as control points, and the coordinates of the four corners of the A4 paper in the geometrically distorted image are detected by image processing technology, and then used The correction transformation function and the bilinear interpolation method perform geometric distortion correction on the distorted image; 步骤3:正面脚的目标提取与测量Step 3: Target extraction and measurement of frontal feet 由步骤2截取到A4纸子图像,我们要从这个子图像中提取出脚长和脚宽两个数据,具体实施过程如下:The A4 paper image is intercepted in step 2. We need to extract the two data of foot length and foot width from this image. The specific implementation process is as follows: (1)足尖位置的检测(1) Detection of toe position 足尖是落在A4纸的上半部分区域内的,而足跟是与A4纸的底边对齐的,因此在A4纸子图的上半部分检测足尖的位置,并根据脚与A4纸的比例关系计算出脚长;The toe falls in the upper half of the A4 paper, and the heel is aligned with the bottom edge of the A4 paper. Therefore, the position of the toe is detected in the upper half of the A4 paper sub-graph, and according to the foot and the A4 paper The proportional relationship calculates the foot length; (2)第一蹠骨和第五蹠骨的位置检测(2) Position detection of the first metatarsal and the fifth metatarsal 由于第一蹠骨和第五蹠骨分别位于脚掌的两侧,我们用如下过程检测这两点的位置:Since the first metatarsal and the fifth metatarsal are located on both sides of the sole of the foot, we use the following process to detect the positions of these two points: ①对前脚掌所在的子区进行边缘检测并滤波;与足尖位置检测的过程相类似,对脚宽处的边缘所在区域进行边缘检测,并用形态学闭运算滤波;① Perform edge detection and filtering on the sub-area where the forefoot is located; similar to the process of toe position detection, perform edge detection on the area where the edge of the foot width is located, and use morphological closed operation to filter; ②确定第一蹠骨的横坐标位置;在A4纸子图上、对应从足跟到足尖的69.5%位置处的纵坐标,用1×16窗口从右向左搜索,将窗口右左对折,在原灰度图上统计对折窗口内对应位置的灰度差,灰度差的均值大于25的位置就是第一蹠骨位置,将该点处的横坐标记为xinner②Determine the abscissa position of the first metatarsal; on the A4 paper submap, corresponding to the ordinate at 69.5% of the position from the heel to the toe, use a 1×16 window to search from right to left, fold the window in half from right to left, and in the original The grayscale difference of the corresponding position in the half-fold window is counted on the grayscale image, and the position where the average value of the grayscale difference is greater than 25 is the position of the first metatarsal bone, and the abscissa at this point is marked as x inner ; ③确定第五蹠骨的横坐标位置;与步骤②相类似,在足跟到足尖的62.5%位置处,用1×16窗口从左向右搜索,第一个满足窗口左右对折灰度差平均值大于25的位置就是第五蹠骨的位置,将该点处的横坐标记为xouter③Determine the abscissa position of the fifth metatarsal; similar to step ②, at the 62.5% position from the heel to the toe, use a 1×16 window to search from left to right, and the first one that satisfies the average gray level difference between the left and right folds of the window The position where the value is greater than 25 is the position of the fifth metatarsal, and the abscissa at this point is marked as x outer ; (3)脚长和脚宽的计算(3) Calculation of foot length and foot width A4纸的标准大小是210毫米×297毫米,假设A4纸子图是M行N列的,令A4纸子图像左下角为坐标原点,若足尖位置在子图像中的坐标是(x,y),则脚的实际长度为297×y/M毫米;假设在A4纸子图像上提取的脚掌宽度像素个数为c,由第一蹠骨和第五蹠骨的横坐标值可得c=xinner-xouter,而脚的实际宽度为210×c/N毫米;The standard size of A4 paper is 210 mm × 297 mm. Assume that the A4 paper sub-image has M rows and N columns. Let the lower left corner of the A4 paper sub-image be the coordinate origin. If the coordinates of the toe position in the sub-image are (x, y ), the actual length of the foot is 297×y/M mm; assuming that the number of pixels of the width of the sole extracted on the A4 paper image is c, the abscissa values of the first metatarsal and the fifth metatarsal can be obtained as c=x inner -x outer , while the actual width of the foot is 210×c/N mm; 步骤4:侧面脚的目标提取与测量Step 4: Target extraction and measurement of lateral feet 脚的侧面照图像是用来提取关键部位脚面的高度的,从足跟到足尖的2/5、1/2以及3/4处,这几个部位的脚面高度是鞋楦设计所用到的重要参数,选择鞋码时,脚面高的人选择比正常脚大一个的鞋码,或者在定制鞋子的时候适当增加鞋楦的高度;侧面照图像中,足跟至足尖的距离就是脚长,而从足底到脚面就对应了相应位置的脚高;假设侧面照中足跟在图像的左侧、足尖在右侧,则关键部位的脚面检测和高度测量方法如下:The side photo image of the foot is used to extract the height of the key parts of the foot, from the heel to the 2/5, 1/2 and 3/4 of the toe, the height of these parts is used in the design of the shoe last Important parameters, when choosing a shoe size, people with tall feet should choose a shoe size that is one size larger than normal feet, or increase the height of the shoe tree appropriately when customizing shoes; in the side photo image, the distance from the heel to the toe is the length of the foot , and from the bottom of the foot to the top of the foot corresponds to the height of the foot at the corresponding position; assuming that the heel is on the left side of the image and the toe is on the right side of the image in the side view, the detection and height measurement methods of the key parts of the foot are as follows: (1)检测足跟和足尖(1) Detect heel and toe 足跟和足尖在图像的下半部分,且在图像左右两侧形成了两个纵向的边缘,因此在图像从底部到高度的1/2区间内,检测图像中纵向的边缘,即能定位到足跟和足尖的位置;检测足底The heel and toe are in the lower half of the image, and two vertical edges are formed on the left and right sides of the image. Therefore, within the 1/2 interval from the bottom to the height of the image, the vertical edge in the image can be detected to locate To the position of the heel and toe; detect the sole of the foot 足底位于足尖和足跟纵坐标的下方,与地板接触,形成了横向的边缘;但是,由于脚的足弓处有弧度,因此脚的底部在图像上所成的边缘并不是一条直线,由此,我们以前脚掌的底部位置作为足底位置来检测1/2以及3/4处的高度,以后脚掌的底部位置作为足底位置来检测2/5的高度;前脚掌一般是脚长的1/3,其横坐标在[x0-(x1-x0)×2/3,x1]区间内,则该位置的足底检测过程为:The bottom of the foot is located below the vertical coordinates of the toe and heel, and is in contact with the floor, forming a horizontal edge; however, due to the curvature of the arch of the foot, the edge formed by the bottom of the foot on the image is not a straight line. Therefore, we use the bottom position of the front sole as the sole position to detect the height of 1/2 and 3/4, and the bottom position of the rear sole is used as the sole position to detect the height of 2/5; the forefoot is generally the length of the foot 1/3, its abscissa is in the interval [x 0 -(x 1 -x 0 )×2/3,x 1 ], then the sole detection process at this position is: ①用垂直方向的梯度模板对图像进行边缘检测,突出横向边缘,模板为;① Use the gradient template in the vertical direction to detect the edge of the image, highlight the horizontal edge, and the template is; 11 33 11 00 00 00 -- 11 33 -- 11 ②在横向边缘图像上,横坐标为[x0-(x1-x0)×2/3,x1]、纵坐标为[0,min(y0,y1)]的区间内,计算水平方向的灰度积分投影,积分值最大的行所在的纵坐标即是足底的纵坐标,记为y2② On the horizontal edge image, the abscissa is [x 0 -(x 1 -x 0 )×2/3,x 1 ], and the ordinate is [0,min(y 0 ,y 1 )], calculate In the gray integral projection in the horizontal direction, the ordinate of the line with the largest integral value is the ordinate of the sole of the foot, which is recorded as y 2 ; 后脚掌足底检测方法类似;The detection method of the sole of the rear foot is similar; (2)脚面的关键部位检测(2) Detection of key parts of the instep 此处以从足跟到足尖的1/2处为例,介绍脚面的关键部位检测;根据经验值,人脚的1/2处脚面高度是脚长的1/3左右,因此,1/2处脚面的横坐标为(x0+x1)/2、纵坐标为y2+(x1-x0)/3;截取1/2处脚面所在的子区窗口,采用区域生长法对该窗口区域进行分割,区域内被分成目标和背景两部分;脚面是目标和背景的分界线,则横坐标为(x0+x1)/2处的分界点就是人脚1/2处脚面位置,我们用y3表示该点的纵坐标;Here we take the 1/2 part from the heel to the toe as an example to introduce the detection of key parts of the instep; according to experience, the height of the 1/2 part of the human foot is about 1/3 of the length of the foot. Therefore, 1/2 The abscissa of the instep is (x 0 +x 1 )/2, and the ordinate is y 2 +(x 1 -x 0 )/3; intercept the sub-area window where the instep is at 1/2, and use the region growing method to The window area is divided, and the area is divided into two parts, the target and the background; the instep is the dividing line between the target and the background, and the abscissa is (x 0 +x 1 )/2 the demarcation point is the position of the human foot at 1/2 , we use y 3 to represent the ordinate of the point; 同样过程,我们提取出2/5处和3/4处的脚面位置;In the same process, we extract the instep positions at 2/5 and 3/4; (3)脚面的关键部位实际高度计算(3) Calculation of the actual height of the key parts of the instep 由以上步骤,侧面照的足尖与足后跟之间的距离为x1-x0个像素,1/2处脚面高度是y3-y1个像素;根据脚长和脚高之间的比例关系,得出1/2处脚面的实际高度为
Figure FDA0000447280420000031
同样方式我们能计算出3/4处和2/5处的脚面高度。
From the above steps, the distance between the toe and the heel of the side view is x 1 -x 0 pixels, and the height of the foot at 1/2 is y 3 -y 1 pixel; according to the ratio between the length of the foot and the height of the foot relationship, the actual height of the instep at 1/2 is
Figure FDA0000447280420000031
In the same way we can calculate the height of the instep at 3/4 and 2/5.
2.根据权利要求1所述的一种基于图像的人脚关键部位的数据提取与测量方法,其特征在于:在步骤1中所述的需要拍摄两幅图像,一幅是脚的正面照,另一幅是脚的侧面照,其具体要求和操作如下:2. the data extraction and measuring method of a kind of image-based people's foot key parts according to claim 1, is characterized in that: described in step 1 needs to take two images, one is the frontal photo of pin, The other is a side view of the foot, and its specific requirements and operations are as follows: ①脚的正面照的采集方法:将白色A4纸短边一侧贴墙放置;用户将脚踩在A4纸上,使脚的中轴线与A4纸的中轴线对齐;足跟靠墙,使得足跟位置和A4纸边缘处对齐,脚的长度方向与A4纸的长度方向一致,且确保脚完全落在A4纸内部;摄像头在脚的正上方50厘米到70厘米之间、拍摄角与地面垂直进行成像,尽量保持A4纸在图像中不歪斜,并确保视场内完全包含A4纸区域;①Collecting the frontal photo of the feet: Place the short side of the white A4 paper against the wall; the user steps on the A4 paper so that the central axis of the foot is aligned with the central axis of the A4 paper; the heel is placed against the wall so that the foot Align with the position and the edge of the A4 paper, the length direction of the feet is consistent with the length direction of the A4 paper, and ensure that the feet are completely inside the A4 paper; the camera is between 50 cm and 70 cm directly above the feet, and the shooting angle is perpendicular to the ground For imaging, try to keep the A4 paper from being skewed in the image, and ensure that the A4 paper area is completely included in the field of view; ②脚的侧面照的采集方法;侧面照不需要A4纸,只需要用户站在墙壁或一个纯色挡板的前面,脚的外侧靠墙或挡板;镜头从脚的内侧向脚的外侧成像,距离侧面脚的距离30厘米到50厘米,拍摄角平行于地面,并与脚面保持同样高度;②The collection method of the side photo of the foot; the side photo does not need A4 paper, only the user needs to stand in front of a wall or a solid color baffle, and the outside of the foot is against the wall or baffle; the lens takes an image from the inside of the foot to the outside of the foot, The distance from the side foot is 30cm to 50cm, and the shooting angle is parallel to the ground and kept at the same height as the foot; ③视场内场景要尽量简单:正面照要求视场内只包含脚、A4纸和地板;侧面照的背景应该是简单的墙壁或挡板,避免其它干扰物出现;同时要求用户穿黑色或其它深色的袜子,以保证脚、A4纸和地板有足够大的反差对比。③The scene in the field of view should be as simple as possible: the front view requires only feet, A4 paper and the floor; the background of the side view should be a simple wall or baffle to avoid other distracting objects; at the same time, the user is required to wear black or other Dark colored socks to ensure sufficient contrast between the feet, the A4 paper and the floor. 3.根据权利要求1所述的一种基于图像的人脚关键部位的数据提取与测量方法,其特征在于:在步骤2中所述的“通过图像处理技术检测几何失真图像中A4纸的四个角的坐标,然后再利用校正变换函数以及双线性内插法对失真图像进行几何失真校正”,其具体实现过程如下:3. The data extraction and measurement method of a kind of image-based key parts of the human foot according to claim 1, characterized in that: in the step 2, "detect the A4 paper in the geometrically distorted image by image processing technology" The coordinates of each corner, and then use the correction transformation function and bilinear interpolation method to correct the geometric distortion of the distorted image", the specific implementation process is as follows: ①对脚的正面照进行边缘检测:利用Sobel算子对正面照图像进行边缘提取,得到图像的梯度图;该梯度图中,目标的边缘变成了亮带,而目标和背景区域由于灰度变化比较平坦,因此在梯度图中形成了暗区;①Edge detection on the frontal photo of the feet: Use the Sobel operator to extract the edge of the frontal photo image to obtain the gradient map of the image; The change is relatively flat, so dark areas are formed in the gradient map; ②对梯度图像二值化:A4纸和脚目标所形成的边缘在图像中占据很小的一部分区域,设为图像面积的0.1;对梯度图进行直方图统计,图像的边缘像素灰度值较高,将分布在直方图靠右侧的位置,而非边缘像素则集中在直方图靠左侧的位置,从直方图最右侧向左计算直方图的累积概率,即图像边缘的像素统计,并将累积概率为0.1所对应的灰度值设定为阈值,小于阈值的像素置为255,大于阈值的像素置为0,从而提取出包括A4纸和脚目标的边缘;②Binarize the gradient image: the edge formed by the A4 paper and the foot target occupies a small part of the image, which is set to 0.1 of the image area; the histogram statistics are performed on the gradient image, and the gray value of the edge pixel of the image is relatively small. High, the distribution will be on the right side of the histogram, and the non-edge pixels will be concentrated on the left side of the histogram. The cumulative probability of the histogram is calculated from the rightmost side of the histogram to the left, that is, the pixel statistics on the edge of the image. And the gray value corresponding to the cumulative probability of 0.1 is set as the threshold value, the pixels smaller than the threshold value are set to 255, and the pixels greater than the threshold value are set to 0, thereby extracting the edge including the A4 paper and the foot target; ③初步检测A4纸的四个角顶点位置坐标,对前述第②步中得到的二值图像,在水平轴上[-5°,5°]的范围内以1°为步长对图像进行灰度投影;由于A4纸的左右两个纵向边是图像中的强边缘,它会在正确的投影方向上形成极值,而根据先验知识,A4纸处在图像的中间位置,从图像中间位置向两侧,检测灰度投影的极值,就能检测左右两条纵向边以及它们的方向角;同样做法能够检测出A4纸的上下两条横向边和它们的方向角;计算左右两条纵向边和上下两条横向边之间的交叉点,即得到A4纸四个角顶点位置的粗略坐标;③ Preliminary detection of the position coordinates of the four corner vertices of the A4 paper. For the binary image obtained in the aforementioned step ②, the image is grayed out within the range of [-5°, 5°] on the horizontal axis with a step size of 1°. degree projection; since the left and right longitudinal sides of the A4 paper are strong edges in the image, it will form an extremum in the correct projection direction, and according to prior knowledge, the A4 paper is in the middle of the image, and from the middle of the image To both sides, detect the extreme value of the grayscale projection, you can detect the left and right vertical sides and their direction angle; the same method can detect the upper and lower two horizontal sides of A4 paper and their direction angle; calculate the left and right vertical sides The intersection point between the side and the upper and lower horizontal sides, that is, the rough coordinates of the four corner vertex positions of the A4 paper; ④精确检测A4纸的四个角顶点位置坐标:以第③步中得到的A4纸四个角顶点位置坐标为中心,在原灰度图上相应位置截取四个140×140大小的子图,将四个子图中边缘所占图像面积的比率设置为0.15,重复上面的第①至③步,即得到A4纸的四个角顶点位置的精确坐标;④Precisely detect the position coordinates of the four corner vertices of the A4 paper: Take the position coordinates of the four corner vertices of the A4 paper obtained in step ③ as the center, intercept four 140×140 sub-images at the corresponding positions on the original gray scale image, and The ratio of the image area occupied by the edges of the four sub-images is set to 0.15, and the above steps ① to ③ are repeated to obtain the precise coordinates of the four corner vertex positions of the A4 paper; ⑤对图像进行几何校正:A4纸实际四个角顶点的相对坐标已知,利用上述的校正变换函数和双线性内插法对失真图像进行几何校正;⑤ Perform geometric correction on the image: the relative coordinates of the actual four corner vertices of the A4 paper are known, and use the above-mentioned correction transformation function and bilinear interpolation method to perform geometric correction on the distorted image; ⑥截取A4纸子图,去掉无用背景:图像校正后,A4纸所在的区域就是一个标准的矩形,矩形的长宽比就是A4纸的长宽比;从图像中截取该矩形,去掉背景,则截取下来的这个子图内部就是我们要检测的脚目标。⑥Intercept the A4 paper sub-picture and remove the useless background: After the image is corrected, the area where the A4 paper is located is a standard rectangle, and the aspect ratio of the rectangle is the aspect ratio of the A4 paper; intercept the rectangle from the image and remove the background, then The inside of the intercepted sub-image is the foot target we want to detect. 4.根据权利要求1所述的一种基于图像的人脚关键部位的数据提取与测量方法,其特征在于:在步骤3中所述的“足尖位置的检测”,其具体过程为:4. the data extraction and measuring method of a kind of image-based people's foot key parts according to claim 1, is characterized in that: in step 3 described in " the detection of tiptoe position ", its specific process is: ①截取A4纸子图像上半部分子区,利用Sobel算子进行边缘检测;根据先验知识,脚目标在这个子区中形成的边缘约占子区面积的0.06,本方案用0.06的面积比例进行阈值选择,对子区进行二值化;①Intercept the sub-area in the upper half of the A4 paper image, and use the Sobel operator to perform edge detection; according to prior knowledge, the edge formed by the foot target in this sub-area accounts for about 0.06 of the area of the sub-area. This scheme uses an area ratio of 0.06 Perform threshold selection and binarize the sub-areas; ②二值图像中有散落的噪声点,采用形态学闭运算对二值图进行滤波,运算模板的大小为5×5②There are scattered noise points in the binary image, and the binary image is filtered by morphological closed operation, and the size of the operation template is 5×5 00 00 11 00 00 00 11 11 11 00 11 11 11 11 11 00 11 11 11 00 00 00 11 00 00 ③对去噪后的二值图像,从上向下按行搜索每一个目标点,以该目标点为中心取5×8的窗口,将窗口上下对折,在原灰度图上统计对折窗口内对应位置的灰度差,并求平均,而第一个满足灰度差平均值大于30的目标点即是足尖的位置,用(x,y)表示。③For the denoised binary image, search for each target point by row from top to bottom, take a 5×8 window centered on the target point, fold the window in half up and down, and count the corresponding points in the folded window on the original grayscale image The gray level difference of the position is calculated and averaged, and the first target point that meets the average value of the gray level difference greater than 30 is the position of the toe, represented by (x, y). 5.根据权利要求1所述的一种基于图像的人脚关键部位的数据提取与测量方法,其特征在于:在步骤4中所述的“检测足跟和足尖”,其具体过程如下:5. the data extraction and measuring method of a kind of image-based people's foot key parts according to claim 1, is characterized in that: " detect heel and toe " described in step 4, its concrete process is as follows: ①采用水平方向的梯度模板对图像进行边缘检测,突出足尖和足跟处的纵向边缘,所采用模板如下:① Use the gradient template in the horizontal direction to detect the edge of the image, and highlight the longitudinal edge of the toe and heel. The template used is as follows: 11 00 -- 11 33 00 -- 33 11 00 -- 11 ②足跟和足尖的边缘在图像中所占面积比例为0.1,用该面积比例作为阈值对图像二值化,得到边缘二值图;② The area ratio of the edge of the heel and toe in the image is 0.1, and the image is binarized using this area ratio as a threshold to obtain a binary image of the edge; ③用5×8窗口从左向右按列搜索,假设窗口中目标点个数为n,则第一个满足(n/(5×8))>0.9的窗口所在位置就是足跟的粗略位置,用(x'0,y'0)表示,其中x'0为足跟粗略位置的横坐标,y'0为纵坐标;③Use the 5×8 window to search by column from left to right. Assuming that the number of target points in the window is n, the position of the first window satisfying (n/(5×8))>0.9 is the rough position of the heel , represented by (x' 0 ,y' 0 ), where x' 0 is the abscissa of the rough position of the heel, and y' 0 is the ordinate; ④以足跟位置坐标(x'0,y'0)为中心,截取20×20的子窗口,在窗口内对足跟位置进行细搜索;采用x方向的梯度模板[1 -1]计算窗口内梯度,搜索窗口内每行的最大梯度所在位置,对所有行的最大梯度所在位置进行横坐标统计,则具有最多的横坐标即为足跟位置的精确横坐标,我们用(x0,y0)代表足跟的精确坐标位置;④ Take the heel position coordinates (x' 0 , y' 0 ) as the center, intercept a 20×20 sub-window, and perform a fine search for the heel position in the window; use the gradient template in the x direction [1 -1] to calculate the window Inner gradient, the position of the maximum gradient of each line in the search window, the abscissa statistics of the maximum gradient position of all lines, the most abscissa is the exact abscissa of the heel position, we use (x 0 ,y 0 ) represents the precise coordinate position of the heel; ⑤同样过程,当从图像右侧开始向左按列搜索时,得到足尖的坐标位置(x1,y1)。⑤ In the same process, when searching from the right side of the image to the left by column, the coordinate position (x 1 , y 1 ) of the toe is obtained.
CN201310731335.6A 2013-12-26 2013-12-26 A kind of data of the people's pin key position based on image are extracted and measuring method Expired - Fee Related CN103646408B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310731335.6A CN103646408B (en) 2013-12-26 2013-12-26 A kind of data of the people's pin key position based on image are extracted and measuring method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310731335.6A CN103646408B (en) 2013-12-26 2013-12-26 A kind of data of the people's pin key position based on image are extracted and measuring method

Publications (2)

Publication Number Publication Date
CN103646408A true CN103646408A (en) 2014-03-19
CN103646408B CN103646408B (en) 2016-03-02

Family

ID=50251618

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310731335.6A Expired - Fee Related CN103646408B (en) 2013-12-26 2013-12-26 A kind of data of the people's pin key position based on image are extracted and measuring method

Country Status (1)

Country Link
CN (1) CN103646408B (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104679857A (en) * 2015-02-16 2015-06-03 陈萌 Recommendation method and recommendation systembased on matched information
CN104732527A (en) * 2015-02-16 2015-06-24 陈萌 Method and device for identifying foot information
CN104732526A (en) * 2015-02-16 2015-06-24 陈萌 Method and device for matching feet with shoes
CN105615070A (en) * 2014-11-04 2016-06-01 广西北海利博盛安全用品有限公司 Methods for acquiring sizes of hands and manufacturing gloves
CN106617496A (en) * 2016-11-21 2017-05-10 刘湘毅 Simple foot information accurate measurement device and method
US20180182123A1 (en) * 2018-02-26 2018-06-28 Chien Min Fang Method of selecting an article for covering a body part by processing the image of the body part
CN108765059A (en) * 2018-04-28 2018-11-06 北京知足科技有限公司 A kind of shoes product method for pushing and device
CN108805138A (en) * 2018-04-19 2018-11-13 北京金尺云数科技有限公司 A kind of method that mobile phone photograph calculates foot's data
CN109090769A (en) * 2018-06-13 2018-12-28 东莞时谛智能科技有限公司 A kind of reconstruct shoe last model detection method and system
CN110070077A (en) * 2019-05-09 2019-07-30 瑞昌芯迈科技有限公司 A kind of arch of foot kind identification method
CN110123330A (en) * 2019-05-20 2019-08-16 浙江大学 Foot type parameter measurement and pressure cloud atlas generation method based on plantar pressure data
CN110211100A (en) * 2019-05-20 2019-09-06 浙江大学 A kind of foot measurement method of parameters based on image
CN110209001A (en) * 2019-06-04 2019-09-06 上海亦我信息技术有限公司 A kind of three-legged support and camera shooting gesture recognition method for 3D modeling
JP2020012736A (en) * 2018-07-18 2020-01-23 富士通株式会社 Foot size measurement method, foot size measurement program and foot size measurement device
CN112971273A (en) * 2021-02-05 2021-06-18 重庆小爱科技有限公司 Shoe customization full-flow manufacturing method
US12198795B2 (en) 2020-10-15 2025-01-14 Beijing Boe Technology Development Co., Ltd. Calculation method of food volume and food calories, electronic apparatus, electronic device and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1895168A (en) * 2005-10-26 2007-01-17 浙江大学 Three-dimensional feet data measuring method to sparse grid based on curve subdivision
CN102222357A (en) * 2010-04-15 2011-10-19 温州大学 Foot-shaped three-dimensional surface reconstruction method based on image segmentation and grid subdivision

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1895168A (en) * 2005-10-26 2007-01-17 浙江大学 Three-dimensional feet data measuring method to sparse grid based on curve subdivision
CN102222357A (en) * 2010-04-15 2011-10-19 温州大学 Foot-shaped three-dimensional surface reconstruction method based on image segmentation and grid subdivision

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
徐从富等: "个性化鞋楦CAD系统的设计与实现", 《计算机辅助设计与图形学学报》 *
朱晔: "数字化脚型测量的新进展", 《中国皮革》 *
高飞等: "基于标记点图案的三维脚型建模与测量方法", 《基于标记点图案的三维脚型建模与测量方法 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105615070A (en) * 2014-11-04 2016-06-01 广西北海利博盛安全用品有限公司 Methods for acquiring sizes of hands and manufacturing gloves
CN104679857A (en) * 2015-02-16 2015-06-03 陈萌 Recommendation method and recommendation systembased on matched information
CN104732527A (en) * 2015-02-16 2015-06-24 陈萌 Method and device for identifying foot information
CN104732526A (en) * 2015-02-16 2015-06-24 陈萌 Method and device for matching feet with shoes
CN104679857B (en) * 2015-02-16 2018-02-23 北京知足科技有限公司 A kind of information recommendation method and system based on matching
CN106617496A (en) * 2016-11-21 2017-05-10 刘湘毅 Simple foot information accurate measurement device and method
US20180182123A1 (en) * 2018-02-26 2018-06-28 Chien Min Fang Method of selecting an article for covering a body part by processing the image of the body part
CN108805138A (en) * 2018-04-19 2018-11-13 北京金尺云数科技有限公司 A kind of method that mobile phone photograph calculates foot's data
CN108805138B (en) * 2018-04-19 2022-04-22 北京金尺云数科技有限公司 Method for calculating foot data by photographing through mobile phone
CN108765059A (en) * 2018-04-28 2018-11-06 北京知足科技有限公司 A kind of shoes product method for pushing and device
CN109090769A (en) * 2018-06-13 2018-12-28 东莞时谛智能科技有限公司 A kind of reconstruct shoe last model detection method and system
JP2020012736A (en) * 2018-07-18 2020-01-23 富士通株式会社 Foot size measurement method, foot size measurement program and foot size measurement device
JP7172222B2 (en) 2018-07-18 2022-11-16 富士通株式会社 Foot size measurement method, foot size measurement program, and foot size measurement device
CN110070077A (en) * 2019-05-09 2019-07-30 瑞昌芯迈科技有限公司 A kind of arch of foot kind identification method
CN110070077B (en) * 2019-05-09 2022-02-01 瑞昌芯迈科技有限公司 Arch type identification method
CN110211100A (en) * 2019-05-20 2019-09-06 浙江大学 A kind of foot measurement method of parameters based on image
CN110123330A (en) * 2019-05-20 2019-08-16 浙江大学 Foot type parameter measurement and pressure cloud atlas generation method based on plantar pressure data
CN110209001A (en) * 2019-06-04 2019-09-06 上海亦我信息技术有限公司 A kind of three-legged support and camera shooting gesture recognition method for 3D modeling
US12198795B2 (en) 2020-10-15 2025-01-14 Beijing Boe Technology Development Co., Ltd. Calculation method of food volume and food calories, electronic apparatus, electronic device and storage medium
CN112971273A (en) * 2021-02-05 2021-06-18 重庆小爱科技有限公司 Shoe customization full-flow manufacturing method

Also Published As

Publication number Publication date
CN103646408B (en) 2016-03-02

Similar Documents

Publication Publication Date Title
CN103646408B (en) A kind of data of the people's pin key position based on image are extracted and measuring method
US10013803B2 (en) System and method of 3D modeling and virtual fitting of 3D objects
US20220202138A1 (en) Foot Measuring and Sizing Application
US10008040B2 (en) Method and system for virtual shoes fitting
EP3298586B1 (en) Method and system for recommending fitting footwear
US9996909B2 (en) Clothing image processing device, clothing image display method and program
US20160286906A1 (en) Method and system for measuring 3-dimensional objects
CN107767442A (en) A kind of foot type three-dimensional reconstruction and measuring method based on Kinect and binocular vision
CN110751716B (en) Virtual shoe test method based on single-view RGBD sensor
CN108805138B (en) Method for calculating foot data by photographing through mobile phone
WO2013026798A1 (en) Method and system for optimised selection of footwear or clothing articles
CN106887019A (en) A kind of footprint Pressure Distribution method for expressing
CN113679147B (en) Method for customizing shoe
CN102890805A (en) Noncontact foot measurement and shoe tree matching method
CN109330106A (en) A kind of subscript dimension measurement method based on mobile phone photograph
Li et al. Bayesian depth-from-defocus with shading constraints
CN105105416B (en) A kind of pin graphic data collector and feet shape measuring method
CN110570438B (en) Method, system, storage medium and electronic device for measuring two-dimensional dimensions of the human body
US10964123B2 (en) Insole design method and insole design system
CN110766738A (en) Virtual shoe fitting method based on multi-view depth sensor
CN117115226B (en) Method for identifying foot shape size based on computer vision
CN110245575B (en) Human body type parameter capturing method based on human body contour line
CN111091895B (en) Breast image analysis method, system and non-transitory computer readable medium
WO2024192432A1 (en) Monocular camera-assisted technique with glasses accommodation for precise facial feature measurements at varying distances
TWI828541B (en) Method for measuring and analyzing foot features and method for designing customized insole

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160302

Termination date: 20201226