WO2018190773A1 - Method and system for targeted advertising based on personal physical characteristics - Google Patents
Method and system for targeted advertising based on personal physical characteristics Download PDFInfo
- Publication number
- WO2018190773A1 WO2018190773A1 PCT/SG2018/050181 SG2018050181W WO2018190773A1 WO 2018190773 A1 WO2018190773 A1 WO 2018190773A1 SG 2018050181 W SG2018050181 W SG 2018050181W WO 2018190773 A1 WO2018190773 A1 WO 2018190773A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- person
- advertisement
- images
- computer
- image
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0269—Targeted advertisements based on user profile or attribute
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/04—Billing or invoicing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/178—Human faces, e.g. facial parts, sketches or expressions estimating age from face image; using age information for improving recognition
Definitions
- the present invention is related to methods for targeted advertising and, in particular, to advertising goods and services to people in public areas.
- Many conventional advertising systems have an information rendering panel with a surface that is used (entirely or partially) for rendering advertisements when a presence of a person is detected.
- Such systems include a detection device for detecting a presence of a person and a control module that connects and synchronizes the information between rendering panel and the detection device.
- the present invention is related to system and method for detecting a presence of a person in a public area and providing targeted advertisement of goods and services to the detected person that substantially obviates one or more of the disadvantages of the related art.
- a system includes an information rendering panel having a mirror surface that is used (entirely or partially) for rendering advertisements upon detection of a person in a vicinity of the system.
- the system includes a detection unit for detecting a person and a control module connected to the information rendering panel and to the detection unit.
- the detection unit includes a video camera.
- the control module detects age, gender and emotional state of a detected person. This data is provided to the information rendering panel for displaying advertisements appropriate for the detected person, including new people within a camera's field of view.
- FIG. 1 illustrates a system for targeted advertising, in accordance with the exemplary embodiment
- FIG. 2 illustrates a method for teaching the targeted advertising system, in accordance with the exemplary embodiment
- FIG. 3 illustrates a flow chart of a person recognition method, in accordance with the exemplary embodiment.
- FIG. 4 illustrates a schematic of an exemplary computer system that can be used for implementation of the invention.
- a method and system for an original and convenient rendering of advertisements targeted to a specific audience (persons) is provided.
- a system includes an information rendering panel having a mirror or similar transparent surface that is used (entirely or partially) for rendering advertisements upon detection of a person in a vicinity of the system.
- the system includes a detection unit for detecting a person and a control module connected to the information rendering panel and to the detection unit.
- the detection unit includes a video camera.
- the control module detects at least age, gender and emotional state of a detected person. This data is provided to the information rendering panel for displaying advertisements appropriate for the detected person.
- the control module includes a storage medium with recorded advertisement data.
- a camera can be in a form of a web-cam and the control module can download advertisement data from a web-server.
- the control module determines data related to a detected person and stores this data for future references. In particular, this data can be used for analyzing the needs of potential customers and for developing future advertising campaigns.
- the information rendering panel has a mirror surface that deflects optical rays received from the outside. At least a portion of the information rendering panel is implemented as a display, which can render the advertisements upon detection a person within a field of view of the video camera.
- the information rendering panel allows through the optical rays generated by an advertisement source (e.g., a special monitor) located behind the information rendering panel (or within the system).
- the control module in accordance with the exemplary embodiment, can be in a form of a computer that runs applications for determining person's age, gender and emotional state based on a person's image(s). For example, applications developed by agisoft.ru can be used.
- voice analysis alone, or in combination with visual analysis can be used to identify a person's gender, for example, and, the subject matter of conversation between several people, to further target the advertisement.
- social network data can be used to identify the person, and, optionally to assist in targeting the advertisement based on data in the profile. Then, the targeted advertisement is rendered to the person via a monitor.
- the system can also ask the user questions, and, in response, provide him with both advertisements and relevant information (e.g., from the server), based on his responses, his geographic location and his identified personal characteristics.
- control module can include a storage medium for storing pre-recorded advertisements (i.e., for example, a hard drive of a computer). Then, the personal data of the detected persons can be also stored onto the hard drive by the control module.
- pre-recorded advertisements i.e., for example, a hard drive of a computer.
- the information rendering panel is located in a public place. When the advertisements are not displayed, the information rendering panel appears as a regular mirror and serves as a part of a room ambience. However, once a person appears in a field of view of the video camera, an image is acquired and sent to the control module (i.e., a computer) in real-time. The control module determines personal parameters (i.e., gender, age, race and an emotional state).
- advertisement is selected for rendering to the detected person.
- the selection of advertisement is made according to pre-stored data reflecting potential (most likely) preferences of a person of a detected age, race, gender and/or emotional state. Then, the selected advertisement is rendered to the person via a monitor located behind the information rendering panel.
- a potential customer is determined to be a young woman, the advertisement of cosmetics, make up or beauty products is rendered. Yet, if a potential customer is determined to be a middle age man, an advertisement of beer or alcoholic beverage is selected and rendered. As soon as the person exits the camera's field of view (or based on a pre-set time out), the rendering of the advertisement is terminated and the information rendering panel begins to serve as a regular mirror again.
- an additional data about potential customers is collected for developing effective advertisement campaigns. For example, an aggregate data reflecting age and gender (or race) of patrons of a particular establishment can be used for selecting the advertisements that are of interest to this group of people, including new people within a camera's field of view.
- FIG. 1 illustrates a system for targeted advertising, in accordance with the exemplary embodiment.
- a media source 110 is connected to a control server 111 over the Internet 180.
- the media source 110 includes a web-camera 120 with an infra-red (IR) filter for detecting persons and acquiring their images.
- the IR filter allows through only the rays from the infra-red illuminated zone that are produced by an IR projector 115.
- the IR lighting allows for camera to operate in low (or dimmed) lighting and increases the accuracy of person recognition and determination of gender, race and age.
- the media source 110 includes a computer 125 which has the following applications (components) installed: a person recognition system; a system for loading advertisement clips from the control server 111, and a billing system for billing an advertiser for the clips shown by a rendering device 130.
- the computer 125 and other media source 110 devices are supplied by a power source 165 connected to a power cable via an AC/DC converter 170.
- the computer 125 allows for classification of a person (by gender, age, race, etc.) and for selection of advertisement clips in real-time, on the order of tens of milliseconds. Note that the images acquired by the web-camera 120 are not necessarily sent to the control server 111.
- the media source 110 also includes a rendering device 130, which can be implemented in a form of an LCD or plasma display for showing advertisement video clips to potential customers.
- the rendering device 130 is controlled by a rendering device controller 160, which selects and loads the advertisement video clips from the computer 125.
- the rendering device is illuminated by a light source 135 (LED or a lamp), which is controlled by a light source controller 155.
- the computer 125 receives information from a sensor panel 140, which acquires parameters of a person.
- the sensor panel 140 can include a microphone, an X-ray source, a distance measuring module, a presence detector, a smell detector, a weight platform, a detector of ultra sound volume, an infrared-ray measuring device, Kinect or similar systems, etc.
- the sensor panel 140 is used for acquiring additional information about a detected person. For example, not only age, gender, race (or ethnicity) and emotional state (or mood) can be detected.
- parameters such as dress style (brands of clothing etc.), body type, degree of intoxication, hear style (color), presence of cigarettes, injuries, scars, accessories (hat, glasses, jewelry, ear rings etc.), special features (beard, mustache, degree of shaving, etc.), mobile phone (tablet computers, smart-phones, laptops, Bluetooth devices, etc.), walking characteristics, presence of pets, person's speed of movement and a number of people in front of the media source 110 (a mirror) can be determined.
- the infrared-ray measuring device can read an infrared map of an area in front of the media source 1 10 and determine a body temperature of a person. Using known algorithms, it can be determined if a person is sick, excited or is experiencing intense physical loads.
- the microphone can classify person's voice timbre, person's age group, gender and an emotional state.
- the Kinect can detect person's posture and size, as well as movements and gestures, which allows to judge effects of the advertisement.
- the distance measuring module determines how far a person is from the media source 110. Then, the advertisement can be rendered based on the distance to a person (i.e., if the person is far, the lower resolution clips are shown). Alternatively, a person can be invited to come closer to the media source 110 by voice or by video. Additionally, a person's presence can be detected at least in part based on Bluetooth radio transmissions of his smartphone or tablet.
- the presence detector allows for detection of a person immediately, so the system can react to a presence very fast and begin to show the advertisement, while the person remains near the media source 1 10.
- An optional smell detector can detect a person's perfume and a gender based on a body odor.
- the weight platform can determine a shoe type (heels, sport shoes, casual or dress shoes), a person's weight and a number of people based on aggregate weight.
- a timer or a watch can assist in selecting advertisement based on a time of a day.
- the media source 110 also includes a near field communication (NFC)-terminal 145 and a printer 150.
- NFC-terminal 145 provides customers with the ability to receive product information (or coupons) to their mobile devices.
- the printer is used for printing out the information (e.g., schedules, store addresses, etc.) or coupons.
- the media source 110 is connected to the control server 111.
- the control server 111 has a database 190, which contains advertisement clips, data related to advertisers (companies) and to media providers.
- the control server also has mirror servers 185 with advertisement clips and a web-interface 195 for server control and configuration.
- the media source 110 communicates to the control server 111 via a billing and updates module 175 within the control server 111.
- New (or updated) advertisement video clips are downloaded to the computer 125 from the server database 190.
- the computer 125 can also download the updated recognition properties from the remote file server via Internet 180.
- FIG. 2 illustrates a method for teaching the targeted advertising system, in accordance with the exemplary embodiment.
- the recognition system of the media source 110 In order for the recognition system of the media source 110 to be effective, it needs to be trained (or taught) for creation of accurate classifiers for determining gender, age and emotional state of persons.
- Various sets of test images (containing facial features) need to be provided. For example, in order to teach an age classifying module, a number of images of children's faces, adult faces and elderly people faces are provided along with their classifying properties.
- the age classifying module learns what properties classify a particular age group.
- Same training principle is applied to gender classification, as well as emotional state classification.
- For training of the emotional state classifier a number of images with smiling and frowning faces are used along with their distinct properties.
- a teaching process is initiated in step 210 where a test set of images is loaded into a recognition system.
- a test set of images is normalized in step 220 by a method of principal component analysis, that allows to reduce significantly the data dimensions by converting the image into a set of uncorrected vectors called "properties".
- properties corresponding to the test images are loaded into a classifier module of the recognition system in step 240.
- the teaching process is completed.
- the teaching process can be repeated with a new set of test images.
- separate teaching cycles can be performed for gender, age and emotional state definitions.
- a recognition process is initiated in step 310, by detecting a person and acquiring a person's image. Definition of face, mouth and eyes within the image is performed in step 320, using a feature recognition algorithm (for example, Viola-Jones algorithm). Then in step 330, facial image rotation is normalized. According to the exemplary embodiment, normalization is performed as an affinity transformation, when a new coordinate system is selected and every point from one system to another is mapped, which rotates, moves and resizes the image using three pairs of given points.
- a feature recognition algorithm for example, Viola-Jones algorithm
- coordinates of a first point from each pair coincide with coordinates of a second point from this pair. Coordinates of detected eyes and mouth are used as the first point coordinates, while coordinates of these features calculated for an average face (out of a test set) are used as the second point coordinates. Note that the average face is positioned horizontally and the eyes are directed forward.
- step 340 lighting is normalized as well, using, for example, a known method of histogram transformation.
- step 350 the facial image is decomposed into components.
- the facial image is decomposed into a set of images that represent certain typical areas of the facial image.
- a known method for object classification can be used.
- a property vector is generated and provided to a classifier.
- step 360 the image is classified based on the property vector reflecting properties defining age, gender and emotional state.
- different advertisements can be provided to the same person based on his emotional state (or, alternatively, the same advertisements running at different speeds, since an angry person is likely to more positively react to a slow-moving advertisement, while a calm person may be more likely to want to see a fast-moving ad, or, alternatively, different advertisements for the same subject matter selected based on the person's emotional state).
- a centralized system having a plurality of interconnected media sources is implemented.
- the media sources are connected over the Internet.
- One or several control servers i.e., web-servers
- web-servers are used for supplying the media sources with advertisement media data stored in a distributed database.
- the media source not only renders the video to a potential customer, but can provide smells of various products (i.e., spray perfumes, food aromas, etc.).
- the media source system can also demonstrate products in a form of holograms.
- the media source system can also display the actual product samples shown in special compartments within the media system.
- the media system can also display some products formed by a piece of electroactive polymer substrates (EAP) by applying voltage to it (e.g., by showing a 3D form of a distinctive package for a product, for example), or print samples for the user using 3D printing techniques, or provide discount cards (like credit cards) or printed media for the specific individual standing in front of the display.
- EAP electroactive polymer substrates
- the media system in accordance to the exemplary embodiment, can interact with persons by asking questions and process their answers.
- the information provided by a video system can include information on where an advertised product can be purchased, directions and traffic.
- a person's reflection in the mirror panel of the media system can use "added reality" virtual features. For example, a person can be displayed wearing a hat, glasses or a different hairstyle provided by local vendors. Alternatively, only an audio advertisement can be provided.
- a person can be offered information about local food places, pharmacy, hair salon, fashion boutique, etc. Additionally, brand names of items that a person is wearing can be identified (for example, many jewelry or accessories or clothing items have a distinctive look, or display logos, etc.), and other items of that brand can be displayed to that person (or, alternatively, items of direct competitors). Additionally, widgets from social networks, news feeds, forecasts etc. can be displayed to a person. In one exemplary embodiment, video feeds from another media source (located at another point of a shopping mall or a city) are provided, optionally showing the nearby address of the location where the goods or services can be purchased.
- another media source located at another point of a shopping mall or a city
- the system can provided distributed matching (personals) services as well.
- advertisement can be selected, for example, based on highest likelihood of purchase, highest cost of goods being advertised, highest price paid by a particular advertiser, highest likelihood of interest to an average person, etc.
- different advertisements can be simultaneously displayed to viewers who see the screen from different angles.
- the system can keep track of which advertisement is shown to whom and when, including counters of how many times the ad was shown to the same person, and overall, and optionally any reaction from the target audience, permitting an analysis of the effectiveness of the advertising.
- the system can track whether the person is looking at the advertisement, for example, by analyzing the eye position (as opposed to away from the advertisement).
- a tilted mirror or a sound directed at the passing person can be employed.
- a request to smile can be displayed or produced by voice and the person is given a prize for smiling.
- a person can be found in social networks by his or her image, and based on the found data the advertisement can be targeted to this person even more precisely.
- the media system can accept payments for product orders using a touch screen. Payments can be made by SMS, cash, debit or credit card, PayPass, PayWave, PayPal, etc.
- the media system can display QR-code or bar-code for reading it by a mobile phone after which a link to a mobile site for purchasing the product is provided.
- the media system can provide product information via NFC and NSDT technologies.
- the media system can also offer a person to provide product-related data to his mobile phone via Bluetooth or Wi-Fi.
- the media system can be placed on a bus, metro, plane, train, elevator, or in a hotel. For any of these locations, the system determines an advertisement that can be of interest to an average person in the vicinity of the media panel. Then the advertisement is shown for a period of time (for example, till next bus or train stop) until the group of people in front of the media panel changes. Then, the average priorities are recalculated for rendering the next advertisement.
- geo-location is taken into consideration.
- a tracker determines the location of the bus (or train) using the geo-location data from cell stations, satellite navigation systems and wi-fi access points and the advertisement may be directed to stores, or other places based on their location.
- the recognition system uses a different algorithm. For example, a level of tan can be used to determine whether a person has just arrived or is about to leave the resort. The presence of souvenirs or local clothing can be detected as well. Based on this data, the appropriate advertisement is selected and rendered in real-time to a person.
- the media system in accordance to the exemplary embodiment, can be placed in a gym or a fitness center.
- the mirror of the media system can be placed in front of a training machine and, based on acquired images, a person can be given exercise advises or advertisements of fitness-related products (weight belts, gloves, weights, vitamins, etc.)
- an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer or a server 20 or the like, including a processing unit 21, a system memory 22, and a system bus 23 that couples various system components including the system memory to the processing unit 21.
- the system bus 23 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures.
- the system memory includes read-only memory (ROM) 24 and random access memory (RAM) 25.
- ROM read-only memory
- RAM random access memory
- the computer 20 may further include a hard disk drive 27 for reading from and writing to a hard disk, not shown, a magnetic disk drive 28 for reading from or writing to a removable magnetic disk 29, and an optical disk drive 30 for reading from or writing to a removable optical disk 31 such as a CD-ROM, DVD-ROM or other optical media.
- a hard disk drive 27 for reading from and writing to a hard disk, not shown
- a magnetic disk drive 28 for reading from or writing to a removable magnetic disk 29
- an optical disk drive 30 for reading from or writing to a removable optical disk 31 such as a CD-ROM, DVD-ROM or other optical media.
- the hard disk drive 27, magnetic disk drive 28, and optical disk drive 30 are connected to the system bus 23 by a hard disk drive interface 32, a magnetic disk drive interface 33, and an optical drive interface 34, respectively.
- the drives and their associated computer-readable media provide nonvolatile storage of computer readable instructions, data structures, program modules and other data for the computer 20.
- a number of program modules may be stored on the hard disk, magnetic disk 29, optical disk 31, ROM 24 or RAM 25, including an operating system 35.
- the computer 20 includes a file system 36 associated with or included within the operating system 35, one or more application programs 37, other program modules 38 and program data 39.
- a user may enter commands and information into the computer 20 through input devices such as a keyboard 40 and pointing device 42.
- Other input devices may include a microphone, joystick, game pad, satellite dish, scanner or the like.
- These and other input devices are often connected to the processing unit 21 through a serial port interface 46 that is coupled to the system bus, but may be connected by other interfaces, such as a parallel port, game port or universal serial bus (USB).
- a monitor 47 or other type of display device is also connected to the system bus 23 via an interface, such as a video adapter 48. In addition to the monitor 47, personal computers typically include other peripheral output devices (not shown), such as speakers and printers.
- the computer 20 may operate in a networked environment using logical connections to one or more remote computers 49.
- the remote computer (or computers) 49 may be another computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 20, although only a memory storage device 50 has been illustrated.
- the logical connections include a local area network (LAN) 51 and a wide area network (WAN) 52.
- LAN local area network
- WAN wide area network
- the computer 20 When used in a LAN networking environment, the computer 20 is connected to the local network 51 through a network interface or adapter 53. When used in a WAN networking environment, the computer 20 typically includes a modem 54 or other means for establishing communications over the wide area network 52, such as the Internet.
- a modem 54 or other means for establishing communications over the wide area network 52, such as the Internet.
- the modem 54 which may be internal or external, is connected to the system bus 23 via the serial port interface 46.
- program modules depicted relative to the computer 20, or portions thereof may be stored in the remote memory storage device. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Development Economics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Game Theory and Decision Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Data Mining & Analysis (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A method and system for detecting a presence of a person in a public area and for providing targeted advertising of goods and services to the person. An information rendering panel has a mirror surface that is used (entirely or partially) for rendering advertisements upon detection of a person in a vicinity of the system. The system includes a detection unit for detecting a person, a control module connected to the information rendering panel and to the detection unit. The detection unit includes a video camera. The control module detects age, gender and/or emotional state of a detected person. This data is provided to the information rendering panel for selecting and displaying advertisements appropriate for the detected person.
Description
METHOD AND SYSTEM FOR TARGETED ADVERTISING BASED ON PERSONAL PHYSICAL CHARACTERISTICS
Background of the Invention
Field of the Invention
[0001] The present invention is related to methods for targeted advertising and, in particular, to advertising goods and services to people in public areas.
Description of the Related Art
[0002] Many conventional advertising systems have an information rendering panel with a surface that is used (entirely or partially) for rendering advertisements when a presence of a person is detected. Such systems include a detection device for detecting a presence of a person and a control module that connects and synchronizes the information between rendering panel and the detection device.
[00031 These advertisement systems are disclosed in the following publications: US 2006/024867A1, JP 2000-112418 and RU 72349. A main common shortcoming of these conventional systems is that the advertising that is directed towards a broad audience and is not targeted to a particular person. This makes advertisements significantly less effective. Furthermore, the advertiser cannot keep track of the advertisements that were shown to potential customers. The advertiser prefers to pay for each time the advertisement is shown. The conventional systems do not allow for pay-per-show billing.
[0004] Accordingly, there is a need in the art for an efficient and effective system for detecting a person and rendering advertisements that are targeted specifically for this person.
Summary of the Invention
[0005] The present invention is related to system and method for detecting a presence of a person in a public area and providing targeted advertisement of goods and services to the detected person that substantially obviates one or more of the disadvantages of the related art.
[0006] According to an exemplary embodiment, an original and convenient rendering of advertisements targeted to a specific audience is provided. A system includes an information rendering panel having a mirror surface that is used (entirely or partially) for rendering advertisements upon detection of a person in a vicinity of the system. The system includes a detection unit for detecting a person and a control module connected to the information rendering panel and to the detection unit.
[0007] The detection unit includes a video camera. The control module detects age, gender and emotional state of a detected person. This data is provided to the information rendering panel for displaying advertisements appropriate for the detected person, including new people within a camera's field of view.
[0008] Additional features and advantages of the invention will be set forth in the description that follows, and in part will be apparent from the description, or may be learned by practice of the invention. The advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
[0009] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
Brief Description of the Attached Figures
[0010] The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
[0011] In the drawings:
[0012] FIG. 1 illustrates a system for targeted advertising, in accordance with the exemplary embodiment;
[0013] FIG. 2 illustrates a method for teaching the targeted advertising system, in accordance with the exemplary embodiment;
[0014] FIG. 3 illustrates a flow chart of a person recognition method, in accordance with the exemplary embodiment; and
[0015] FIG. 4 illustrates a schematic of an exemplary computer system that can be used for implementation of the invention.
Detailed Description of the Preferred Embodiments
[0016] Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
[0017] According to the exemplary embodiment, a method and system for an original and convenient rendering of advertisements targeted to a specific audience (persons) is provided. A system includes an information rendering panel having a mirror or similar transparent surface that is used (entirely or partially) for rendering advertisements upon detection of a person in a vicinity of the system.
[0018] The system includes a detection unit for detecting a person and a control module connected to the information rendering panel and to the detection unit. The detection unit includes a video camera.
The control module detects at least age, gender and emotional state of a detected person. This data is provided to the information rendering panel for displaying advertisements appropriate for the detected person.
[0019] According to one exemplary embodiment, the control module includes a storage medium with recorded advertisement data. A camera can be in a form of a web-cam and the control module can download advertisement data from a web-server. According to the exemplary embodiment, the control module determines data related to a detected person and stores this data for future references. In particular, this data can be used for analyzing the needs of potential customers and for developing future advertising campaigns.
[0020] According to the exemplary embodiment, the information rendering panel has a mirror surface that deflects optical rays received from the outside. At least a portion of the information rendering panel is implemented as a display, which can render the advertisements upon detection a person within a field of view of the video camera.
[0021] The information rendering panel allows through the optical rays generated by an advertisement source (e.g., a special monitor) located behind the information rendering panel (or within the system). The control module, in accordance with the exemplary embodiment, can be in a form of a computer that runs applications for determining person's age, gender and emotional state based on a person's image(s). For example, applications developed by agisoft.ru can be used. Optionally, voice analysis alone, or in combination with visual analysis, can be used to identify a person's gender, for example, and, the subject matter of conversation between several people, to further target the advertisement. Also, optionally, social network data (particularly, photographs in people's profiles, which can be matched to the image received by the camera) can be used to identify the person, and, optionally to assist in targeting the advertisement based on data in the profile. Then, the targeted advertisement is rendered to the person via a monitor. The system can also ask the user questions, and, in response, provide him with both advertisements and relevant information (e.g., from the server), based on his responses, his geographic location and his identified personal characteristics.
[0022] According to the exemplary embodiment, the control module can include a storage medium for storing pre-recorded advertisements (i.e., for example, a hard drive of a computer). Then, the personal data of the detected persons can be also stored onto the hard drive by the control module.
[0023] The information rendering panel is located in a public place. When the advertisements are not displayed, the information rendering panel appears as a regular mirror and serves as a part of a room ambience. However, once a person appears in a field of view of the video camera, an image is acquired and sent to the control module (i.e., a computer) in real-time. The control module determines personal parameters (i.e., gender, age, race and an emotional state).
[0024] Subsequently, based on the personal parameters, appropriate advertisement is selected for rendering to the detected person. The selection of advertisement is made according to pre-stored data reflecting potential (most likely) preferences of a person of a detected age, race, gender and/or emotional state. Then, the selected advertisement is rendered to the person via a monitor located behind the information rendering panel.
[0025] For example, if a potential customer is determined to be a young woman, the advertisement of cosmetics, make up or beauty products is rendered. Yet, if a potential customer is determined to be a middle age man, an advertisement of beer or alcoholic beverage is selected and rendered. As soon as
the person exits the camera's field of view (or based on a pre-set time out), the rendering of the advertisement is terminated and the information rendering panel begins to serve as a regular mirror again.
[0026] Those skilled in the art will appreciate that a surprise effect from a sudden advertisement displayed from a regular mirror (once a person looks at it) combined with an original and convenient way of delivering the targeted advertisement messages significantly increases the advertisement effect (and impression) on the person. Thus, the effectiveness of the overall advertisement campaign is increased, as well.
[0027] Furthermore, an additional data about potential customers is collected for developing effective advertisement campaigns. For example, an aggregate data reflecting age and gender (or race) of patrons of a particular establishment can be used for selecting the advertisements that are of interest to this group of people, including new people within a camera's field of view.
[0028] FIG. 1 illustrates a system for targeted advertising, in accordance with the exemplary embodiment. A media source 110 is connected to a control server 111 over the Internet 180. The media source 110 includes a web-camera 120 with an infra-red (IR) filter for detecting persons and acquiring their images. The IR filter allows through only the rays from the infra-red illuminated zone that are produced by an IR projector 115. The IR lighting allows for camera to operate in low (or dimmed) lighting and increases the accuracy of person recognition and determination of gender, race and age.
[0029] The media source 110 includes a computer 125 which has the following applications (components) installed: a person recognition system; a system for loading advertisement clips from the control server 111, and a billing system for billing an advertiser for the clips shown by a rendering device 130. The computer 125 and other media source 110 devices are supplied by a power source 165 connected to a power cable via an AC/DC converter 170. The computer 125 allows for classification of a person (by gender, age, race, etc.) and for selection of advertisement clips in real-time, on the order of tens of milliseconds. Note that the images acquired by the web-camera 120 are not necessarily sent to the control server 111.
[0030] The media source 110 also includes a rendering device 130, which can be implemented in a form of an LCD or plasma display for showing advertisement video clips to potential customers. The rendering device 130 is controlled by a rendering device controller 160, which selects and loads the advertisement video clips from the computer 125. The rendering device is illuminated by a light source 135 (LED or a lamp), which is controlled by a light source controller 155.
[0031] According to the exemplary embodiment, the computer 125 receives information from a sensor panel 140, which acquires parameters of a person. The sensor panel 140 can include a microphone, an X-ray source, a distance measuring module, a presence detector, a smell detector, a weight platform, a detector of ultra sound volume, an infrared-ray measuring device, Kinect or similar systems, etc. The sensor panel 140 is used for acquiring additional information about a detected person. For example, not only age, gender, race (or ethnicity) and emotional state (or mood) can be detected.
[0032] Also, parameters such as dress style (brands of clothing etc.), body type, degree of intoxication, hear style (color), presence of cigarettes, injuries, scars, accessories (hat, glasses, jewelry, ear rings etc.), special features (beard, mustache, degree of shaving, etc.), mobile phone (tablet computers, smart-phones, laptops, Bluetooth devices, etc.), walking characteristics, presence of pets, person's
speed of movement and a number of people in front of the media source 110 (a mirror) can be determined.
[0033] The infrared-ray measuring device can read an infrared map of an area in front of the media source 1 10 and determine a body temperature of a person. Using known algorithms, it can be determined if a person is sick, excited or is experiencing intense physical loads. The microphone can classify person's voice timbre, person's age group, gender and an emotional state. The Kinect can detect person's posture and size, as well as movements and gestures, which allows to judge effects of the advertisement.
[0034] The distance measuring module determines how far a person is from the media source 110. Then, the advertisement can be rendered based on the distance to a person (i.e., if the person is far, the lower resolution clips are shown). Alternatively, a person can be invited to come closer to the media source 110 by voice or by video. Additionally, a person's presence can be detected at least in part based on Bluetooth radio transmissions of his smartphone or tablet.
[0035] The presence detector allows for detection of a person immediately, so the system can react to a presence very fast and begin to show the advertisement, while the person remains near the media source 1 10. An optional smell detector can detect a person's perfume and a gender based on a body odor.
[0036] The weight platform can determine a shoe type (heels, sport shoes, casual or dress shoes), a person's weight and a number of people based on aggregate weight. A timer or a watch can assist in selecting advertisement based on a time of a day.
[0037] The media source 110 also includes a near field communication (NFC)-terminal 145 and a printer 150. The NFC-terminal 145 provides customers with the ability to receive product information (or coupons) to their mobile devices. The printer is used for printing out the information (e.g., schedules, store addresses, etc.) or coupons.
[0038] The media source 110 is connected to the control server 111. The control server 111 has a database 190, which contains advertisement clips, data related to advertisers (companies) and to media providers. The control server also has mirror servers 185 with advertisement clips and a web-interface 195 for server control and configuration.
[0039] The media source 110 communicates to the control server 111 via a billing and updates module 175 within the control server 111. New (or updated) advertisement video clips are downloaded to the computer 125 from the server database 190. The computer 125 can also download the updated recognition properties from the remote file server via Internet 180.
[0040] FIG. 2 illustrates a method for teaching the targeted advertising system, in accordance with the exemplary embodiment. In order for the recognition system of the media source 110 to be effective, it needs to be trained (or taught) for creation of accurate classifiers for determining gender, age and emotional state of persons. Various sets of test images (containing facial features) need to be provided. For example, in order to teach an age classifying module, a number of images of children's faces, adult faces and elderly people faces are provided along with their classifying properties.
[0041] Subsequently, the age classifying module learns what properties classify a particular age group. The more test sets are processes, the more accurately the age recognition is performed by the system. Same training principle is applied to gender classification, as well as emotional state classification. For
training of the emotional state classifier, a number of images with smiling and frowning faces are used along with their distinct properties.
[0042] A teaching process is initiated in step 210 where a test set of images is loaded into a recognition system. A test set of images is normalized in step 220 by a method of principal component analysis, that allows to reduce significantly the data dimensions by converting the image into a set of uncorrected vectors called "properties". Then, properties corresponding to the test images are loaded into a classifier module of the recognition system in step 240. Then, in step 250, the teaching process is completed. The teaching process can be repeated with a new set of test images. Thus, separate teaching cycles can be performed for gender, age and emotional state definitions.
[0043] A recognition process is initiated in step 310, by detecting a person and acquiring a person's image. Definition of face, mouth and eyes within the image is performed in step 320, using a feature recognition algorithm (for example, Viola-Jones algorithm). Then in step 330, facial image rotation is normalized. According to the exemplary embodiment, normalization is performed as an affinity transformation, when a new coordinate system is selected and every point from one system to another is mapped, which rotates, moves and resizes the image using three pairs of given points.
[0044] After the transformation, coordinates of a first point from each pair coincide with coordinates of a second point from this pair. Coordinates of detected eyes and mouth are used as the first point coordinates, while coordinates of these features calculated for an average face (out of a test set) are used as the second point coordinates. Note that the average face is positioned horizontally and the eyes are directed forward.
[0045] Then, in step 340 lighting is normalized as well, using, for example, a known method of histogram transformation. In step 350, the facial image is decomposed into components. The facial image is decomposed into a set of images that represent certain typical areas of the facial image. A known method for object classification can be used. A property vector is generated and provided to a classifier. In step 360, the image is classified based on the property vector reflecting properties defining age, gender and emotional state. Note that different advertisements can be provided to the same person based on his emotional state (or, alternatively, the same advertisements running at different speeds, since an angry person is likely to more positively react to a slow-moving advertisement, while a calm person may be more likely to want to see a fast-moving ad, or, alternatively, different advertisements for the same subject matter selected based on the person's emotional state).
[0046] According to one exemplary embodiment, a centralized system having a plurality of interconnected media sources is implemented. The media sources are connected over the Internet. One or several control servers (i.e., web-servers) are used for supplying the media sources with advertisement media data stored in a distributed database.
[0047] According to another exemplary embodiment, the media source not only renders the video to a potential customer, but can provide smells of various products (i.e., spray perfumes, food aromas, etc.). The media source system can also demonstrate products in a form of holograms. The media source system can also display the actual product samples shown in special compartments within the media system. The media system can also display some products formed by a piece of electroactive polymer substrates (EAP) by applying voltage to it (e.g., by showing a 3D form of a distinctive package for a product, for example), or print samples for the user using 3D printing techniques, or provide discount cards (like credit cards) or printed media for the specific individual standing in front of the display.
[0048] Furthermore, the media system, in accordance to the exemplary embodiment, can interact with persons by asking questions and process their answers. The information provided by a video system can include information on where an advertised product can be purchased, directions and traffic. A person's reflection in the mirror panel of the media system can use "added reality" virtual features. For example, a person can be displayed wearing a hat, glasses or a different hairstyle provided by local vendors. Alternatively, only an audio advertisement can be provided.
[0049] Based on personal data detected by sensors, a person can be offered information about local food places, pharmacy, hair salon, fashion boutique, etc. Additionally, brand names of items that a person is wearing can be identified (for example, many jewelry or accessories or clothing items have a distinctive look, or display logos, etc.), and other items of that brand can be displayed to that person (or, alternatively, items of direct competitors). Additionally, widgets from social networks, news feeds, forecasts etc. can be displayed to a person. In one exemplary embodiment, video feeds from another media source (located at another point of a shopping mall or a city) are provided, optionally showing the nearby address of the location where the goods or services can be purchased. Additionally, based on a person's image, a matching person for meeting can be recommended. Thus, the system can provided distributed matching (personals) services as well. Additionally, multiple people can be detected, and advertisement can be selected, for example, based on highest likelihood of purchase, highest cost of goods being advertised, highest price paid by a particular advertiser, highest likelihood of interest to an average person, etc. As a further option, different advertisements can be simultaneously displayed to viewers who see the screen from different angles. Also, the system can keep track of which advertisement is shown to whom and when, including counters of how many times the ad was shown to the same person, and overall, and optionally any reaction from the target audience, permitting an analysis of the effectiveness of the advertising. Also, the system can track whether the person is looking at the advertisement, for example, by analyzing the eye position (as opposed to away from the advertisement).
[0050] In order to attract person's attention to the media system, a tilted mirror or a sound directed at the passing person can be employed. A request to smile can be displayed or produced by voice and the person is given a prize for smiling. In yet another exemplary embodiment, a person can be found in social networks by his or her image, and based on the found data the advertisement can be targeted to this person even more precisely.
[0051] Furthermore, the media system can accept payments for product orders using a touch screen. Payments can be made by SMS, cash, debit or credit card, PayPass, PayWave, PayPal, etc. The media system can display QR-code or bar-code for reading it by a mobile phone after which a link to a mobile site for purchasing the product is provided. The media system can provide product information via NFC and NSDT technologies. The media system can also offer a person to provide product-related data to his mobile phone via Bluetooth or Wi-Fi.
[0052] According to the exemplary embodiment, the media system can be placed on a bus, metro, plane, train, elevator, or in a hotel. For any of these locations, the system determines an advertisement that can be of interest to an average person in the vicinity of the media panel. Then the advertisement is shown for a period of time (for example, till next bus or train stop) until the group of people in front of the media panel changes. Then, the average priorities are recalculated for rendering the next advertisement.
[0053] Additionally, in case of a bus or a train, geo-location is taken into consideration. A tracker determines the location of the bus (or train) using the geo-location data from cell stations, satellite navigation systems and wi-fi access points and the advertisement may be directed to stores, or other places based on their location.
[0054] In case of a hotel (or resort), the recognition system uses a different algorithm. For example, a level of tan can be used to determine whether a person has just arrived or is about to leave the resort. The presence of souvenirs or local clothing can be detected as well. Based on this data, the appropriate advertisement is selected and rendered in real-time to a person.
[0055] The media system, in accordance to the exemplary embodiment, can be placed in a gym or a fitness center. The mirror of the media system can be placed in front of a training machine and, based on acquired images, a person can be given exercise advises or advertisements of fitness-related products (weight belts, gloves, weights, vitamins, etc.)
[0056] With reference to FIG. 4, an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer or a server 20 or the like, including a processing unit 21, a system memory 22, and a system bus 23 that couples various system components including the system memory to the processing unit 21.
[0057] The system bus 23 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. The system memory includes read-only memory (ROM) 24 and random access memory (RAM) 25. A basic input/output system 26 (BIOS), containing the basic routines that help transfer information between elements within the computer 20, such as during start-up, is stored in ROM 24.
[0058] The computer 20 may further include a hard disk drive 27 for reading from and writing to a hard disk, not shown, a magnetic disk drive 28 for reading from or writing to a removable magnetic disk 29, and an optical disk drive 30 for reading from or writing to a removable optical disk 31 such as a CD-ROM, DVD-ROM or other optical media.
[0059] The hard disk drive 27, magnetic disk drive 28, and optical disk drive 30 are connected to the system bus 23 by a hard disk drive interface 32, a magnetic disk drive interface 33, and an optical drive interface 34, respectively. The drives and their associated computer-readable media provide nonvolatile storage of computer readable instructions, data structures, program modules and other data for the computer 20.
[0060] Although the exemplary environment described herein employs a hard disk, a removable magnetic disk 29 and a removable optical disk 31, it should be appreciated by those skilled in the art that other types of computer readable media that can store data that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access memories (RAMs), read-only memories (ROMs) and the like may also be used in the exemplary operating environment.
[0061] A number of program modules may be stored on the hard disk, magnetic disk 29, optical disk 31, ROM 24 or RAM 25, including an operating system 35. The computer 20 includes a file system 36 associated with or included within the operating system 35, one or more application programs 37, other program modules 38 and program data 39. A user may enter commands and information into the computer 20 through input devices such as a keyboard 40 and pointing device 42. Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner or the like.
[0062] These and other input devices are often connected to the processing unit 21 through a serial port interface 46 that is coupled to the system bus, but may be connected by other interfaces, such as a parallel port, game port or universal serial bus (USB). A monitor 47 or other type of display device is also connected to the system bus 23 via an interface, such as a video adapter 48. In addition to the monitor 47, personal computers typically include other peripheral output devices (not shown), such as speakers and printers.
[0063] The computer 20 may operate in a networked environment using logical connections to one or more remote computers 49. The remote computer (or computers) 49 may be another computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 20, although only a memory storage device 50 has been illustrated. The logical connections include a local area network (LAN) 51 and a wide area network (WAN) 52. Such networking environments are commonplace in offices, enterprise-wide computer networks, Intranets and the Internet.
[0064] When used in a LAN networking environment, the computer 20 is connected to the local network 51 through a network interface or adapter 53. When used in a WAN networking environment, the computer 20 typically includes a modem 54 or other means for establishing communications over the wide area network 52, such as the Internet.
[0065] The modem 54, which may be internal or external, is connected to the system bus 23 via the serial port interface 46. In a networked environment, program modules depicted relative to the computer 20, or portions thereof, may be stored in the remote memory storage device. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
[0066] Having thus described a preferred embodiment, it should be apparent to those skilled in the art that certain advantages of the described method and apparatus have been achieved.
[0067] It should also be appreciated that various modifications, adaptations and alternative embodiments thereof may be made within the scope and spirit of the present invention. The invention is further defined by the following claims.
Claims
1 . A system for targeted advertisement located in a public area, the system comprising:
a rendering device having a mirror surface for rendering advertisements;
a computer connected to the rendering device for providing the advertisement media;
a video camera with an infra-red (IR) filter connected to the computer for acquiring an image of a passing person;
a sensor panel connected to the computer for acquiring personal data from the passing person;
an IR projector behind the mirror surface;
a light source couple to a light source controller for lighting the rendering device; and a rendering device controller for loading the advertisement into the rendering device, wherein:
the computer analyses and classifies the image acquired by the video camera and selects the advertisement based on classification; and
the computer provides the selected advertisement media to the rendering device for rendering advertisement media to the person.
2. The system of claim 1 further comprising a printer for printing out information requested by the person.
3. The system of claim 1, wherein the computer comprises a billing module for billing an advertiser for the advertisement provided to the rendering device.
4. The system of claim 1 , wherein the computer comprises a recognition module for recognition and classification of the person.
5. The system of claim 1, wherein the image is classified at least by age, gender and emotional state.
6. The system of claim 1 , wherein the computer uses additional personal data provided by the sensor panel for classification of the person and selection of the advertisement to be rendered.
7. The system of claim 1, wherein the computer downloads the advertisement from a webserver and stores is for future rendering.
8. The system of claim 1 , wherein the video camera is a web-camera connected to a webserver for storing acquired images on the web-server.
9. The system of claim 1, wherein the computer downloads additional classification properties from the Internet.
10. The system of claim 1, wherein the sensor panel includes any of:
a microphone;
an X-ray source;
a distance measuring module;
a presence detector;
a smell detector;
a weight platform;
a detector of ultra sound volume;
a near field communication terminal for connecting to the passing person's
mobile device;
an IR measuring device; and
Kinect.
1 1. A computer-implemented method for targeted advertising, the method comprising:
detecting a person in a vicinity of an advertising system;
acquiring a facial image of the detected person;
providing the facial image to a classification module;
classifying the detected person using the image based on pre-stored properties;
selecting an advertisement based on the detected person's classification;
providing the advertisement to the advertising system; and
rendering the advertisement to the detected person.
12. The method of claim 11 , further comprising:
generating a test set of facial images;
normalizing the test set of the facial images;
forming a basis from the test set of the facial images;
identifying properties of the test images;
generating a property vector; and
loading the property vector into a classifying module for use in classifying the detected person.
13. The method of claim 12, wherein the test set of images comprises any of:
images of adults;
images of children;
images of elderly people;
images of smiling faces;
image of frowning faces;
images of males; and
image of females.
14. The method of claim 13, wherein the images are used with their classifying properties.
15. The method of claim 11 , wherein the classifying of the person comprises:
defining face, mouth and eyes with in the facial image;
normalizing the image rotation;
normalizing lighting;
decomposing the image into components;
generating a property vector; and
classifying the person based on the property vector.
16. The method of claim 1 1 , wherein the normalizing of the image rotation images is performed as an affinity transformation on coordinates of pairs of points, wherein upon the transformation coordinates of a first point from each pair coincides with coordinates of a second point from this pair.
17. The method of claim 16, wherein coordinates of detected eyes and mouth are used as the first point coordinates and coordinates of these features calculated for an average face from the test set of facial images are used as the second point.
18. The method of claim 17, wherein the test images are taken of faces positioned horizontally with the eyes pointed forward.
19. A system for targeted advertisement, the system comprising:
a processor;
a memory couple to the processor; and
a computer program logic stored in the memory and executed on the processor, the computer program logic for implementing the steps of claim 11.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
SG10201702912SA SG10201702912SA (en) | 2017-04-10 | 2017-04-10 | Method and system for targeted advertising based on personal physical characteristics |
SG10201702912S | 2017-04-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018190773A1 true WO2018190773A1 (en) | 2018-10-18 |
Family
ID=63793548
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/SG2018/050181 WO2018190773A1 (en) | 2017-04-10 | 2018-04-10 | Method and system for targeted advertising based on personal physical characteristics |
Country Status (2)
Country | Link |
---|---|
SG (1) | SG10201702912SA (en) |
WO (1) | WO2018190773A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110189179A (en) * | 2019-05-31 | 2019-08-30 | 广州软盈科技有限公司 | A kind of precision advertisement broadcast method |
CN110516874A (en) * | 2019-08-28 | 2019-11-29 | 中国银行股份有限公司 | Information processing method, apparatus and system |
US20200160389A1 (en) * | 2018-11-19 | 2020-05-21 | Walmart Apollo, Llc | Method and apparatus for automatically providing advertisements |
WO2021037569A1 (en) * | 2019-08-28 | 2021-03-04 | Roettcher Oliver M | Wall mirror having adaptive user interface |
CN112446718A (en) * | 2019-08-28 | 2021-03-05 | 南京深视光点科技有限公司 | Voice advertisement system capable of being placed in specific personnel and implementation method thereof |
WO2022023831A1 (en) * | 2020-07-29 | 2022-02-03 | Akhavan Mahdi | Smart display application with potential to exhibit collected outdoor information content using iot and ai platforms |
CN115829655A (en) * | 2022-12-30 | 2023-03-21 | 广州掌购网络科技有限公司 | Advertisement effect intelligent analysis management system and method based on big data analysis |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080004951A1 (en) * | 2006-06-29 | 2008-01-03 | Microsoft Corporation | Web-based targeted advertising in a brick-and-mortar retail establishment using online customer information |
CN102654913A (en) * | 2011-03-04 | 2012-09-05 | 谢韬 | Method for selectively delivering advertisement |
US20130342703A1 (en) * | 2012-06-25 | 2013-12-26 | PSP Security Co., Ltd. | System and Method for Identifying Human Face |
US20140156398A1 (en) * | 2011-04-11 | 2014-06-05 | Jianguo Li | Personalized advertisement selection system and method |
CN104166268A (en) * | 2014-07-24 | 2014-11-26 | 京东方科技集团股份有限公司 | Mirror surface display device |
-
2017
- 2017-04-10 SG SG10201702912SA patent/SG10201702912SA/en unknown
-
2018
- 2018-04-10 WO PCT/SG2018/050181 patent/WO2018190773A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080004951A1 (en) * | 2006-06-29 | 2008-01-03 | Microsoft Corporation | Web-based targeted advertising in a brick-and-mortar retail establishment using online customer information |
CN102654913A (en) * | 2011-03-04 | 2012-09-05 | 谢韬 | Method for selectively delivering advertisement |
US20140156398A1 (en) * | 2011-04-11 | 2014-06-05 | Jianguo Li | Personalized advertisement selection system and method |
US20130342703A1 (en) * | 2012-06-25 | 2013-12-26 | PSP Security Co., Ltd. | System and Method for Identifying Human Face |
CN104166268A (en) * | 2014-07-24 | 2014-11-26 | 京东方科技集团股份有限公司 | Mirror surface display device |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200160389A1 (en) * | 2018-11-19 | 2020-05-21 | Walmart Apollo, Llc | Method and apparatus for automatically providing advertisements |
US11928709B2 (en) * | 2018-11-19 | 2024-03-12 | Walmart Apollo, Llc | Method and apparatus for automatically providing advertisements |
CN110189179A (en) * | 2019-05-31 | 2019-08-30 | 广州软盈科技有限公司 | A kind of precision advertisement broadcast method |
CN110516874A (en) * | 2019-08-28 | 2019-11-29 | 中国银行股份有限公司 | Information processing method, apparatus and system |
WO2021037569A1 (en) * | 2019-08-28 | 2021-03-04 | Roettcher Oliver M | Wall mirror having adaptive user interface |
CN112446718A (en) * | 2019-08-28 | 2021-03-05 | 南京深视光点科技有限公司 | Voice advertisement system capable of being placed in specific personnel and implementation method thereof |
WO2022023831A1 (en) * | 2020-07-29 | 2022-02-03 | Akhavan Mahdi | Smart display application with potential to exhibit collected outdoor information content using iot and ai platforms |
CN115829655A (en) * | 2022-12-30 | 2023-03-21 | 广州掌购网络科技有限公司 | Advertisement effect intelligent analysis management system and method based on big data analysis |
CN115829655B (en) * | 2022-12-30 | 2023-09-22 | 广州掌购网络科技有限公司 | Advertisement effect intelligent analysis management system and method based on big data analysis |
Also Published As
Publication number | Publication date |
---|---|
SG10201702912SA (en) | 2018-11-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018190773A1 (en) | Method and system for targeted advertising based on personal physical characteristics | |
US10565616B2 (en) | Multi-view advertising system and method | |
CN105339969B (en) | Linked advertisements | |
US20190005535A1 (en) | Sales promotion system, sales promotion method, non-transitory computer readable medium, and shelf system | |
US9324096B2 (en) | System and method for communicating information | |
US20170243246A1 (en) | Content rendering system dependent on previous ambient audio | |
US20080004950A1 (en) | Targeted advertising in brick-and-mortar establishments | |
US20080004951A1 (en) | Web-based targeted advertising in a brick-and-mortar retail establishment using online customer information | |
JP2023510283A (en) | Systems/methods for identifying products within audiovisual content and allowing viewers/users of the audiovisual content to seamlessly purchase the identified products | |
CN110163715A (en) | Information recommendation method, device, equipment and system | |
US20140172557A1 (en) | Interactive display system | |
US20140130076A1 (en) | System and Method of Media Content Selection Using Adaptive Recommendation Engine | |
US20030088832A1 (en) | Method and apparatus for automatic selection and presentation of information | |
US20140379461A1 (en) | Information processing device, communication system, and information processing method | |
JP6470438B1 (en) | Mirror device and program | |
US10497020B2 (en) | Information processing device, communication system, and information processing method | |
WO2020093827A1 (en) | Multimedia material pushing method and apparatus | |
US20220253907A1 (en) | System and method for identifying tailored advertisements based on detected features in a mixed reality environment | |
KR20190113245A (en) | Method of providing a service using a face information | |
US20220066537A1 (en) | System and method for identifying tailored advertisements based on detected features in a mixed reality environment | |
KR20220021689A (en) | System for artificial intelligence digital signage and operating method thereof | |
CN111353842B (en) | Push information processing method and system | |
US10776828B2 (en) | System and method for facilitating dynamic brand promotion using autonomous vehicles | |
KR20230044382A (en) | Advertising curation system using face recognition and IoT technology | |
US11656681B2 (en) | System and method for determining user interactions with visual content presented in a mixed reality environment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18784746 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18784746 Country of ref document: EP Kind code of ref document: A1 |