FR3133257A1 - Experimental systems, devices and methods for the design of cosmetic applications - Google Patents

Abstract

Experience systems, devices and methods for designing cosmetic applications A system is provided that executes a competition that includes displaying to a user an image of a face of one of a plurality of models ; receiving inputs from the user to adjust a color of a mixed cosmetic product to be applied to the model's face; displaying the model with the adjusted color selected by the user; receiving the image of the model's face with the adjusted color as input from the user; displaying the user input to a plurality of users and providing the plurality of users with a vote-on option on the user input and the inputs of other users; producing a competition result based on an entry receiving the highest number of votes. The system is further configured to produce one or more colors of the blended cosmetic product included in the highest-voted entries corresponding to an extracted model as a recommendation to a user. No Figure for the abstract

Description

Experimental systems, devices and methods for the design of cosmetic applications CONTEXT Domain

The present invention generally relates to a system, apparatus and method for determining a combination of cosmetic substances that can be mixed and dispensed for a particular user.

SUMMARY

In one embodiment, a system is provided that includes processing circuitry configured to execute a contest that includes displaying to a user an image of a face of one of a plurality of models; receiving user inputs to adjust a color of a mixed cosmetic product to apply to the model's face; displaying the model with the adjusted color selected by the user; receiving the image of the model's face with the adjusted color as input by the user; displaying the user entry to a plurality of users and providing the plurality of users with an option to submit a vote on the user entry and the entries of other users; producing a result of a competition based on an entry receiving the greatest number of votes; the processing circuits being further configured to: receive an image taken by itself from a second user; analyze the characteristics of the second user based on the image; extracting a model from the plurality of models that includes features that match the analyzed features of the second user; determining contest entries in which one or more users determine a color of a mixed cosmetic product to be applied to the face of the extracted model; determining the greatest number of entries received corresponding to the extracted model and producing, as a recommendation to the second user, one or more colors of the mixed cosmetic product included in the entries receiving the highest number of votes corresponding to the extracted model.

According to particular embodiments, this process comprises one or more of the following characteristics, taken individually or in all technically possible combinations:

- System in which the processing circuits are configured to:

• receive a self-taken image from a second user;
• carry out an analysis of the characteristics of the second user based on at least the image taken by him in comparison with the entries in the competition;
• producing one or more colors of the mixed cosmetic product as a recommendation to the second user based on the analysis.

- System in which user inputs to adjust the color of the mixed cosmetic product are received on a displayed color adjustment interface.

- System in which the adjusted color selected by the user corresponds to a color created with color ingredients that are used in a dispensing device to produce the mixed cosmetic product.

- System in which the displayed color setting interface is further configured to select a color for the dispensing device to be used in producing the mixed cosmetic product.

- System further comprising the display of a link to purchase a mixed cosmetic product corresponding to the entry receiving the greatest number of votes.

- System in which processing circuitry is configured to display selectable areas of a face of the model that the user selects to adjust the color of a mixed cosmetic product.

- System in which the selectable areas include at least the model's lips, eyes and cheeks.

- System in which processing circuitry is configured to display a color used for a mixed cosmetic product for all entries currently displayed among entries submitted by the user and other users.

BRIEF DESCRIPTION OF THE DRAWINGS

This patent or patent application file contains at least one drawing executed in color. A fuller appreciation of the invention and the many advantages which flow therefrom will readily be obtained as it is better understood with reference to the following detailed description when considered in conjunction with the accompanying drawings in which:

There is a perspective overview of a cosmetics dispensing device or a cosmetics dispenser, according to one example;

There is a perspective view of a body of the distributor, according to an example;

There is a perspective view of the cosmetic dispenser, with the dispenser body removed, according to one example;

[Fig 4A] [Fig 4A] is a perspective view of internal components of the cosmetic dispenser, according to one example;

[Fig 4B] [Fig 4B] is a perspective view of internal components of the cosmetic dispenser, according to one example;

There is a perspective view of a cartridge, according to an example;

There is a perspective view of a cartridge gear, according to one example;

[Fig 7A] [Fig 7A] is a perspective view of a bottom plate, according to an example;

[Fig 7B] [Fig 7B] is a perspective view of the bottom plate, seen from the bottom, according to an example;

There is a perspective view of a base, according to an example;

[Fig 9A] [Fig 9A] is an exploded perspective view of a compact, arranged above a collector, according to an example;

[Fig 9B] [Fig 9B] is a perspective view of a compact in the open position, according to an example;

There is a diagram representing an example of a sequence of primary processes of a cosmetic formulation process 900, according to an example;

There is a process diagram representing an example of a method for detecting cosmetic material in the cosmetic dispenser, according to an example;

[Fig 12A] [Fig 12B] Figures 12A and 12B are process diagrams representing examples of a process for selecting a cosmetic formulation, according to one example;

There is a process diagram representing an example of a method for detecting cosmetic material in the cosmetic dispenser, according to an example;

There is a diagram representing an example of a connected cosmetic distribution system, according to an example and

There is a diagram showing typical circuits of the cosmetics controller and dispenser, according to an example.

There shows components of an ecosystem that uses the cosmetic dispenser to make personalized doses for a user.

There presents an ecosystem built on offering a user a trendy lipstick color.

[Fig 18A] [Fig 18A] shows an example flow of operations in the ecosystem for dispensing a personalized lipstick shade from an application perspective.

[Fig 18B] [Fig 18B] depicts an additional flowchart of how smartphone app algorithms in the lipstick ecosystem can allow a user to view a lipstick shade on the device. Self-portrait of the user.

[Fig 18C] [Fig 18C] further illustrates how the specific set of cartridges can result in different universes of shades to be presented to the user.

[Fig 18D] [Fig 18D] shows how match my look can work on the app in the lipstick ecosystem.

[Fig 18E] [Fig 18E] shows more details on how the lipstick recommendation engine works based on the user's outfit selfie.

There represents an ecosystem built on offering the user a skincare formulation that is most effective for the user.

[Fig 20A] [Fig 20A] depicts an example flow of operations in the ecosystem for distributing a personalized skincare formulation from an application perspective.

[Fig 20B] [Fig 20B] depicts an example of how a combination of different environmental factors determined to be present for a user can lead to different dosage amounts from three different cartridges.

There represents an eco-system that is used to distribute personalized foundation to the user.

[Fig 22A] [Fig 22A] represents an example of an operation flow in the ecosystem for distributing personalized foundation from an application perspective.

[Fig 22B] [Fig 22B] gives details of a method for carrying out a skin tone diagnosis.

[Fig 22C] [Fig 22D] Figures 22C and 22D depict details of how deep learning is used to assess skin tone in an image.

There represents a structure of a cartridge that has an NFC tag.

There represents a data format of the data stored on the NFC tag on the cartridge.

There represents a table that includes descriptions of the various fields contained in the NFC tag data format.

There represents a structure of the dispensing device which is equipped for an intelligent interchangeable cartridge system.

There represents a handshake between the dispensing device and the user's smartphone device.

There represents a client application state machine that shows a process from the application's perspective of priming cartridges before any use of the dispensing device.

There represents a method of handling a defective cartridge NFC tag in the above-mentioned scenario.

[Fig 30A] [Fig 30B] [Fig 30C] Figures 30A-30C show a first type of game that uses a chromatic rotating disk interface for a distribution device.

there represents a graph where data is collected on user selections on the chromatic spinning disk interface.

there represents a flowchart based on a game calibration function that uses the chromatic spinning disk interface.

There represents a second type of game that uses a chromatic spinning disk interface for a distribution device.

There represents a third type of game that uses a chromatic spinning disk interface for a dispensing device.

There represents an example of a user design challenge that uses the Chromatic Rotating Disk interface for a dispensing device.

[Fig 36A] [Fig 36B] Figures 36A and 36B depict different screens displayed to the user while the user is participating in the user design challenge.

There represents an alternative usability design challenge.

Figures 38 and 39 show example screens for different types of specific challenges for different themes.

There represents a process for generating a recommended cosmetic shade for a user based on the user's image and the results of a design challenge.

Figures 41 and 42 depict different processes for consolidating cosmetic cartridges into a single package based on the results of a design challenge.

There represents a screen displayed at the end of a design challenge that allows a user to purchase cartridge bundles based on the challenge results.

DETAILED DESCRIPTION OF THE EMBODIMENTS

In the drawings, like reference numerals designate identical or corresponding parts in the different views. Additionally, as used herein, the words "a", "an" and the like have, unless otherwise indicated, generally the meaning of "one or more".

For the drawings, like reference numerals designate identical or corresponding parts in different views.

The selection of cosmetic formulations and cosmetic components to formulate cosmetic formulations is a common activity often relying on subjective decision-making and manual input. There are a wide variety of cosmetic substances available, and countless combinations and permutations of cosmetic formulations possible.

For each occasion where cosmetic formulations are used, subjective decisions are often made by a cosmetic end user to produce satisfactory cosmetic formulations. Results are usually the result of experimentation, perhaps requiring several iterations to produce a satisfactory result . Partly due to limited knowledge of the specific characteristics of basic cosmetic substances and the necessary proportions, the resulting cosmetic formulations may lack precision. Repeatability of the production of a specific cosmetic formulation is therefore difficult to achieve. The embodiments below address these problems in conventional art.

More specifically, the description below relates to an ecosystem for enabling skin care and creating a formula customization system for use at home that is based on a specialized delivery device that allows the ingredients of a cosmetic product to be be instantly blended into a user's preferred end result, then be easily transported for greater portability.

The system shown below is a first-of-its-kind, AI-powered 3-in-1 device for personalizing skincare, foundation and liquid lipstick. The device and its corresponding app evaluate users' individual skin and local environmental data to create and deliver personalized skincare and cosmetic formulations on-site that optimize to increase levels of personalization over time.

The overall ecosystem features an AI-enabled motorized cartridge system as described above that creates personalized skincare and cosmetic formulas in four steps. The device creates personalized skin serums using the following process:

1. Personal skin analysis: the user takes a photo with a smartphone camera and opens an application on the smartphone. The app uses AI to analyze the overall condition of the user's skin, assessing deep wrinkles, fine lines, dark spots, lack of firmness, pore visibility and lack of radiance.
2. Environmental assessment: the application (and/or a separate cloud platform) assesses local environmental conditions that may influence the condition of the user's skin, including weather, temperature, humidity, UV index, air quality and pollen.
3. Product Preference: The user then enters specific skincare concerns, such as fine lines, wrinkles, dark spots, rough skin texture, and dullness, into the app.
4. Custom Formulation and Delivery: A personalized blend of high-performance skin care is then dispensed in a single portioned dose at the top of the device.

The motor system, located at the top of the device, moves and compresses the formula from the cartridges located at the base of the machine in an upward motion to the dispensing tray above to allow for clean application.

With regular use, the AI platform can assess the appearance of a user's skin over time, helping users identify what works and calibrate future formulas. The AI-powered system can optimize the effectiveness of personalized formulas. By regularly taking photos, users enable the intelligent system to recognize the effects of the formulas and adjust the dosage of active ingredients accordingly. That being said, the user can override the system's recommendations if they are looking for, say, additional moisturizer.

The skin care system contains active ingredients including AHAs, vitamins C and E, hyaluronic acid, ferulic acid, retinol, cucumber, thyme and mulberry.

Cosmetic offerings – for foundation and liquid lipstick – will have the ability to integrate real-time trend information as well as color matching technology into its personalized product offerings, as described below below.

• Through the Lipstick System, consumers will be able to create a liquid lipstick based on their skin tone and personal preferences. The system can match a user's clothing or accessories, it can even choose to create a particular color that is trending on social media. The device will have three cartridges; Collectively, these cartridges will have the capacity to create hundreds of shades.
• The foundation system described below will contain three cartridges, ranging from light to deep tones. Knowing that foundation is never unique, a selection of these trios of colors can be offered in order to match the greatest variety of shades. Using a shade matching tool, the three cartridges will distribute different levels of color to create custom shades. The device has the ability to create hundreds of custom shades. The device will create a single dose of color, but users can easily double or triple the amount with an extra touch.

There are three dosing settings for the system described here. There will be a standard-sized dose (0.7 grams; about the size of a pistachio) that users can double or triple with an extra twist.

The device has a compact with removable mirror that allows you to take a dose of product with you.

From opening the app and taking a photo of one's face to dispensing the product, the user experience with the current system takes about three minutes.

[DISTRIBUTION DEVICE]

There is a perspective overview of a cosmetic dispensing device 100, or a cosmetic dispenser, according to one example. The visible portion of the cosmetic dispenser 100 includes a base 102 connected to a power cord 104. The base 102 provides support for the body of the dispenser 106. A compact 108 is disposed above the body of the dispenser 106, a button power button 110 may be disposed partly within the body of the dispenser 106 such that the body of the dispenser 106 provides placement of the power button 110, and an indicator light and a button 122 may be disposed partly within inside the body of the dispenser 106 so that the body of the dispenser 106 ensures the placement of the indicator light and the button 122. The indicator light and the button 122 can be a mechanical or capacitive touch type button.

There is a perspective view of the body of the distributor 106, according to an example. The body of the dispenser 106 is a thin-walled hollow container which serves as a cover for most of the components of the cosmetic dispenser 100. In this example, the body of the dispenser 106 has a first upper end of substantially square section with rounded corners, while a second lower end has a circular cross section. The dispenser body 106 may provide a base for the compact 108, or other components serve as a base for the compact 108. The dispenser body 106 may also include a mounting point for the power button 110 and a mounting point. assembly for the indicator light and button 122.

There represents a perspective view of the cosmetic dispenser 100 with the body of the dispenser 106 being removed, according to one example. The power button 110, indicator light and button 122, a controller 150, a bottom plate 166, an inductive plate 176 and a gear case 170 are visible in this view, as is a lower body section 154, a middle body section 155 and an upper body section 156. The power button 110 is electrically connected to the controller 150.

The controller 150 includes circuitry for distributing power received via the power cord 104, controlling one or more motors 112 to dispense the cosmetic substance, detecting readings from an optical encoder 192, charging one or more batteries 126, operating indicators such as the indicator light and button 122, sound signals or other audiovisual signals, sensors, in particular for detecting the availability state, the type and quantity of cosmetic substance, and communicating wirelessly with external devices, including circuits for sending and receiving signals and data, for example via smartphones and other wireless devices, using a variety of communications protocols, such as radio frequency (RF), Bluetooth, Wi-Fi or cell phone.

The inductive plate 176 supports the bottom plate 166, apart from the base 102 and the power cord 104, the rest of the cosmetic dispenser 100 is disposed above the bottom plate 166. The gear case 170 is disposed at the Above it, it is connected to, and provides support to, the internal components of the cosmetic dispenser 100 which are described in more detail in Figures 4 to 9B. Additionally, the gear case 170 includes a plurality of gear case cartridge holes 178, one for each cartridge 114 in the cosmetic dispenser 100. A nozzle 160 of each cartridge 114 is disposed within the gear case 170. one of the cartridge holes of the gear case 178. Various additional substructures and covers may be disposed between the internal components of the cosmetic dispenser 100 and the dispenser body 106.

For example, the upper body section 156 is disposed above the middle body section 155, and the lower body section 154 is disposed below the middle body section 155. When connected, the body of the Dispenser 106 attaches to the exterior of at least one of the following: lower body section 154, middle body section 155 and upper body section 156. The lower plate 166 is disposed below and connected to the lower body 154.

Figures 4A and 4B are perspective views of internal components of the cosmetic dispenser 100, according to an example. The internal assembly includes a plurality of distribution assemblies 120, disposed above the bottom plate 166 and the inductive plate 176. Each distribution assembly 120 includes a cartridge 114, a cartridge gear 116, a motor 112, a motor gear 124, an ejector 140, an ejector index ring 190, an ejector spring 142, an ejector spring pin 144, a detent piston 146 and a detent spring 152. The controller 150 controls the operation of each of the dispensing assemblies 120. The cosmetics dispenser 100 includes at least one dispensing assembly 120. The examples described here contain three dispensing assemblies 120, although those skilled in the art recognize that a dispenser of cosmetics 100 can have any number of dispensing sets 120.

Additionally, a plurality of batteries 126 within the cosmetic dispenser 100 are electrically connected to the plurality of dispensing assemblies 120 to provide electrical power for the operation of the controller 150, the dispensing assembly 120 , motor 112 and various indicators, such as the indicator light and button 122 (described in more detail in ), sound signals or other audiovisual signals.

The controller 150 and a connected device 300 (shown on the ) allow a user to operate the cosmetic dispenser 100 wirelessly. Cosmetic substance formulation and recipe commands to controller 150 may be received from connected device 300, such as a smartphone, tablet, or personal computer, configured to communicate with cosmetic dispenser 100.

The cartridge 114 also having a cartridge key 162 disposed on or near the nozzle 160, is connected near a first end to the cartridge gear 116, is connected near a second end to the bottom plate 166, with a driving gear 124 connected to the motor 112, and the driving gear 124 connected to and driving the cartridge gear 116. The cartridge 114 and the cartridge gear 116 are held in position by the gear case 170 (shown in there ). The cartridge 114 may be disposed within the cosmetic dispenser 100, and secured in place by the ejector 140 connected to an ejector spring 142, the ejector spring pin 144 has a first end connected to the spring d ejector 142 and a second end rigidly connected to an interior surface of at least one of the following: the dispenser body 106, the lower body section 154, the middle body section 155, the upper body section 156 and another internal structure. The dispensing assembly 120 further includes an ejector indexing ring 190 (shown in [Fig 4A]) to guide the movement of the ejector 140 within the cosmetic dispenser 100 during insertion and dispensing. removal of the cartridge 114, with the ejector indexing ring 190 disposed against the interior surface of at least one of the following: dispenser body 106, lower body section 154, middle body section 155 and upper body section 156 to provide a guide for the movement of the ejector 140.

Additionally, an expansion piston 146 may be disposed substantially perpendicular to a longitudinal axis of the cartridge 114 and connected near the second end of the cartridge 114, providing lateral pressure to a circumferential groove 134 of the cartridge 114, holding the cartridge 114 in place along the vertical Y axis, counteracting an opposing force applied by tension to the cartridge 114 by the ejector 140, the ejector spring 142 and an ejector spring pin 144. The ejector 140 is disposed inside the cosmetic dispenser 100 and can move substantially parallel to the cartridge 114, and is connected to the ejector spring 142 which is further connected to the ejector spring pin 144. When the cartridge 114 is inserted in the cosmetic dispenser 100, an edge of the ejector 140 contacts an edge near the first end of the cartridge 114. The ejector 140 applies pressure to the cartridge 114 when the spring of the ejector 142 s stretches with increasing distance between the spring pin of the fixed ejector 144 and the ejector 140, as the ejector 140 moves with the cartridge 114 further into the cosmetic dispenser 100. Once the cartridge 114 is inserted at the point that a first end of the expansion piston 146 contacts the circumferential groove 134 of the cartridge 114, the movement of the cartridge 114 along the Y axis is restricted, holding the cartridge 114 in place

The trigger piston 146 is a mechanism that holds the cartridge 114 in place.

The expansion piston 146 moves along an axis substantially perpendicular to that of the major axis of the cartridge 114. A first end of the expansion piston 146 is arranged to come into contact with the cartridge 114. A second end is connected to a first end of a trigger spring 152, the second end of the trigger spring 152 is in contact with an interior surface of at least one of the following elements: the body of the distributor 106, the lower body section 154, the middle body section 155, the upper body section 156 or other internal structure.

Insertion of cartridge 114 into cosmetic dispenser 100 moves detent plunger 146 against detent spring 152, compressing detent spring 152. Since the contour of cartridge 114 varies along the length of cartridge 114 , the expansion piston 146 and the expansion spring 152 are moved by varying amounts depending on the position of the cartridge 114 relative to the cosmetic dispenser 100. At a point where the expansion piston 146 contacts the circumferential groove 134 of the cartridge 114, the first end of the trigger piston 146 is capable of locking the cartridge 114 in place due to the pressure of the trigger spring 152 and the geometric relationship between the trigger piston 146 and the circumferential groove 134.

Further, the cartridge 114 is inserted into the cosmetic dispenser 100 through a cartridge through the hole 172 of the bottom plate 166. The through hole of the cartridge 172 has a base key cutout 165 ([Fig 7A]) shaped to match base key 164 such that when base key 164 and base key cutout 165 come into contact, cartridge 114 cannot rotate relative to bottom plate 166. Cartridge 114 also has a shape to fit into the bottom plate 166 and cartridge gear 116 in a specific orientation. In the position where cartridge 114 is fully inserted into cosmetic dispenser 100 and locked in place by detent piston 146, cartridge 114 is seated against cartridge gear 116. Additionally, cartridge gear 116 has a collar portion 168 which is rotatably connected to the gear case 170, restricting the movement of the cartridge gear 116 such that the cartridge gear 116 can rotate about a longitudinal axis but cannot move axially or otherwise, and supporting the position of each of the cartridge gears 116 and the driving gears 124. Likewise, the driving gear 124 has a driving gear collar portion 169 which is rotatably connected to the housing d gears 170, restricting the movement of the driving gear 124 such that the driving gear 124 can rotate about a longitudinal axis but cannot move axially or otherwise, preserving the relationship between the cartridge gear 116 and the driving gear 124 such that rotational movement of the driving gear 124 causes rotational movement of the cartridge gear 116 at a fixed ratio.

The driving gear 124 may be a spur gear which includes a key cutout 163 ( ) fitted to cartridge key 162 of cartridge 114, as described by [Fig 4B].

There is a perspective view of the cartridge 114, according to an example. Cartridge 114 has a round cylindrical body and a nozzle 160 at a first end. The nozzle 160 is further disposed proximate a cartridge key 162. The cartridge key 162 fits inside the opening of the cartridge gear 116, is adapted to the shape of the cutout of key 163 of the cartridge gear 116, and locks the rotational movement of the portion near a first end of the cartridge 114 with that of the cartridge gear 116. The cartridge gear 116 is driven by the the driving gear 124 and the motor 112. A second end of the cartridge 114 includes a base key 164. The base key 164 fits within the base key cutout 165 of the bottom plate 166, fixed the second end of the cartridge 114 to the bottom plate 166 and prevents the rotational movement of the second end of the cartridge 114 relative to the bottom plate 166. Since the first end of the cartridge 114 is fixed to the movement of the cartridge gear 116, actuation of motor 112 rotates drive gear 124 and drives cartridge gear 116, thereby opening and closing nozzle 160 of cartridge 114. The first and second ends of the cartridge 114 can rotate relative to each other.

Cartridge 114 contains and dispenses an amount of cosmetic substance into compact 108 as needed (further described in Figure 9). Cartridge 114 dispenses cosmetic substance by rotation of cartridge gear 116 while cartridge 114 remains in place substantially vertically along the Y axis. Cartridge gear 116 is driven by drive gear 124 which is driven by the rotation of motor 112. The amount of rotation of motor 112 is controlled by controller 150 .

A quantity of cosmetic substance is released from the cartridge 114 through the nozzle 160 by a first rotational movement of the first end relative to the second end of the cartridge 114. The rotational movement of the first end of the cartridge 114 in a second direction, opposite to the first rotational movement, can close the nozzle 160 of the cartridge 114.

Cartridge gear 116 actuates nozzle 160 of cartridge 114 which is attached to a hollow cartridge leadscrew 202 within cartridge 114. Rotation of cartridge leadscrew 202 proportionally moves a piston of cartridge 200 which forces a quantity of cosmetic material through cartridge lead screw 202 and out of nozzle 160 of cartridge 114. The quantity of cosmetic material released during an opening and closing operation of nozzle 160 is a function of the movement of the cartridge lead screw 202, which depends on the rotational movement of the cartridge gear 116. The rotation of the motor 112 rotates the respective driving gear 124 and the cartridge gear 116. The controller 150 detects the relative movement of the cartridge gear 116 by using the optical encoder 192 to count a number of cartridge gear slots 148 that pass the optical encoder 192 as the cartridge gear 116 rotates, and the direction of rotation of the cartridge gear 116. A specific unit of measurement of cosmetic substance is a dose unit 118.

In one example, the lead screw pitch of cartridge 202 is approximately 1 mm, with one full rotation of the lead screw of cartridge 202 dispensing approximately 1 ml of cosmetic substance from cartridge 114.

In another example, due to the shape of the cartridge key 162 of the cartridge 114, the circumferential groove 134 may be a notch or groove around a portion of the circumference of the cartridge 114, rather than expanding entirely around the perimeter of the cartridge 114 to secure the cartridge 114 to the expansion piston 146 in substantially the same manner.

There is a perspective view of cartridge gear 116, according to one example. Cartridge gear 116 may be a spur gear that includes a key cutout 163 that matches the shape of cartridge key 162 of cartridge 114. Cartridge gear 116 may further have a collar 168 that connects rotatably to an interior surface of the gear case 170 to align and support the position of the cartridge gear 116 and the corresponding drive gear 124. The cartridge gear 116 may have a plurality of gear slots cartridge 148 for use with optical encoder 192 to detect the angular position of cartridge gear 116 and cartridge lead screw 202.

[Fig 7A] is a perspective view of the bottom plate 166, according to an example. The bottom plate 166 is connected to the dispenser body 106 and/or the lower body section 154, holds the plurality of cartridges 114 disposed inside the cosmetic dispenser 100, and connects the cosmetic dispenser 100 to the inductive plate 176 placed under the lower plate 166.

The bottom plate 166 has a plurality of cartridge through-holes 172 to permit insertion, removal and attachment of the plurality of cartridges 114. Each cartridge through-hole 172 includes a base key cutout 165, and the shape of the base key cutout 165 matches the shape of the base key 164 of each cartridge 114 to prevent rotational movement of the second end of the cartridge 114, the portion in contact with the bottom plate 166, when the cartridge 114 is installed in the cosmetics dispenser 100.

Additionally, the bottom plate 166 has contact pins 174 (shown in [Fig 7B]) which contact the inductive plate, providing electricity to the bottom plate 166, allowing the cosmetic dispenser 100 to charge the plurality of batteries 126 by contact or induction.

[Fig 7B] is a perspective view of the bottom plate 166, seen from below, according to an example. The bottom plate 166 includes three cartridge through holes 172 disposed inside the plate, and contact pins 174. When the bottom plate 166 is disposed inside the cosmetic dispenser and on the base 102, the pins contact plate 174 can conduct electricity from base 102 to bottom plate 166. Bottom plate 166 can then inductively charge the plurality of batteries 126 disposed above bottom plate 166

There is a perspective view of the base 102, according to an example. A power cord 104 is connected at a first end to the base 102. The power cord 104 is connected at a second end to a power source (not shown), providing power for operation of the dispenser of cosmetics 100 and for charging the plurality of batteries 126. The base 102 includes an indentation of the base 128 for placement of the inductive plate 176 and other parts of the cosmetic dispenser 100. The indentation of the base 128 may have the ability to inductively charge the plurality of batteries 126 using power supplied by the power cord 104. Additionally, it can also charge the cosmetic dispenser 100 via contact pins 174 disposed within the lower plate 166 when the lower plate 166 is disposed in the indentation of the base 128.

[Fig 9A] is an exploded perspective view of the compact 108, arranged above a collector 130, according to an example. The compact 108 includes an upper lid 180, a compact base 182, and a lower lid 184. The upper lid 180 is disposed above the compact base 182, which is disposed above or within the lower lid 184. The upper cover 180 is attached to the base of the compact 182 by magnets, as described in more detail in [Fig 9B]. The compact base 182 includes a plurality of holes passing through the compact base 138. In this example, there is one through hole 138 of the compact base for each cartridge 114 in the cosmetic dispenser 100. The bottom cover 184, having a plurality of bottom cover through holes 136, is disposed under the base of the compact 182. In this example, there is one bottom cover through hole 136 for each cartridge 114 in the cosmetic dispenser 100, and the bottom cover 184 is arranged such that each bottom cover through hole 136 corresponds to and is connected to a through hole 138 of the compact base 182.

The compact 108 is connected to the manifold 130, the manifold 130 is connected to and disposed above the gear case 170, further disposed inside the dispenser body 106 of the cosmetic dispenser 100, and the compact 108 is arranged above both the collector 130 and the body of the distributor 106. The manifold 130 includes a manifold through-hole 132 for each cartridge 114 in the cosmetic dispenser 100, and the manifold 130 is arranged so that each through-hole of the manifold 132 corresponds to and is connected to a base of the compact through the hole 136 of the lower cover 184. Furthermore, each through hole of the manifold 132 of the manifold 130 corresponds to and is disposed above a gear case cartridge hole 178 of the gear case 170, providing a passage through which the cosmetic substance can be dispensed from the nozzle 160 of each cartridge 114 through the collector 130, the lower cover 184, and into the base of the compact 182.

The compact 108 may be shaped such that there is only one orientation by which the compact 108 can connect to the cosmetic dispenser 100. In another example, the shape of the compact 108 may be connect to compact 108 in more than one orientation.

Additionally, the cosmetic substance dispensed into the compact 108 may be prevented from flowing back using a one-way duckbill valve 194 (not shown) disposed in each of the through holes 136 of the compact base in the lower cover 184 of the compact 108 .

[Fig 9B] is a perspective view of the compact 108 in the open position, according to an example. The compact 108 includes a top cover 180, a compact case base 182, a bottom cover 184, a plurality of hinge magnets 186a, 186b, 186c and 186d, a plurality of cover magnets 188a, 188b, 188c and 188d , and a plurality of mounting magnets 196a, 196b and 196c.

In one example, the compact base 182, the plurality of mounting magnets 196a-196c, a first half of the plurality of lid magnets 188b and 188d, and a first half of the plurality of hinge magnets 186b and 186d, are arranged inside the lower cover 184, with the base of the compact 182 disposed above. The plurality of mounting magnets 196a-196c are arranged to magnetically connect the compact 108 to the cosmetic dispensing device 100, for example by connecting to the manifold 130 ([Fig 9A]). The collector 130, or portions of the surface of the collector 130, may be formed of a ferrous substance or contain corresponding magnets to be magnetically attached to the plurality of mounting magnets 196a-196c.

A second half of the plurality of lid magnets 188a and 188c is disposed in one side of the upper lid 180, and a second half of the plurality of hinge magnets 186a and 186c is disposed in one side of the upper lid 180. hinge magnets 186b and 186d are arranged inside one side of the bottom cover 184 so that they can be in contact with the corresponding hinge magnets 186a and 186c in at least two planes, depending on a position relationship between the upper cover 180 and the lower cover 184. The hinge magnets 186a and 186b have opposite magnetic polarity, as do the respective pairs of hinge magnets 186c and 186d, the cover magnets 188a and 188b and the hinge magnets. cover 188c and 188d.

The plurality of 196 and the plurality of lid magnets 188a-188d may be arranged such that the plurality of lower lid through-holes 138 disposed in the base of the compact 182 are unobstructed to allow the cosmetic substance to flow. flow from each of the cartridges 114 into the compact 108 when the cosmetic product is dispensed.

In a case where the compact 108 is in the open position, the upper cover 180 and the lower cover 184 are positioned approximately in perpendicular planes, the hinge magnets 186a and 186c being magnetically connected to the hinge magnets 186b and 186d respectively. The magnetic force between each pair of hinge magnets 186a and 186b and the hinge magnets 186c and 186d is sufficient to hold the upper cover 180 in position relative to the lower cover 184.

In a case where the housing 108 is in a closed position, the upper cover 180 and the lower cover 184 are positioned approximately in parallel planes, the hinge magnets 186a and 186c magnetically connected to the hinge magnets 186b and 186d respectively, and the lid magnets 188a and 188c are arranged in corresponding positions, and magnetically connected respectively to the lid magnets 188b and 188d, the magnetic connection between the pairs of hinge magnets 186a and 186b and the hinge magnets 186c and 186d, and between the pair of lid magnets 188a and 188b, and the pair of lid magnets 188c and 188d, is sufficient to hold the upper lid 180 connected to the lower lid 184 in a closed position.

Since the upper cover 180 is magnetically connected to the lower cover 184, the upper cover 180 can be entirely separated from the lower cover 184. In addition, it can also connect with the lower cover 184 in a closed position in more than one orientation about the x-z plane, depending on the arrangement of the plurality of hinge magnets 186a-186d and lid magnets 188a-188d in the upper cover 180 and the lower cover 184. Additionally, the upper cover 180 may optionally be pivoted around the bottom cover 184, or vice versa, opening or closing around more than one axis, such as around the x-axis or z-axis.

Alternatively, the plurality of mounting magnets 196a-196c may be replaced by a mounting magnet 196 of sufficient strength to attach the compact 108 to the cosmetic dispensing device 100.

Alternatively, the plurality of hinge magnets 186a-186d may be replaced by a hinge magnet 186a of sufficient strength in the upper cover 180 and by a hinge magnet 186b of sufficient strength in the lower cover 184 to secure one side of the cover upper 180 to the lower cover 184 with the compact 108 in an open or closed position.

Alternatively, the plurality of lid magnets 188a-188d may be replaced by a lid magnet 188a of sufficient strength in the upper lid 180 and by a lid magnet 188b of sufficient strength in the lower lid 184 to secure one side of the lid upper 180 to the lower cover 184 with the housing 108 in the closed position.

There is a diagram representing an example of a sequence of primary processes of a cosmetic formulation process 900, according to an example. The examples provided herein each have three cartridges, although the same method can be used by the cosmetic dispenser 100 equipped with any number of cartridges 114. The cosmetic formulation method 900 includes a detection process S920, a selection process S940 and an S960 distribution process. An additional S980 mixing process can be performed by a user. The detection processes S920, the selection process S940 and the dispensing process S960 are executed by the cosmetic device 100 based on commands received from the controller 150, the controller 150 sending data to the user and receiving inputs from the user. this via the intelligent device 300 or through indicators located on the cosmetic device 100 itself, as described in Figures 3 and 4.

There is a process diagram showing an example of a cosmetic substance detection process in the cosmetic dispenser 100, according to one example. S920 represents a cosmetic material detection process. The process S920 may comprise at least one of the steps of step 921 of detecting removal and installation of a cartridge 114, step 922 of detecting at least one substance characteristic of the cartridge 114, an optional step 923 for detecting a quantity of cosmetic substance in the cartridge 114, and an optional step 924 for calculating the estimate of the exhaustion of the cartridge(s) after carrying out a future dispensing operation.

The optional step 923 of detecting a quantity of substance in each cartridge of a plurality of cartridges 114 may comprise, for example, the step 923a of detecting a quantity of substance of a cartridge A, the step 923b of detecting a quantity of substance of a cartridge B, and step 923c of detecting a quantity of substance of a cartridge C, for example based on the total net displacement (rotation) of the gear cartridge 116 detected by the optical encoder 192 since the installation of each cartridge 114.

The optional step 924 of detecting at least one substance characteristic in each of a plurality of cartridges 114 may include, for example, step 924a of detecting at least one substance characteristic of a cartridge A , step 924b of detecting at least one substance characteristic of a cartridge B and step 924c of detecting at least one substance characteristic of a cartridge C. The substance characteristics may include at least one characteristic of the group consisting of color, texture, shine, moisture, nutrient content and chemical formulation. This detection may be performed based on a near field sensor disposed in the dispenser 100 which detects an RFID tag on the cartridge which stores information about the contents of the cartridge according to methods well understood in the art. Alternative detection methods may be used such as bar code detection of a bar code printed on the cartridge, or detection using methods well understood in the art. The step of detecting said at least one substance characteristic in each of the cartridges can be carried out before the optional step of detecting the quantity of cosmetic substance in each cartridge.

Additionally, process S920 may include optional step 926 to report information that may be derived from historical, user usage data or aggregated across groups of users, such as cartridge 114 to interior of the cosmetics dispenser 100 which is supposed to be used up first in cosmetic substance and at what time.

[Fig 12A] is a process diagram showing an example of an S940 process for selecting a cosmetic formulation, according to one example. S940 includes a process for selecting a cosmetic formulation. Process S940 includes steps of identifying possible cosmetic formulation combinations based on the type and quantities of cosmetic substances present in cosmetic dispenser 100, as established by detection process S920.

A step 942d may be based on a user selecting from a set of cosmetic formulations that are possible for the types and quantities of cosmetic substance present in the cosmetic dispenser 100, or a step 942c allows the user to choose from a set largest inventory of cosmetic substances 204 possible for the types and quantities of cosmetic substances that the cosmetic dispenser 100 is capable of using.

In another example, step 943 of process S940 includes allowing a user to choose a desired dose unit 118. Varying the dose unit 118 may change the set of cosmetic formulations available from the inside the cosmetic dispenser 100 if a greater quantity of one or more cosmetic substances is required than is available to dispense a specific quantity of dosage unit 118 for a specific cosmetic formulation.

For example, if cartridge A contains a yellow cosmetic substance, cartridge B contains a red cosmetic substance and cartridge C contains a green cosmetic substance, and only one dose unit 118 remains of cartridge A, The user will not be able to choose to dispense any combination of dose units 118 and cosmetic formulations that require more than one dose unit 118 of yellow cosmetic substance.

Additionally, process S940 may include step 942a allowing the user to select a cosmetic formulation based on matching a photo, step 942b allowing the user to select a cosmetic formulation based on recommendations, or selecting a cosmetic formulation based on another process. U.S. Patent Number 8,634,640 describes a method of selecting a color from an image or photo in a camera or electronic device and using the color reference data to substantially match the color.

In another embodiment, a skin diagnosis (sometimes referred to herein as a skin profile) may be performed to provide a recommended plurality of predetermined colors that the user may select based on an analysis of the user's skin characteristics. The skin diagnosis determines an appropriate color for the user based on an imaging operation performed on the user's face. Examples of skin diagnostic tools known in the art are: Diagnos ABS from Lancôme, HR Skinscope, Bluesmart from Biotherm, Skinprofiler V.0 from Kiehl's, CA Dermanalyzer and Vichyconsult from Vichy.

For cosmetic formulations that are possible but not available based on the results of the detection process S920, the cosmetic dispenser 100 may communicate to the user which cosmetic substances are necessary to dispense such cosmetic formulations.

In one example, in step 944, the user selects a unit dose 118 of a cosmetic formulation currently unavailable. Step 944 may determine which cosmetic substances, such as the type of cartridges 114, are needed to mix and dispense the selected cosmetic formulation.

In another example, step 944 may determine what additional cosmetic formulations may become available if a specific cartridge 114 is replaced with a full but otherwise identical cartridge 114.

In another example, step 944 may determine what additional cosmetic formulations may become available if a cartridge 114 is replaced with another cartridge 114 containing a different cosmetic substance.

Step 945 determines whether to proceed to step 947 to prompt the user to confirm and proceed with dispensing a cosmetic formulation or to proceed to step 946 to report which cartridge(s) 114 are necessary to distribute the desired cosmetic formulation, based on the result of step 944.

[Fig 12B] shows an optional process S940b which is executed by the dispensing device 100 alone after a cosmetic formulation has been previously received and is currently stored on the dispensing device 100 at step 948. The remaining steps 943 to 947 of S940b are identical to those of S940 described in [Fig 12A].

The process of [Fig 12B] can be executed without an existing connection being established between the dispenser device 100 and the device 300.

There is a process diagram representing an example of a cosmetic substance dispensing process S960 in a cosmetic dispenser 100, according to one example. Step 961 represents a step of dispensing at least one unit dose of a cosmetic formulation. Process S960 includes steps 962a to 962c of ejecting a requested quantity of cosmetic material from at least one cartridge 114 to produce a cosmetic formulation selected by the user in process S940, such that the cosmetic formulation can be applied, transported in a container, or otherwise be available to the user. The process S960 includes the optional steps 963a to 963c of detecting the remaining quantity of cosmetic material in each of the cartridges and the optional step 964 of recording the results in a memory of the dispensing device.

Once the S960 dispensing process is completed, the user can perform the S980 process of manually mixing the released cosmetic substance, producing the requested cosmetic formulation.

There is a diagram representing an example of a connected cosmetics distribution system, according to one example. A system 400, which implements the cosmetics dispenser 100 described above, includes at least the cosmetics dispenser 100 and a connected device 300. Optionally, the system may further include one or more external servers 410 which are placed implemented in a cloud computing environment. Additionally, the system may optionally include a cosmetic substance inventory 204 which is an inventory of possible cosmetic substances that may be inserted into the cosmetic device 100.

The connected device 300 can be a personal computer (PC), a laptop, a PDA (Personal Digital Assistants), a smartphone, a tablet, a UMPC (Ultra Mobile Personal Computer), a netbook or a notebook type personal computer. . In the examples below, the connected device 300 is assumed to be a tablet, such as an Apple iPad.

The connected device 300 is capable of wireless communication with the cosmetic dispenser 100 by means of a wireless communication interface circuit 774 on the cosmetic dispenser 100. However, the connected device 300 is also capable of have a wired connection with the cosmetic dispenser 100 by means of a USB interface 776 on the device 100. Additionally, all devices, including the cosmetic dispenser can communicate with each other and with one or more external devices by means an Internet connection via an 802.11 wireless connection to a wireless Internet access point, or a physical connection to the Internet access point, for example via an Ethernet interface. Each connected device 300 is capable of wireless communication with other devices, for example via a Bluetooth connection or other wireless devices.

The connected device 300 is configured to receive information from a user for use in generating a cosmetic formulation that will be used by the cosmetic dispenser 100 to dispense a cosmetic substance into the compact 108.

There is a block diagram showing the circuitry of controller 150 and cosmetic dispenser 100, according to one example. A central processing unit (CPU) 710 provides primary control over separate circuit components included in the device, such as valve control circuits 740 (which may include control circuits for the motors 112, circuits for the optical encoder 192 and inductive sensor circuits). CPU 710 may also control optional input/output device 772 (such as a keyboard or mouse), memory 780, wireless communications interface circuit 774, universal serial bus (USB) controller 776, an LED driver 778 and a display module 780. The LED driver 778 controls the pulsation of one or more indicator lights 122.

In one embodiment, the circuits include, among others, one or more computing devices such as a processor (e.g., a microprocessor, a quantum processor, a qubit processor, etc.), a central processing unit (CPU) , digital signal processor (DSP), application specific integrated circuits (ASIC), field programmable gate array (FPGA), or the like, or any combination thereof, and may include circuit elements or discrete digital or analog electronic components or combinations thereof.

In one embodiment, a module includes one or more ASICs having a plurality of predefined logic components.

In one embodiment, a module includes one or more FPGAs, each having a plurality of programmable logic components.

In one embodiment, the circuit includes one or more components operably coupled (e.g., communicatively coupled, electromagnetically, magnetically, ultrasonically, optically, inductively, electrically, capacitively, wirelessly, or the like) each other. to others.

In one embodiment, the circuits include one or more remotely located components.

In one embodiment, remotely located components are functionally coupled, for example, via wireless communication, particularly with a connected device 300.

In one embodiment, remotely located components are operationally coupled, for example, via one or more communications modules, receivers, transmitters, transceivers, or the like.

In one embodiment, any of the components, CPU 710 or other components shown on the can be replaced by alternative circuit elements. Examples of circuits of this type include a memory which, for example, stores instructions or information. Non-limiting examples of memory include volatile memory (e.g., random access memory (RAM), dynamic random access memory (DRAM), or the like), non-volatile memory (e.g., read only memory (ROM), electrically erasable and programmable read only memory (EEPROM), computer compact disk (CD-ROM) or the like), persistent memory, or the like. Other non-limiting examples of memory include erasable programmable read only memory (EPROM), flash memory or the like.

In one embodiment, the memory is coupled to, for example, one or more computing devices by one or more instruction, information, or power buses.

In one embodiment, the circuitry includes one or more computer-readable media readers, interface jacks, universal serial bus (USB) ports, memory card slots, or the like, and one or more components. input/output such as, for example, a graphical user interface, display, keyboard, keypad, trackball, joystick, touch screen, mouse, switch, dial, or the like, and any other peripheral device.

In one embodiment, a module includes one or more user input/output components that are operably coupled to at least one computing device configured to control (electrically implemented, electromechanically implemented, software implemented, firmware implemented , or other control, or combinations thereof) at least one parameter associated, for example, with the determination of one or more thermal properties of tissues in response to detected shifts in the activation voltage.

In one embodiment, the circuitry includes a computer-readable media reader or memory card slot that is configured to accept signal-carrying media (e.g., computer-readable memory media, readable recording media by computer, or similar).

In one embodiment, a program enabling a system to execute any of the described methods may be stored, for example, on a computer-readable recording medium, a signal-carrying medium, or the like. Non-limiting examples of signal-carrying media include a recordable type media such as a magnetic tape, a floppy disk, a hard disk drive, a compact disk (CD), a universal digital disk (DVD), a Blu-ray disk. Ray, digital tape, computer memory, or the like, and a transmission type medium such as a digital or analog communications medium (e.g., fiber optic cable, waveguide, wired communications link, a wireless communications link (e.g., receiver, transmitter, transceiver, transmission logic, reception logic, etc.). Other non-limiting examples of signal-carrying media include, but are not limited to, limited to DVD-ROM, DVD-RAM, DVD+RW, DVD-RW, DVD-R, DVD+R, CD-ROM, Super Audio CD, CD-R, CD+R, CD+RW, CD-RW, video compact discs, super video discs, flash memory, magnetic tape, magneto-optical disc, MINIDISC, non-volatile memory card, EEPROM, optical disc, optical storage, RAM, ROM, system memory, web server or similar.

In one embodiment, the circuits include acoustic transducers, electroacoustic transducers, electrochemical transducers, electromagnetic transducers, electromechanical transducers, electrostatic transducers, photoelectric transducers, radioacoustic transducers, thermoelectric transducers, or ultrasonic transducers.

In one embodiment, the circuits include electrical circuits operably coupled to a transducer (e.g., an actuator, a motor, a piezoelectric crystal, a microelectromechanical system (MEMS), etc.).

In one embodiment, the circuits include electrical circuits having at least one discrete electrical circuit, electrical circuits having at least one integrated circuit, or electrical circuits having at least one application-specific integrated circuit.

In one embodiment, the circuits include electrical circuits forming a general purpose computing device configured by a computer program (e.g., a general purpose computer configured by a computer program that at least partially executes the processes and/or devices described herein, or a microprocessor configured by a computer program which at least partially executes the processes and/or devices described herein), an electrical circuit forming a memory device (e.g., forms of memory (e.g., random access , flash, dead, etc.)), electrical circuits forming a communication device (for example, a modem, a communications switch, opto-electric equipment, etc.) and/or any analogous non-electric device, in particular optical or other analogues.

[PERSONALIZED COSMETIC ECOSYSTEM]

There represents components of the 1600 ecosystem that are common to each product type. The ecosystem includes the dispenser 1610, a user smartphone device 1620 and a cloud platform 1630. The smartphone is shown as comprising two functional blocks of the configuration of the smartphone application ("app") 1621 and of use of the smartphone application 1622. Configuration of the smartphone application 1621 will be described in detail below with respect to the various customization examples and involves establishing initial configuration information to configure a user profile of the user. The configuration information may then be used when the smartphone application is used and may also be sent to the cloud platform 1630 for use in sending a selection of styles relevant to the user .

Use of the smartphone application itself involves the user making selections that lead to the determination of a color and performing interactive communication with the dispenser, such as sending the recipe to the dispenser and tracking dispenser status (such as inventory and volume remaining in dispenser cartridges). The smartphone application also performs interactive communication with the cloud platform. For example, the smartphone application may receive the selection of relevant styles described above, and it may also provide direct user feedback on the styles that the cloud platform has previously sent and it can inform the cloud platform of the colors and recipes actually selected by the user and distributed by the distributor. This feedback can provide a form of machine learning to the cloud platform and improve the algorithms used by the cloud platform.

[PERSONALIZED LIPSTICK ECOSYSTEM]

There represents the ecosystem described above (1700) which is based on proposing a trendy lipstick color to the consumer after analyzing trends on social networks by combining the taste of favorite colors, geolocation, favorite influencers , past selection etc. It offers the consumer the possibility of choosing a color based on a style, trying it virtually and adjusting it if necessary to finally produce the formula on site with a connected dispenser. It is also possible to suggest a color based on the user's outfit scanned with a self-portrait photo. The consumer can save favorite colors and share them with their virtual community.

There represents a user's smartphone that ultimately delivers a recipe to the dispensing device via a smartphone application ("app"). The smartphone application interacts with both the connected distributor and a cloud platform. Before a user performs normal operations (use) of the smartphone application, the application must be configured (1710) with configuration information to configure a user profile. The application configuration can be based on the following configuration inputs.

• Questionnaire during registration (e.g. favorite color)
• Identifiers on social networks (in particular Instagram, Twitter, Facebook)
• Favorite influencers to follow color
• Geolocation based on local fashion
• Environmental data (UV index, pollution, humidity, pollen)

The configuration entries are used during regular use of the application on the smartphone, but they are also transmitted to a cloud platform, which can be an external server connected via the Internet.

Actual use of the smartphone application (1720) includes selecting a lipstick selection mode. In the present example, the modes include a mode of selecting a social media trending recommendation by algorithms that are executed in the cloud platform (discussed later in more detail). Another mode allows the user to create their own lipstick color using a wide variety of color options.

Another mode can allow the user to match a lipstick color to their “style” based on the self-portrait photo. In this example, the shade and finish selection in the proposed photo is extracted. User can virtually try on the lipstick in real time, user can adjust the color presented. When the user is happy with the color, the user can tap a button displayed on the app to dispense the formula and an internal neural network will break down the requested color into different color cartridge doses. Once the recipe is sent to the dispenser and the lipstick shade is dispensed, the user can apply the lipstick.

After using the lipstick, the user can use the app to provide feedback whether he/she liked the result or not. User can also save their favorite style and color for reuse later, and user can share the look and color on canvas via social media platform.

The cloud platform implements functions introduced in 1730, such as a remote algorithm workflow and improvement process.

In the workflow performed by the cloud platform, personal social media accounts (influencers, trending styles) can be retrieved for lipstick color data. The cloud platform can perform analysis of one or more collected images to extract the average makeup color (lips, foundation, hair color) using a deep learning algorithm to segment the finishes of the makeup lips. For example, the cloud platform may accomplish this by first detecting lips in a plurality of images using a technique known in the art (such as that described in U.S. Patent No. 5,805,745 ). The cloud platform can then make comparisons of an extracted color with the colors most favored by one or more user communities while also taking into account user configuration inputs received from the smartphone device. of the user. Taking into account all the collected data, the final step is for the cloud platform to send the analysis results to the user in the form of the aforementioned selection of relevant styles.

In the improvement process carried out by the cloud platform and smartphone application, the user can save their favorite styles and like the popular color to enrich the scraping algorithms for recommendation relevant later. The cloud platform can also aggregate all user feedback, and the platform can send new users the most trending area based on location.

The distribution operations in Block 1740 are already described in detail above, but they are summarized as follows. The dispenser receives an order to dispense a certain proportion of each cartridge. The dispenser dispenses on the top and the user can mix it to achieve the desired color. The dispenser returns the remaining stock of the formula to the client application to ensure that only the colors to be dispensed are available in the user interface when the user makes a selection.

[Fig 18A] depicts an example flow of operations in the ecosystem described above for dispensing a personalized lipstick shade from an application perspective. In step 1810, the user may select a "mode" as described above, which may be a mode for selecting a social media trend recommendation by the algorithms that are executed in the cloud; allow the user to create their own lipstick color using a wide variety of color options or allow the user to match a lipstick color to their "style" based on the self-portrait photo.

Step 1820 represents an example of a display when the chosen mode makes it possible to select a trend style powered by an AI algorithm of the cloud platform. Step 1820 also shows that a menu is provided at the bottom of the interface to allow the user to switch between the modes described above.

Step 1830 represents an example display where the user has selected a potential hue and is allowed to adjust the hue using an appropriate adjustment mechanism such as a color palette or slider. The shade can be displayed on the user's self-portrait.

Step 1840 shows that once a color is finally selected by the user, the color is broken down into a combination of available colors contained in the cartridges of the dispensing device, the recipe is then transmitted to the dispensing device for distribution.

[Fig 18B] depicts an additional flowchart of how smartphone app algorithms in the lipstick ecosystem can enable a user to visualize a shade of lipstick on the lipstick's self-portrait. user. A recipe prediction module 1860 ("Module 2") may receive as inputs the dispensing capacity of the device, which is the set of three lipstick ingredient cartridges currently inside the dispensing device. Another input can be the full tint color of the dilution mixtures, which represent the actual color values that can be produced by the cartridge ingredients. The output of Module 2 is a list of recipes (actual quantities dispensed from each cartridge) and a corresponding predicted full-tone RGB color resulting from each recipe. Module 1 (1870) can then project what the lipstick will look like on their actual lips based on the full tint RGB color in a recipe and the user's lip color (liptone), this which results in a list of recipes and a corresponding RGB color applied. The relationship between the full tone color and the applied color based on the user's "liptone" can be predetermined and stored in advance. So what can be presented to the user on the screen is a palette based on an RGB color universe as shown in 1890.

[Fig 18C] further illustrates how the specific set of cartridges can result in different universes of shades to be presented to the user.

[Fig 18D] shows how the “match my style” mode can work on the app in the lipstick ecosystem. In state 1881, a user can enter a self-portrait that includes the user's outfit. A recommendation can be generated in different ways based on color recognition and/or outfit type in the self-portrait. For example, an early approach ("Approach 1") in 1882 can use the 7 rules of color science and harmony to target the formation of a certain type of relationship between lipstick shade and colors of outfit based on the relationships of the rotating chromatic disk as illustrated in Approach 1. Alternatively, in the 1883 state, a predetermined palette may be presented based on a recommendation from a makeup artist for a seasonal style of the outfit in combination with the color of the outfit

[Fig 18E] depicts more details of how the lipstick recommendation engine works based on the user's outfit selfie. In state 1891, probes can be defined by the user at different points on the equipment, where only one probe can have priority. In the 1892 state, a different color palette can be assigned to each probe based on the makeup artist's recommended palettes, it can also be based on a predetermined chromatic rotating disk relationship as has been shown in [Fig 18D] . As seen in state 1893, the output can recommend colors based on the cartridge set installed in the dispensing device, and based on the number and priority of probes the user has decided to use. If desired, the user can also swipe to browse options that would be available in other chromatic spinning discs if other cartridge sets were used. This may prompt the user to purchase a new set of cartridges.

[PERSONALIZED CARE ECOSYSTEM]

There represents the ecosystem described above (1900) which consists of offering the user a skin care formulation that is most effective for the user based on the user's geolocation, environmental factor, cumulative UV exposure and clinical signs assessed with diagnosis by smartphone or by a dermatologist. The system manages to adjust the proportion of assets to obtain the most effective recipe on a daily basis. The user can save their favorite colors and share them with their virtual community.

There represents a user's smartphone that ultimately delivers a recipe to the dispensing device via a smartphone application ("app"). The smartphone application interacts with both the connected distributor and a cloud platform. Before a user performs normal operations (use) of the smartphone application, the application must be configured (1910) with configuration information to configure a user profile. The application configuration can be based on the following configuration inputs.

• Questionnaire during registration (e.g. favorite color)
• Skincare analysis by dermatologist or AI algorithms with self-portrait
• Geolocation based on the location detection function of the smartphone
• Environmental data (UV index, pollution, humidity, pollen)

The configuration entries are used during regular use of the application on the smartphone, but they are also transmitted to a cloud platform which can be an external server connected via the Internet.

The actual use of the smart phone app (1920) is to collect geolocation-based environmental data and combine it with a smart phone diagnosis assessing clinical signs (wrinkles, spots, firmness, pores, fine lines, skin tone dull).

The user can also collect data from a UV sensor, such as a portable UV sensor as described in US Patent No. 10,060,787, which will actually give an accurate measurement of UV exposure cumulative received. Based on historical skin assessment data and environmental factor, the app will process the ideal formulation to combat the signs of aging of your skin and protect itself from the environment. When the user is satisfied with the formulation, the user can tap a button displayed on the app to dispense the formulation and an internal neural network will break down the requested formulation into different cartridge ingredients. Once the recipe is sent to the distributor and the formulation is dispensed, the user can apply the formulation. The user can provide feedback on their preferred formulations for a specific period of time.

The cloud platform implements functions introduced in 1930, such as a remote algorithm workflow and improvement process. In the workflow carried out by the cloud platform, based on environmental forecasts on UV, pollen, pollution, temperature, specific notifications are sent to the application user to adjust the recipe. For example, there is a known correlation between environmental conditions and skin aging (see “Evaluation of the impact of chronic urban air pollution (UP) on certain facial signs of Chinese men of different ages” (“ Assessing the impact of an aerial chronic urban pollution (UP) on some facial signs of differently‐aged Chinese men ”) at the following address www.researchgate.net and “ The skin aging exposome” » in www.jdsjournal.com). Additionally, by giving input of the user's geolocation, which can provide an air quality determination using a tool such as Breezometer TM and a forecast of the local UV index (l UV exposure can also be obtained based on a UV sensor described above), the cloud platform can adjust the recipe to account for environmental factors such as UV exposure and air quality. For example, [Fig 20B] below depicts examples of combinations of environmental factors and their correlation with the ingredients in the cartridges.

In the improvement process carried out by the cloud platform and the smartphone application, the user can save his favorite recipes which are the most effective over time or which offer the best sensation on the skin. The user can also share their recipes with the community.

The cloud platform can further consolidate all user feedback, and the platform can send new users the most trending wording area by location.

The distribution operations in Block 1940 are already described in detail above, but they are summarized as follows. The dispenser receives an order to dispense a certain proportion of each cartridge. The dispenser dispenses on the top and the user can mix it to achieve the desired color. The dispenser returns the remaining stock of the formula to the client application to ensure that only dispensable ingredients are available in the user interface when the user makes a selection.

[Fig 20A] depicts an example flow of operations in the ecosystem described above for distributing a personalized skincare formulation from an application perspective. In step 2010, the user may perform a skin care diagnosis as described above, which may be performed by taking a 360° self-portrait photo, or a series of photos from different angles using the camera capability. photo from smart phone. In step 2020, the app performs an analysis of the user's skin to detect skin characteristics, such as dark spots, wrinkle firmness, pores, fine lines, dullness, etc. A deep learning method for training and performing this type of detection is discussed in more detail below. Alternative known methods may also be used, such as those described in U.S. Patent Nos. 10,325,146 and 9,760,935.

Step 2030 represents the analysis results for one or more of the skin characteristics that are analyzed. Results can be displayed as a score, which can be relative to people in the user's age range. For example, each of the skin characteristics can be presented on a five-point scale, and characteristics that represent a score significantly worse than an average score can be highlighted as a priority for the user, while Characteristics that are better than average can be presented as a strong point.

Step 2040 shows that the application may present a recommended skin care formulation ("blend") that addresses the user's priority skin care concerns, while taking into account current environmental conditions. Once the formulation is finally selected by the user, the formulation is broken down into a combination of the available colors contained in the cartridges of the dispensing device, and then the recipe is transmitted to the dispensing device for dispensing in step 2050.

[Fig 20B] shows an example of how a combination of different environmental factors determined to be present for a user can lead to different dosage amounts from three different cartridges. In this example, the cartridges respectively include the administration of ingredients for deep damage recovery, cell renewal and daily protection against skin aggressions (which may include an SPF ingredient and a pollution protection ingredient). In this example, a fixed dose of cartridge 1 can always be used for effectiveness, while the proportions of the remaining cartridges vary depending on the levels of UV or pollution present.

[CUSTOM FOUNDATION ECOSYSTEM]

There represents an eco-system 2100 which is used to distribute a personalized foundation to the user. The Eco-System 2100 uses a deep learning algorithm to measure the user's skin tone with a smartphone. By combining with environmental information or makeup tutorials, the system can adjust throughout the year to always offer the consumer the best foundation color that matches their tan level/skin tone variation. Based on weather forecasts and UV exposure, the device can also increase skincare actives or SPF.

There represents a user's smartphone that ultimately delivers a recipe to the dispensing device via a smartphone application ("app"). The smartphone application interacts with both the connected distributor and a cloud platform. Before a user performs normal operations (use) of the smartphone application, the application must be configured (2110) with configuration information to configure a user profile. The application configuration can be based on the following configuration inputs.

• Questionnaire during registration (e.g. favorite color)
• Detection of user skin tone with 360° video and skin tone algorithm
• Geolocation based on the location detection function of the smartphone
• Environmental data (UV index, pollution, humidity, pollen)

The configuration entries are used during regular use of the application on the smartphone, but they are also transmitted to a cloud platform, which can be an external server connected via the Internet.

Actual use of the smartphone application (2120) includes collecting geolocation-based environmental data and combining it with a smartphone diagnostic assessing the user's skin tone. While methods of determining a user's skin tone to match a foundation are known in the art, a method below related to a deep learning method will be described in detail. Depending on the condition of the user's skin, the application can decide to merge the skincare active ingredients with the foundation, in particular the SPF when the environmental conditions are not optimal. The app makes a determination based on the time of year and the person's tan level to slightly adjust the foundation color to follow the changing skin tone. When color does not perfect the matching process, the user can send feedback to the cloud to remotely improve the algorithms. In some cases, the user may wish to use the device to adjust the color of the base to achieve a specific makeup strategy by layering different colors.

The cloud platform implements functions presented in 2130, such as a remote algorithm workflow and an improvement process. In the workflow carried out by the cloud platform, based on environmental forecasts on UV, pollen, pollution, temperature, specific notifications are sent to the application user to adjust the recipe by adding of the FPS. The cloud platform can shift the master skin tone formula for the user which is sent when the consumer's tan level is different from the initial diagnosis.

In the improvement process carried out by the cloud platform and the smartphone application, the user can save his favorite recipes which are the most effective over time or which offer the best sensation on the skin. The user can also share their recipes with the community. The cloud platform can further consolidate all user feedback, and the platform can send new users the most trending wording area by location.

The distribution operations in block 2140 are already described in detail above, but they are summarized as follows. The dispenser receives an order to dispense a certain proportion of each cartridge. The dispenser dispenses on the top and the user can mix it to achieve the desired color. The dispenser returns the remaining stock of the formula to the client application to ensure that only dispensable ingredients are available in the user interface when the user makes a selection.

[Fig 22A] represents an example of an operation flow in the ecosystem described above for distributing a personalized database from the application point of view. At step 2210, the user may perform a skin care diagnosis as described above, which may be performed by taking a 360° self-portrait photo, or a series of photos from different angles using the ability to smartphone camera. In step 2220, the application performs an analysis of the user's skin to detect skin tone and shade.

At step 2230, the application may present a recommended foundation ("blend") that matches the user's skin tone while taking into account current environmental conditions. Once the foundation is finally selected by the user, the foundation is broken down into a combination of the available ingredients contained in the cartridges of the dispensing device, and then the recipe is transmitted to the dispensing device for dispensing at step 2240.

[Fig 22B] provides more details on the method of performing the skin tone diagnosis described above. In step 2211, the user performs a video recording of himself until face detection is performed by the smartphone application. In step 2212, face detection is carried out according to known methods. If no face is detected, an error message is displayed to the user, and it may ask to change an angle or position of the camera relative to the user until the face detection is performed. After face detection is performed, preprocessing is performed on 10 frames of video data, where a normalization process and a zooming process are performed to evaluate the specific features of the user's face. Normalization is a process to align all frames to the same resolution, orientation width, illumination, etc. Normalization aims to make frames comparable to each other and to ensure that the main algorithm will operate within the validated operating condition/range and avoid any outlying data points. A skin tone prediction model is then executed in step 2213 based on a median skin tone value detected in the 10 frames used for prediction. Additionally, an evaluation of the prediction noise rate is performed using a median approach to filter/average the noise. If the noise prediction is low, a skin tone LAB value is used to determine the mixture used to generate the foundation at the dispensing device. However, if the noise level is high, then a safety net backup questionnaire is triggered in step 2214, which requests a foundation that the user has used previously. Next, the previous foundation color is mapped to a stored LAB value which is used to determine the mixture used to generate the foundation at the dispensing device.

[Fig 22C]-D shows additional details of how deep learning is performed to cause the smartphone application (or cloud platform) to estimate a skin tone in a photo. The same process can also be used to cause a device to estimate a skin care condition in a photo. In [Fig 22C], training is performed for the deep learning model. Inputs are provided in step 2221, where images (which may be 360 video self-portraits or photo self-portraits) are input along with metadata associated with the inputted image and external metadata. The metadata associated with the image may include a date and time (and/or season) as well as an optional GPS location and whether the image is taken indoors or outdoors. External metadata can be historical climate data. Preprocessing is performed on the input images in step 2222, it may include face detection, centering and scaling, face recognition (depending on library availability) and correction of lighting conditions. In step 2223, the deep learning model performs image learning by learning features for skin tone estimation. The deep learning model may also perform frame selection to determine the scalar importance weight of selected frames based on a group of images from the same user. The output of the deep learning model (2224) provides a weighted average of the skin colors of the selected frames and the weights obtained with frame selection and post-processing. To adjust the accuracy of the model, a measured skin color is input into the system for the real user in the images to perform the deep learning model.

[Fig 22D] shows the use of the deep learning model once learning has reached an adequate level. This is called “inference time” because skin tone (or skin condition) will be inferred from images without being able to make a true measurement on the user's actual skin. It can be seen that the steps in [Fig 22D] are the same except that there is no measurement of the user's skin color in the final step.

[INTELLIGENT EXCHANGEABLE CARTRIDGE SYSTEM]

The dispensing device described above allows consumable cartridges to be swapped intelligently and efficiently. The cartridges (consumables) used in the distribution device described above are preferably managed in batches (such as batches of three cartridges). For example, there could be separate cartridge sets for each of the lipstick, skincare, and foundation applications described above. In the system, sets of consumables equipped with a smart chip or an electronic device configured to perform storage and transmission/reception of data (including NFC, RFID or a contact chip). In the following description an NFC (Near Field Communication) tag will be mentioned, but not limited to this example. Each cartridge has different cosmetic attributes and a unique formula identifier that can identify attributes such as shade/finish, texture, and skin/hair benefits. The attributes are stored on the integrated circuit in production and signed with an asymmetric cryptographic algorithm.

As we will see in detail below, the NFC label applied to the cartridges ensures management of the color universe for the user, multi-device use cases and traceability.

The tag will have two memory areas: an area for production data (encoded during the filling process) and an area for usage where the device will encode usage and tracking quantities. In addition, the following security mechanism has been implemented: (i) ensure non-modification of production data: sectoral editions are protected by password (secret password); (ii) ensure non-duplication of cartridge data in the event of misappropriation: addition of a signature mechanism by UIID (unique identifier of the label), the encoded data, the manufacturer's secret key) The application using the device for reading the cartridge will then verify that the signature comes from the manufacturing entity before authorizing distribution.

There depicts a structure of the cartridge 2300, which is similar to the cartridge described above, but further includes a region 2310, which is an area where metallization is not permitted, and an NFC (smart chip) tag 2320 which is glued to the bottom of the cartridge so that it is flat and without edges.

There represents a data format of the data stored on the NFC tag on the cartridge. The “OFF” column designates an “offset”, which corresponds to the coordinates of the data encoded in hexadecimal. “Page” represents consecutive data table blocks because the system can only fully read/write one page at a time. We can see that the format includes a Tag ID and several fields. The data size for the data included on the NFC tag is 56 bytes in this non-limiting example, but it can also be more or less important. The data format shows that there are information fields directed toward production information and other fields directed toward usage tracking.

There represents a table that includes obvious descriptions of the various fields contained in the NFC tag data format. Additionally, “base type” denotes the data type, for example: u8 denotes an 8-bit unsigned integer. “Ule16” designates a 16-bit unsigned integer. “Length” and “page” are the coordinates and assignment required in the memory page of the NFC tag. For example “u8” is an 8-bit unsigned integer, which will require 8 bits of memory space at page 0.

There shows a structure of the dispensing device 2600 which is equipped for the intelligent interchangeable cartridge system. We see that the dispensing device 2600 includes a contact/Hall effect sensor 2610 which detects and counts an opening/closing cycle of the cover to trigger consumable reading and change detection operations. The device further includes a communication interface 2620, which here is a specific NFC antenna for each cartridge channel which can read and write information on the NFC tag of the cartridge each time it is dispensed.

There represents a handshake between the dispensing device 2600 and the user's smartphone device 2710. The various triggers for initiating communication between the dispensing device and the smartphone may include a connection established between the devices (such as Bluetooth pairing), opening the cover of the dispensing device, a dispensing order sent by the smartphone application (in particular one of the applications described above), or a dispensing order entered directly on the dispensing device. distribution. In response to the trigger, the handshake comprises in step 1, reading a consumable status of the cartridges stored on the dispensing device and sending the status to the smartphone. At the same time, the user experience is updated and sent to the smart phone. “User experience” refers to a context of the device relative to the user viewing a specific interface showing the user a pop-up window when the lid is open, the cartridge is empty, or the color wheel is the correct color available. In step 2, the smartphone may transmit or adjust a dispensing command sent to the dispensing device. In step 3, the distribution device can transmit the distribution feedback itself to the smartphone. In step 4, the smartphone may transmit an instruction to update the NFC tags on the cartridges when a dispensing session is completed.

There represents a client application state machine that represents a process from the application's perspective of priming cartridges prior to any use of the dispensing device. In an initial priming step 2810, a certain formula may be dispensed in a predetermined sequence and/or simultaneously from each of the cartridges to verify that dispensing can be accomplished from each cartridge. In an additional priming step 2820, the user can practice clicking on a displayed color to control individual distribution on command. This can be done to ensure that the correct color is detected in the correct channel within the device so that recipes can be automatically assigned to the correct channel. Step 2830 represents a display, when priming is complete, of the state of the cartridges in the dispensing device.

As a result, the priming process can detect when a new cartridge has been installed and it allows proper engagement with the plunger of the dispensing device and the formula contained in the cartridge so that an appropriate dose can be dispensed when a actual mixture is created.

Additionally, by detecting the exact cartridges that are installed, the cartridge set (such as the set of three cartridges) can be determined, and the color attributes (or skin care attributes) that are possible with the The current set are automatically updated on the app.

Additionally, the application can perform consumable management by automatically suggesting or performing pipe cleaning when changing a cartridge. The application can further adapt the universe of formulas in the user interface function depending on the type of cartridge set installed.

Additionally, the application state machine may detect inconsistent sets or missing cartridges. She can offer to buy the missing set to achieve a result. It can automatically detect the expiration dates of all cartridges. Additionally, because the security information is stored on the cartridge, this allows for native multi-user and multi-device capability since each separate user's smartphone will independently detect the information on the cartridge.

During boot, cartridges can also be authenticated. A 32-bit control key is generated in production using a manufacturer's secret key and the code is encoded on the cartridge's NFC tag. The smartphone includes a hard-coded secret key, which may be included in a software development kit (SDK), to verify the control key when reading NFC tag data transmitted from the dispensing device. The smart phone can also be hardcoded with the secret key if possible. A unique item identification (UIID) tag can also be physically added to the cartridge or NFC tag (in the form of a barcode for example) and read by the dispensing device. If the cartridge authentication process fails, the dispensing device can transmit the notification to the smartphone.

In rare cases, the user may encounter a cartridge whose NFC tag is not read by the machine (encoding error, destruction of the tag, device out of range, other defect). In this case, the user should still be able to dispense the formula and use their device as normally as possible. To ensure this default tolerant mode, a recovery cartridge mode requiring the user to enter cartridge information will take over the operation. The application relying on the SDK will then create a virtual cartridge to continue the algorithm to be distributed. This automatically triggered recovery mode will be deactivated the moment a new cartridge is inserted or when the NFC is in range again.

There represents a method of handling a defective cartridge NFC tag in the above-mentioned scenario. If there is an error in reading the data from the NFC tag, the process is started at step 2910, the SDK installed on the smartphone activates a recovery mode for a particular channel of the dispensing device. In step 2911, the SDK attempts to write a new production sequence (by transmission to the label via the distribution device) on the label from the last value read. In step 2912a, if the label is written successfully, the process ends. However, in step 2912b, if the label fails to be rewritten, the process proceeds to step 2940. In step 2913, the application displays a message asking the user to verify that a cartridge is in an appropriate channel and the dispensing device automatically opens the cover in step 2914. In other words, if the problem was that no cartridge was inserted, this step will remedy that possibility. In step 2915, the user confirms that a cartridge is in the channel. If reading is still impossible, in step 2916, the user is asked to select a color of the cartridge corresponding to a sticker on the cartridge. In step 2917, the user is asked to enter the lot ID and serial number of the cartridge, and asked to verify if the cartridge is new. In step 2918, the SDK creates a virtual cartridge for the channel number. Dispensing operations can continue based on using the virtual cartridge as a proxy to correctly read the NFC tag on the real cartridge. In step 2919, the virtual cartridge will be stopped if the cartridge suddenly becomes readable for a predetermined number of consecutive distribution operations or if all of the cartridges are changed.

[GAME]

The distribution device described above may include several "gaming" features that are not only useful in entertaining the user, but provide valuable data and feedback to optimize system functionality and provide personalized results to the user .

Games with the chromatic rotating disc

Figures 30A-30C show a game that uses the color spinning disk interface described above.

In a first game, shown in [Fig 30A], a photograph of a mixed color is presented to the user (before being applied to a face). The user is prompted to select a point on the color wheel that matches the displayed color. Once the user makes a selection on the color wheel, the result shows the user the percentage corresponding to the hue actually distributed ([Fig 30B]).

The "difference" between the user's selection on the color wheel and the color actually displayed may be based on a difference in CIELAB coordinates. For example, a Euclidean distance between points L*, a*, b* can be determined based on the perceptual differences between any two colors in L*a*b* which can be approximated by treating each color as a point in a three-dimensional space (with three components: L*, a*, b*) and taking the Euclidean distance between them.

In a variation of this game, [Fig 30C] represents a challenge where the user is asked to make a selection based on an image of a model wearing lipstick after dispensing a recipe from the dispensing device and after The mixture.

The benefit of this game is to train the user to better understand the color wheel so that there is not too much variation between the user's desired selection and the actual result.

Another advantage is that user selections can be used to determine whether the displayed color wheel itself is correctly calibrated. For example, if a large number of users do not consistently make selections within an appropriate threshold of the actually distributed mixed color, then adjustments may be made to the displayed color wheel.

Additionally, if the user device is collected, it will be incorporated into the learning if the displays on different devices are set differently such that users' selections diverge based on their user device. With this data, the application can make adjustments to the displayed color wheel based on the user device type or user-specific operating system.

For example, the depicts a graph in which data is collected on the user's selections on the color wheel for a displayed image such as those shown in Figures 30A or 30C. Additionally, the correct position of colors on the color wheel is shown in comparison. We can see that in this example the user's selection group is not centered on the correct color. If a centroid of a cluster of user selections is offset in coordinates by some magnitude from an assumed correct color position on the color wheel, then color correction may be necessary for color mapping displayed on the color wheel.

There represents a flowchart based on the above game calibration feature. At step 3101, the image shown in Figures 30A or 30C is shown to a plurality of users for each separate instance of the game. As each user plays the game and provides input to the color disk, the point of view data selection of each user on the color disk are transmitted to a central server (step 3012). This data can be analyzed after a threshold number of users provide input for the same image. A cluster may be formed based on the total number of user inputs collected and a centroid of the cluster is determined and compared to a coordinate position of the presumed correct point on the color wheel that would allow the dispensing device to generate the displayed cosmetic formulation in the picture. If the distance between the centroid and the correct position is greater than a predetermined threshold, in this case the color wheel will be recalibrated in step 3104. Otherwise, the process repeats.

In one example, "tuning" involves remaping the associated color value in a color space (such as CIELAB) for each position on the color wheel displayed to a new color value in the color space to more accurately reflect that color space. that the user sees displayed on his screen. In other words, the "error" in the values displayed on the color wheel compared to what the actual color will look like when a color is distributed by the system, or even on images displayed in-game, represents a vector shift between the displayed color and the color value stored in the game application. Therefore, a vector shift can be performed for all color values associated with the color positions displayed on the color wheel based on the difference between the color space values between the centroid of the group described above and the target image color.

There represents a second type of “chromatic spinning disc” game. In this game, three colors of ingredients that are dispensed from the canister are presented separately to the user. The user is then asked to guess the resulting color on the color wheel which will be made based on the color combination.

Once the user makes a selection on the color wheel, the result of the actual shade based on the color combination with a percentage match of the user's selection is shown to the user.

The advantage of this game is to train the user to understand what the result will be by combining the colors when the user looks at the colors separately. This can make the user more proficient in selecting specific cartridges to produce a desired shade.

There represents a third type of game that also uses the color wheel. In this game, the user attempts to guess which color to select on the color wheel by seeing other cosmetics applied to the model while the model's lips are blocked. The hidden selection may be a selection made by a professional makeup artist. Once the user's entry in the color wheel is selected, the actual hidden lipstick shade will be revealed and a percentage match will be demonstrated to the user. Over time, the percentage matches will be averaged to determine an overall user score.

As a first advantage of the game illustrated on the , the user can sharpen their eye on how lipstick colors coordinate with other cosmetic products. The game can vary in such a way that the user can select different professional makeup artists so that the user can target a particular style or taste in the industry.

A second advantage of the game represented on the is that each user's selections can be collected by a central server. This data can be very useful. For example, they can be used to find out the preferences of the general public. For example, with additional user data, such as the user's age, location, and other lifestyle habits, a cosmetics company can know if there are trends in user preferences based on different user categories and locations.

The data can also be useful if the characteristics of the model in the photo are taken into account. When large amounts of user picks are collected, one can see if there is a trend in user picks based on the model's appearance (such as hair color, skin tone, body type). nose, the structure of the cheekbones, etc.).

User Design Challenges

A second category of game is represented on the . The game involves a user design challenge which may be based on a theme which may be described in an introductory screen 3501. The interface 3502 represents selectable regions of a model's face, such as lips, eyes, cheeks, face, eyebrows and/or background.

Once the user selects the region to adjust a cosmetic tint to the displayed model's face, a screen 3503 is displayed; it represents a color wheel that can adjust the displayed shade of the selected cosmetic.

Once the user has made additional selections and adjustments on a different face region (such as moving to the eye region in 3504), the user can submit the "style" to enter the challenge (see the [Fig 36A]).

[Fig 36B] shows that a screen can be displayed to the user asking them to vote on different styles. A community of users can vote on the best style of the challenge on a screen shown in [Fig 36B] and determine a winner or ranking of submissions.

For each submission, style statistics can be displayed, showing the color shade used for each cosmetic region. Additionally, a web link may be provided so that a user viewing a submitted style can purchase the cosmetic shades used in the style statistics.

There represents an alternative challenge with screens 3701, 3702, 3703 and 3704 which are analogous to the challenge represented on the . For example, in screen 3704, when you make changes to the eyes, eyeliner, eyeshadow, or mascara can be "drawn" onto the image using a specific virtual tool.

Figures 38 and 39 show example screens for different types of specific challenges for different themes. For each theme, a first screen (3801 or 3901) may offer the user the option to complete the challenge, a second screen (3802 or 3902) may display the challenge description, requirements and rewards. Additional screens to display may include a voting screen (3803 or 3903) which represents different "styles" created by community users. Finally, a results screen (3804 or 3904) can be displayed; it represents the challenge winning styles as well as trend shades based on data collected during the challenge.

The design challenge games described above are not simply intended to entertain the user. Rather, the voting system used in the game is a form of participatory production or crowdsourcing on different cosmetic shades and styles that users in a community prefer. Additionally, based on the models' appearance (like hair color, skin tone, nose type, cheekbone structure, etc.), style submissions and voting can provide insight into colors and styles that best suit different face types.

This data can be used for practical application such as learning and creating recommendations when users ask for advice on which shades to use on their own face. For example, as shown in , and similar to the process described in [Fig 22A] above, in step 4001, the user can take a self-portrait, a 360° self-portrait or a series of photos from different angles using the device photo from smart phone. In step 4001, the system performs an analysis of the user's skin to detect the user's characteristics. In step 4003, the system determines an image of a model used in the design challenges that matches the user's characteristics. In step 4004, the system determines the shade or shades which received the most votes which were applied by the users on the image of the model and delivers the shade or shades which received the best votes to the user in as a recommendation for the user.

Gaming-Based Manufacturing Optimization

The above games collect valuable data on popular color shades selected by the user community, which is also valuable for configuring the production and supply of cartridges used in the dispensing device described above.

For example, a popular color shade selected by users will be based on a specific blend of two or three cosmetic formulations used in the dispensing device. As these formulations gain frequency as source ingredients in the colors selected in the sets described above, this data can be used for at least the following two practical applications:

1. Efficient grouping of formulations into predetermined sets of cartridges for sale.

2. Establish priorities for manufacturing and distribution of specific cartridges

There represents a method of efficiently grouping a set of cartridges for sale together based on game results when the goal is to group together the most popular source ingredients.

In step 4101, data is collected on the X most frequent ingredients in the colors selected by a community or by users, where X is an integer. In an example, X can be worth 3 since the dispensing device described above contains 3 cartridges. However, X can be any number 3 or higher depending on the preferred size of the bundling to be sold as a single unit. In step 4102, the main ingredients X are defined to be included in a single package sold. This adjustment can be made in a packaging and distribution facility.

While concerns grouping the most common ingredients in a single package, other ways of grouping ingredients in a single package may be preferable. For example, to allow users to create a very popular color that emerges as a result of the games or challenges described above, bundling may involve grouping together the specific cartridges needed to turn the popular color into purchasable packaging. On the , in step 4202, data is collected on the X most popular mixed colors determined in the games or challenges. X may be an integer greater than or equal to 1. In step 4202, the ingredients necessary to make the top

Alternatively, a plurality of three separate cartridge packages may be defined for a plurality of separate popular colors. Alternatively, a package may be created based on the first top colors appearing among the selected colors in the games or contests, while a separate package is created for the additional top colors appearing in the games or contests.

As noted above, while creating ingredient combination packaging is one practical application of the games described above, another practical application is setting actual manufacturing volumes to prioritize cartridge manufacturing unique which correspond to the ingredients determined in one or the other of Figures 41 and 42.

Additionally, the flowcharts in Figures 41 and 42 can be configured to work for specific regions of the world by relying on and isolating data collected in regions of the world. In addition, the flowcharts of Figures 41 and 42 can define the determination steps 4101 and 4201 to be carried out periodically or depending on the season. For example, a particular challenge may be performed just before a certain season or event (such as a particular holiday), and the end date of the challenge may automatically trigger determination steps 4001 and 4101, where determination is focused on the results of the challenge. In this way, the available supply of salable packaging for the above distribution arrangement will be available in a timely manner coinciding with the end of the challenge or the start of a particular season or event. For example, as represented by , when the challenge is completed and a screen is displayed showing the winners and top shades (see Figures 38 and 39), in this case a graphic can be displayed allowing a user to purchase the bundled packs of cartridges based on the challenge results. Additionally, to allow the manufacturing process time to begin manufacturing the packages according to the methods described above, there may be a predetermined delay (preferably 1 day or more) between the actual end of voting in the competition and the public display of the screen illustrated in .

The structural components for realizing the above-mentioned gaming concept are similar to the architecture shown in either Figure 14, 16, 17, 19 or 21. Thus, each user smartphone is connected to a cloud platform (made by one or more servers), and the selections made by a user during a game or design challenge are transmitted to the cloud platform. The cloud platform processes the collected information with processing circuits as defined above and generates the calibration commands to update the application software for each user or generates the recommendation for an individual user for the process illustrated in . Additionally, the cloud platform can directly connect to a plurality of manufacturing, filling and/or distribution facilities to send orders to control the distribution and packaging of cartridges based on process results in Figures 41 and 42. The manufacturing facility can receive updates directly to change the ingredients dispensed on a filling line, similar to the process described in US Publication No. 2020/0277181. Thus, changes to increased production and cartridge packaging can, if necessary, be carried out in a fully automated manner without human intervention.

Obviously, many modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that the invention may be practiced otherwise than as specifically described herein.

Claims (10)

A system including processing circuitry configured to execute a contest that includes:

• displaying to a user an image of a face of one of a plurality of models;
• receiving user inputs to adjust a color of a mixed cosmetic product to apply to the model's face;
• displaying the model with the adjusted color selected by the user;
• receiving the image of the model's face with the adjusted color as input from the user;
• displaying the user entry to a plurality of users and providing the plurality of users with an option to submit a vote on the user entry and the entries of other users and
• the output of a competition result based on an entry receiving the greatest number of votes.

System according to claim 1, in which the processing circuits are configured to:

• receive a self-taken image from a second user;
• carry out an analysis of the characteristics of the second user based on at least the image taken by himself in comparison with the entries in the competition;
• producing one or more colors of the mixed cosmetic product as a recommendation to the second user based on the analysis.

System according to claim 2, in which, during the analysis, the processing circuits are configured to:

• extracting a model from the plurality of models that includes features that match the analyzed features of the second user;
• determining contest entries in which one or more users define a color of a mixed cosmetic product to be applied to the face of the extracted model;
• determine the highest-voted entries matching the extracted pattern, and
• producing one or more colors of the mixed cosmetic product included in the highest-voted entries matching the extracted model as a recommendation to the second user.

A system according to claim 1, wherein user inputs for adjusting the color of the mixed cosmetic product are received on a displayed color adjustment interface. A system according to claim 4, wherein the adjusted color selected by the user corresponds to a color created with color ingredients which are used in a dispensing device to produce the mixed cosmetic product. The system of claim 5, wherein the displayed color adjustment interface is further configured to select a color for the dispensing device to be used in producing the mixed cosmetic product. The system of claim 1 further comprising displaying a link to purchase a mixed cosmetic product corresponding to the entry receiving the highest number of votes. The system of claim 1, wherein the processing circuitry is configured to display selectable areas of a face of the model that the user selects to adjust the color of a blended cosmetic product. A system according to claim 8, wherein the selectable areas include at least the lips, eyes and cheeks of the model. The system of claim 1, wherein the processing circuitry is configured to display a color used for a mixed cosmetic product for all entries currently displayed among entries submitted by the user and other users