JP2010218227A - Electronic album creation device, method, program, system, server, information processor, terminal equipment, and image pickup device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic album creation device which reduces the burden of inputting titles of each picture taken by a camera to form an electronic album. <P>SOLUTION: The electronic album creation device is provided with: a subject analyzing part for determining a person and object to be imaged from electronic data of a picture taken by an image pickup device, and for analyzing subject attributes including person attributes including the expressions and status of the determined person, object attributes including the object name of the object and a position relation between the person and the object; a title addition part for adding a title to each picture by inserting words corresponding to the analyzed subject attributes into a predetermined position of a preset title template; and an electronic album creation part for creating an electronic album from the electronic data of the picture with a title. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an electronic album creating apparatus, method, program, system, server, information processing apparatus, terminal device, and imaging apparatus, and more particularly to an electronic album creating apparatus that creates an electronic album from electronic data of a photograph taken by an imaging apparatus. And a method.

  In recent years, many digital cameras using solid-state imaging devices such as CCD (Charge Coupled Device) and CMOS (Complementary Metal Oxide Semiconductor) image sensors are on the market as imaging devices (cameras).

  Electronic data of a photograph taken with this digital camera is normally stored in a recording medium such as a CD (compact disc) or a network in an electronic album format. As described above, the electronic album on the recording medium or the network may satisfy only the purpose of browsing data or simply storing data. For this reason, in order to function as an official album, it is necessary to clearly specify a title (title) such as “when, where, what, and what kind of shooting” for each photo.

  However, since digital cameras have a large storage capacity, they can easily store a large number of images and can easily shoot hundreds or hundreds of photos. It is difficult to save a work with a title. And if you don't do this right after shooting, you'll forget where you shot.

  In this regard, Patent Document 1 discloses an information processing method in an electronic album system having data in an album format composed of a plurality of pages. In this method, an electronic image captured by a digital camera connected to or equipped with a GPS device and GPS information recorded corresponding to each electronic image are acquired, and the electronic image is pasted from a server device via a computer network. The mount data is acquired, and the electronic image is pasted to a predetermined point on the mount data based on the GPS information recorded corresponding to each electronic image. As a result, electronic images can be easily registered and classified in the electronic album.

  Patent Document 2 discloses an electronic album display method for displaying an image captured by a digital camera as an electronic album on a computer screen. In this method, the GPS data and time information recorded in each image data are read, the corresponding city name is obtained while referring to the database, the city names are sorted in the order of the distance from the preset starting point, and each Images belonging to city names are sorted in order of shooting time and displayed on the album viewer. According to this, based on the position information and time information recorded in the photographed image, the images captured in the album are classified by city name and organized on the album viewer according to the combination of the distance and time from any base point. It can be displayed.

JP 2002-329191 A JP 2006-120058 A

  As mentioned above, electronic albums are used, but usually only the data from the camera is posted on the network, and the title of each photo is written manually, Or it was preserve | saved with the regulation value. Also, rather than an album, the phrase simply stored on the network was correct, and there was a place that did not function as an electronic album.

  That is, the above-described electronic album has only a function of uploading and saving a photograph taken with a digital camera on a network as it is. Also, the title of each photo is untitled as a default value, or there are many manual inputs, and after a few days have passed since the photo was taken, it was forgotten where it was taken, and it was not possible to give a title. In addition, when inputting manually, it takes a lot of time if the number is large. If it remains as it is, it will be only a preservation of a photograph, and the countermeasure is desired. Patent documents 1 and 2 are not necessarily made in consideration of such a problem.

  An object of the present invention is to solve the above problems, reduce the difficulty of inputting the title of each photograph taken with a camera, and function as an electronic album creating apparatus and method. Is to provide.

  In order to achieve the above object, an electronic album creating apparatus according to the present invention discriminates a person and an object from an electronic data of a photograph taken by an imaging device, and includes a person attribute including a facial expression and a state of the determined person, A subject analysis unit that analyzes a subject attribute including an object name including an object name and a positional relationship between a person and an object, and a predetermined portion of a fixed phrase for a title in which words corresponding to the analyzed subject attribute are set in advance And a title adding unit for adding a title for each photo by inserting the electronic album into an image, and an electronic album creating unit for creating an electronic album from electronic data of a photo with a title added thereto.

  An electronic album creating method according to the present invention discriminates a person and an object of a subject from electronic data of a photograph taken by an imaging device, and includes an object attribute including a person attribute including a facial expression and a state of the determined person and an object name of the object Analyzing subject attributes including attributes and the positional relationship between a person and an object, and adding a title to each photo by inserting words corresponding to the analyzed subject attributes into a predetermined place in a fixed phrase for a subject An electronic album is created from electronic data of a photo with a title added.

  An electronic album creating program according to the present invention discriminates a person and an object of a subject from electronic data of a photograph taken by an imaging device on a computer, a person attribute including a facial expression and a state of the determined person, and an object name of the object Subject analysis processing for analyzing subject attributes including object attributes including the positional relationship between a person and an object, and inserting a phrase corresponding to the analyzed subject attributes into a predetermined portion of a fixed phrase for a title Thus, a title adding process for adding a title for each photo and an electronic album creating process for creating an electronic album from electronic data of a photo with a title added thereto are executed.

  According to the present invention, it is possible to reduce the difficulty of inputting the title of each photograph taken by the camera and to function as an electronic album.

1 is a schematic block diagram showing an overall configuration of an electronic album creation system according to a first embodiment of the present invention. It is a schematic block diagram which shows the internal structure of the electronic album server shown in FIG. It is a figure which shows an example of the content of reception data DB shown in FIG. It is a figure which shows an example of the content of member DB shown in FIG. It is a figure which shows an example of the content of object log | history DB shown in FIG. It is a figure which shows an example of the content of location DB shown in FIG. It is a figure which shows an example of the content of object DB shown in FIG. It is a figure which shows an example of the content of photograph DB shown in FIG. It is a figure which shows an example of the content of cover DB shown in FIG. It is a figure which shows an example of the content of personal identification DB shown in FIG. It is a figure which shows an example of the content of the facial expression DB shown in FIG. It is a figure which shows an example of the content of operation | movement DB shown in FIG. It is a schematic block diagram explaining the function of an electronic album server when the user of a user terminal is a new member. It is a schematic block diagram explaining the function of an electronic album server when the user of a user terminal is an existing member. It is a schematic block diagram explaining the function of an electronic album server in the case of monitoring for every GPS position at a preset fixed time. It is a figure which shows an example of the content of the notification of member registration. It is a figure which shows an example of the content (cover) of an electronic album. It is a figure which shows an example of the content (contents) of an electronic album. It is a figure which shows an example of the content of the album completion notification. It is a schematic flowchart explaining operation | movement of the electronic album production system shown in FIG. FIG. 21 is a schematic flowchart for explaining the operation of the electronic album creating system shown in FIG. 1 following FIG. 20. FIG. 22 is a schematic flowchart for explaining the operation of the electronic album creation system shown in FIG. 1 following FIG. 21. FIG. 23 is a schematic flowchart describing the operation of the electronic album creation system shown in FIG. 1 following FIG. 22. FIG. 24 is a schematic flowchart for explaining the operation of the electronic album creation system shown in FIG. 1 following FIG. 23. FIG. 25 is a schematic flowchart for explaining the operation of the electronic album creation system shown in FIG. 1 following FIG. 24. It is a schematic block diagram which shows the whole structure of the electronic album production apparatus which concerns on the 2nd Embodiment of this invention. It is a schematic block diagram which shows the whole structure of the portable terminal provided with the electronic album production apparatus which concerns on the 3rd Embodiment of this invention. It is a schematic block diagram which shows the whole structure of the imaging device provided with the electronic album production apparatus which concerns on the 4th Embodiment of this invention.

  Hereinafter, embodiments of an electronic album creating apparatus, method, program, system, server, information processing apparatus, terminal apparatus, and imaging apparatus according to the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 shows the overall configuration of an electronic album creation system according to the first embodiment of the present invention.

  The electronic album creation system shown in FIG. 1 has a user terminal 10, an electronic album creation server (electronic album creation device) 20, and a reception agency terminal 30, which are connected via a network 100. The network 100 can be applied in any form as long as it is communicably connectable between nodes via a communication line.

  The user terminal 10 is an information processing apparatus such as a personal computer (PC) and a mobile terminal used by a user who registers member information, logs into the electronic album creation server 20, and transmits and receives various notifications. It is assumed that data used when electronic data is transmitted from the user terminal 10 to the electronic album creation server 20 is taken by a digital camera with a GPS (Global Positioning System) function (position acquisition function).

  FIG. 2 shows the internal configuration of the electronic album creation server 20.

  The electronic album creation server 20 is configured by an information processing device (computer) such as a PC (Personal Computer) server or a dedicated server, for example, and a DB that stores predetermined data in a preset format as shown in FIG. (Database) 200 and a processing device 201 for processing the data of the DB 200 by preset program control. The DB 200 includes a member DB 202, a reception data DB 203, an object history DB 204, a place DB 205, an object DB 206, a photograph DB 207, a cover DB 208, an individual discrimination DB 209, an expression DB 210, and an action DB 211.

  3 to 12 show an example of the contents of these DBs 201 to 211.

  As shown in FIG. 3, the member DB 202 is composed of “Member No.”, “Mail Address”, “Password”, “Address”, “Name”, and “Telephone Number” fields. Store in association.

  As shown in FIG. 4, the reception data DB 203 includes “member No.”, “photo NO”, “GPS position”, “azimuth”, “shooting date / time”, “photo (image data)”, and “object name”. It consists of columns and stores the data in each column in association with each other.

  The object history DB 204 records position and object shape information at a preset time. If there is an object other than a person at the time of recording, the object DB 206 is collated, the object is reliably analyzed, and the history is recorded and stored as the object name. In the present embodiment, as shown in FIG. 5, it is composed of columns of “GPS position”, “azimuth”, “shape (image data)”, “date / time”, and “object name”. Store in association with each other.

  As shown in FIG. 6, the location DB 205 is composed of columns of “GPS position”, “azimuth”, “major category”, “medium category”, and “small category”, and stores the data in each column in association with each other. To do.

  The object DB 206 stores object names of various angles in association with shapes (images) as object attributes. In the present embodiment, as shown in FIG. 7, each column includes “object name” and “shape (image data)”, and the data in each column is stored in association with each other.

  As shown in FIG. 8, the photograph DB 207 is composed of “Member No.”, “Photo No.”, “Title”, and “Photo (Image Data)” columns, and stores the data in each column in association with each other. 1 photo DB 207a and a “large category”, “medium category”, “small category”, “shooting date / time”, and “object name” columns, and stores the data in each column in association with each other. It has a photo DB 207b and a third photo DB 207c that is composed of columns of “correction”, “cover”, “display name”, “mode”, and “operation”, and stores the data in each column in association with each other.

  As shown in FIG. 9, the cover DB 208 is composed of “Main Category” and “Cover (Picture or Photo)” fields, and stores data in each field in association with each other.

  As shown in FIG. 10, the individual discrimination DB 209 is composed of columns of “registrant member NO”, “batch NO”, “display name”, and “shooting period”, and stores the data in each column in association with each other. .

  The facial expression DB 210 stores various discrimination data in advance so that facial expressions such as “laughing” and “crying” can be automatically analyzed from the shape and position of the parts of the person's eyes, nose and mouth as human attributes. In this embodiment, as shown in FIG. 11, each column includes “expression (partial feature)” and “mode”, and data in each column is stored in association with each other.

  The action DB 211 stores various discrimination data in advance so that actions such as “piece” and “jump” can be analyzed from the shape and position of the gesture of the person's hand or foot as person attributes. As shown in FIG. 12, each column is composed of “pause” and “operation” columns, and the data in each column is stored in association with each other.

  FIGS. 13 to 15 illustrate functions of the electronic album creation server 20. FIG. 13 shows a function when the user of the user terminal 10 is a new member, FIG. 14 shows a function when the user of the user terminal 10 is an existing member, and FIG. 15 shows a case where monitoring is performed for each GPS position at a preset time. Indicates.

  The processing device 201 is an information processing device such as a server having computer components such as a CPU (Central Processing Unit) and a memory that holds a program executed by the CPU and processing data thereof. The functions of the processing device 201 described below are realized by executing a preset electronic album creation program.

  In the present embodiment, the processing device 201 receives member registration information (“email address”, “address”, “name”, “phone number”, etc.) including personal information from the user terminal 10 via the network 100. Then (FIG. 13: A1), the member registration information is stored in each column of the member DB 202. After the storage, the processing device 201 automatically creates data constituting the content of the “member registration notification” 221 in a preset format using the data stored in the member DB 202, and stores the data as “member registration registration”. “Notification” 221 is notified to the user terminal 10 that it has been transmitted or posted on the WEB (FIG. 13: A2). FIG. 16 shows an example of the content of “member registration notification” 221.

  When the user terminal 10 logs in (FIG. 13: A3, A7, FIG. 14: B1, B5), the processing device 201 checks the login ID and password against the member DB 202, and if they match, allows the use. After permitting the use by login, the processing apparatus 201 receives each data of “display name” and “shooting period” from the user terminal 10 and automatically assigns “batch NO” to these “display name”, Each data of “shooting period” and “batch NO” is stored in each column of the personal discrimination DB 209 in association with “registrant member NO” (FIG. 13: A4, FIG. 14: B2). The processing device 201 sends personal information including “Batch NO” of the registered member to the accepting trader terminal 30 (FIG. 13: A5, FIG. 14: B3). Thereby, the reception trader terminal 30 transports the predetermined batch to the user of the user terminal 10 (FIG. 13: A6, FIG. 14: B3).

  When the processing device 201 receives electronic data of a photograph taken from the user terminal 10, “member No.”, “photo NO”, “GPS position”, “azimuth”, “photographing date / time”, “photograph” in the reception data DB 203. (Image data) ”and“ object name ”are stored in the respective columns (FIG. 13: A8, FIG. 14: B6). After the storage, the processing device 201 analyzes the “photograph (image data)” in the reception data DB 203 according to a predetermined image analysis algorithm, and if the result of the analysis shows an “object” other than a person, the reception data The mutual position information (“GPS position”, “azimuth”) and “date and time” of the DB 203 and the object history DB 204 are compared, and the data in the “object name” column where the position information is the same and the “date and time” is the closest Is selected from the object history DB 204, and the selected data is stored in the "object name" column of the received data DB 203 (FIG. 13: A9, FIG. 14: B7).

  The processing device 201 further compares the positional information (“GPS position”, “azimuth”) between the reception data DB 203 and the location DB 205, and the “major category”, “medium category”, “small category” in which the location information matches. ”Column is extracted from the location DB 205, and the extracted data is integrated with the“ shooting date ”and“ object name ”column data, and stored in the second photo DB 207 b of the photo DB 207 (see FIG. 13: A10, FIG. 14: B8).

  The processing device 201 further analyzes the image data in the “photograph (image data)” column of the received data DB 203 according to a predetermined analysis algorithm, and automatically analyzes “batch NO” when “batch” exists in the subject person. (FIG. 13: A11, FIG. 14: B9), the analyzed “batch NO” data is compared with the “batch NO” data in the personal identification DB 209. If the date and time indicated by the data in the “shooting date / time” column of the DB 203 is within the period indicated by the period data in the “shooting time” column corresponding to the matched “batch NO” column, it corresponds to the matched “batch NO”. The data in the “display name” column is extracted (FIG. 13: A12, FIG. 14: B10).

  At the same time, the processing device 201 automatically analyzes the “expression” and “pose” of the person from the image data in the “photograph (image data)” column of the reception data DB 203 according to a predetermined image analysis algorithm, Each piece of “pose” data is compared with the data in the “state” column of the facial expression DB 210 and the data in the “pose” column of the action DB 211, and the “state” and “motion” of the person are automatically analyzed. Are stored in each column of the third photo DB 207c of the photo DB 207 together with the data of the “display name” column extracted above (FIG. 13: A13, FIG. 14: B11).

  The processing device 201 selects “major category”, “medium category”, “small category”, “object” depending on whether or not there is data in the “object name”, “mode”, and “motion” columns of the photo DB 207. The “title” data is automatically added from the data in the “name”, “mode”, and “motion” columns by the method of several patterns determined by the position of the object name as seen from the subject (FIG. 13: A14, FIG. 14: B12), the added data is stored in the “title” column of the photo DB 207. After the storage, the processing apparatus 201 notifies the user terminal 10 that the data in each column of the photograph DB 207 has been transmitted or posted on the WEB for content confirmation (FIG. 13: A15, FIG. 14: B13). In addition, when the processing device 201 receives data in each column of the photograph DB 207 from the user terminal 10 and there is an input of correction data in the “correction” column (FIG. 13: A16, FIG. 14: B14). The data in the “title” column is rewritten using the corrected data.

  The processing apparatus 201 collates the “major section” of the photograph D207 with the cover DB 208 (FIG. 10), adds the cover, selects the matching “cover”, and stores it in the photograph DB 207 (FIG. 13: A17, FIG. 14: B15). After sorting the data, the processing device 201 adds a “cover” for each major category to create an electronic album. 17 and 18 show an example of the contents of an electronic album.

  After creating the electronic album, the processing apparatus 201 automatically creates an “album completion notification” 222 and notifies the user terminal 10 that it has been transmitted or posted on the WEB (FIG. 13: A18, FIG. 14: B13). FIG. 19 shows an example of the contents of “album completion notification” 222.

  The processing device 201 has a shape corresponding to the image data in the “photograph (image data)” column of the reception data DB 203 for each GPS position (for example, AA1) at a preset time (for example, t1 to t4). The data is stored in the “shape (image data)” column of the object history DB 204 (FIG. 15: C1). The storage device 201 analyzes the image data in the “shape (image data)” column according to a predetermined image analysis algorithm (FIG. 15: C2). If there is an object other than a person as a result of the analysis, the processing device 201 reads the image data in the “shape (image data)” column of the object DB 206 and compares the image data with the analyzed shape data. (FIG. 15: C3), if they match, the data in the “object name” column corresponding to the “shape (image data)” column is extracted from the object DB 206, and the data is stored in the “shape (image data)” column. Together with the data, it is automatically stored in the object history DB 204 in association with the position information (“GPS position”, “azimuth”) and each data in the “date and time” column (FIG. 15: C4).

  When using the service for the first time, the user terminal 10 transmits the member registration data to the electronic album creation server 20 via the network 100, and after registering as a new member, the electronic album creation server 20 sends "member registration". ”Is received. With this reception, it is possible to log in to the electronic album creation server 20.

  After logging in, the user terminal 10 inputs information of “display name” and “shooting period” and requests to add a personal name to the title. With these registrations, the user terminal 10 receives a shooting batch from the reception agency terminal 30. After taking a picture, the user terminal 10 logs in again to the electronic album server 20 and transmits electronic data taken with a digital camera with a GPS function. After the transmission, the user terminal 10 receives the photo DB 207 from the electronic album server 20, confirms the title content, corrects any correction, and transmits the photo DB 207 to the electronic album again. When the electronic album is completed, the user terminal 10 receives an “album completion notification” 222 from the electronic album creation server 20.

  The receiving trader terminal 30 is an information processing device such as a personal computer or a portable terminal used by a user, receives personal information of members from the electronic album creation server 20, and transports the batch based on the personal information. When receiving the contents of the personal identification DB 209 and the member DB from the electronic album creation server 20, the acceptor terminal 30 distributes the batch to the user terminal 10.

  Next, the operation of the present embodiment will be described in detail with reference to FIGS. A program (electronic album creation program) based on the processing flowchart on the electronic album creation server 20 side shown in FIGS. 20 to 25 is executed by the processing device 201.

  First, the electronic album creation server 20 records and manages the position information, the shape of the object (image data), and the like in the object history DB 204 for each GPS position at a preset time by the processing device 201 as described above. (FIG. 20: S201, S202).

  Each time the data is stored, the electronic album creation server 20 automatically analyzes the image data in the “shape (image data)” column of the object history DB 204, and if an object other than a person exists, the “shape (image data)” of the object DB 206. ) "Column image data is read (FIG. 20: S204), and it is compared with the image data in the" shape (image data) "column of the object history DB 204. Data is extracted from the object DB 206 (FIG. 20: S205). The electronic album creation server 20 stores the extracted “object name” field data in the “object name” field of the object history DB 204 (FIG. 20: S206). On the other hand, if the image data in the “shape (image data)” column does not match, nothing is stored in the corresponding “object name” column.

  Next, since the user terminal 10 needs to become a member in order to create an electronic album, if the user terminal 10 is not a member, the user terminal 10 electronically registers via the Internet 100 for new member registration (FIG. 21: S101). The member registration information is transmitted to the album creation server 20 (FIG. 21: S102).

  The electronic album creation server 20 receives the member registration information by the processing device 201 (FIG. 21: S207), and at the same time, automatically numbers each data of “member No.” and “password” (FIG. 21: S208), The information is stored in the “member No.” and “password” fields and simultaneously in the member DB 202 (FIG. 21: S209). After the storage, the electronic album creation server 20 automatically creates the contents of the “member registration notification” 221 by adding “member No.” and “password” (FIG. 21: S210), and sends the mail address ( For example, it is transmitted to HANAKO @ JP) or notified that it has been posted on the WEB (FIG. 21: S211).

  The user terminal 10 receives the “member registration notification” 221 and recognizes that the member has been registered (FIG. 21: S103). After the registration, the user terminal 10 logs in the electronic album creation server 20 (WEB) on the network 100 by inputting the designated member No. and password data by user operation (FIG. 22: S104). . After logging in, the electronic album creation server 20 reads the data in each column of the member DB 202 by the processing device 201 (FIG. 22: S212), and the data in the “member No.” and “password” columns and the user terminal 10 The entered member number and password data are collated (FIG. 22: S213). If they match (YES), use is permitted (FIG. 22: S214).

  The user terminal 10 may display “person photographed in the photograph” as a nickname or personal name in the title after the login, and display it in the photograph of each person. A name (for example, “Hanako”, “Mii-chan”) and a shooting period for taking the picture are input (FIG. 22: S105).

  When the electronic album creating server 20 receives the display name and shooting period data by the processing device 201 (FIG. 22: S215), after the data registration, only the number of people who have registered “batch NO (eg, B001, B002)”. Numbers are assigned automatically one by one, stored in the “Batch NO” field of the personal judgment DB 209, the nickname or name is stored in the “Display Name” field, and the shooting period data is stored in the “Shooting Period” field. (FIG. 22: S216).

  After the storage, the processing device 201 collates the “registrant member NO (for example,“ 001A ”)” of the record of the newly stored personal discrimination DB 209 with the “member No. (for example,“ 001A ”)” of the member DB ( 22: S217), the personal information such as the matched address and the newly registered personal information in the personal identification DB 209 are transmitted to the acceptor terminal 30 (FIG. 22: S218).

  The receiving trader terminal 30 receives the personal information and the personal identification data (FIG. 22: S301), and the batch of “Batch NO” that is automatically numbered is stored in the user terminal 10 described in the personal information (for example, member NO. Is 001A and the name is Hanako) by means of transportation or the like (FIG. 22: S302).

  The user terminal 10 receives the batch sent from the reception contractor terminal 30 by transportation (FIG. 22: S106). As a result, only the registered shooting period is shot with a batch. Individual discrimination is possible only when shooting with a batch attached.

  Next, in order to transmit data after taking a picture, the user terminal 10 inputs “member No.” and “password” by user operation and logs in again to the electronic album creation server 20 (WEB) (FIG. 23: S107), the electronic data of the digital camera is transmitted to the electronic album creation server 20 (FIG. 23: S108).

  When the electronic album creating server 20 receives the “member No.” and “password” by login from the user terminal 10 by the processing device 201 (FIG. 23: S219), it reads the member DB 202 (FIG. 23: S221). “Member No” and “Password” are checked (FIG. 23: S220). If they match (YES), use is permitted (FIG. 23: S221).

  Also, the electronic album creation server 20 receives the electronic data from the user terminal 10 by the processing device 201 (FIG. 23: S222), and at the same time, automatically assigns the data of “Photo NO” (FIG. 23: S223). The data is stored in the “photo NO” column and simultaneously in each column of the received data DB 203 (FIG. 23: S224).

  After the storage, the electronic album creation server 20 automatically analyzes the “photograph (image data)” in the reception data DB 203 by the processing device 201, and when an “object” other than a person exists (FIG. 23: S225, YES). The “GPS position”, “azimuth”, and “date / time” in the object history DB 204 are read (FIG. 23: S226), and compared with the “GPS position”, “azimuth”, and “shooting date / time” in the reception data DB 203 (FIG. 23). : S227), “object name (for example, deer, bronze image)” in the object history DB 204 with the closest approximation of “shooting date” and “date” among the matched data is selected (FIG. 23: S228). After the selection, the electronic album creation server 20 stores it in the “object name” field of the reception data DB 204 (FIG. 23: S229).

  Furthermore, the electronic album creation server 20 reads the data in the “GPS position” and “azimuth” columns of the location DB 205 by the processing device 201 (FIG. 23: S230), and the “GPS position” and “azimuth” in the reception data DB 203. The data in the column is checked (FIG. 23: S231), the data in the “major category”, “medium category”, and “minor category” columns corresponding to the matched data, the “member No.”, “photo No.” in the reception data DB 203. ”,“ Shooting Date / Time ”,“ Photo (Image Data) ”, and“ Object Name ”only data are extracted (FIG. 24: S232) and stored in each column of the photo DB 207 (FIG. 24: S233).

  Further, the electronic album creation server 20 automatically analyzes the stored image data in the “photograph (image data)” column by the processing device 201 (FIG. 24: S234) and distributes it to the subject of the camera by the receptionist terminal 30. Only when the image is taken with a batch (FIG. 24: S235, YES), the “batch NO” described in the batch is analyzed (FIG. 24: S236), and the “batch NO” is automatically acquired (FIG. 24: S237). Also, the electronic album creation server 20 determines the acquired “batch NO” as a personal identification if the “photographing date / time” in the photo DB 207 is a period between the “photographing date / time” in the personal identification DB 209 (FIG. 24: S238, YES). Compared with “batch NO” in the DB 209 (FIG. 24: S239), the matched “display name” is extracted (FIG. 24: S240). After the extraction, the electronic album creation server 20 stores it in the “display name” field of the photo DB 207 (FIG. 24: S241).

  Again, the electronic album creation server 20 automatically analyzes the image data in the “photo (image data)” column by the processing device 201 (FIG. 24: S242), and there is a person who attaches a batch to the subject of the camera. Then, the face and pose of the person is automatically analyzed (FIG. 24: S243), and the “expression” in the expression DB 210 or the pose of the person is compared with the “pose” in the action DB 211 (FIG. 24: S244). “State” and “motion” are extracted (FIG. 24: S245). After the extraction, the electronic album creation server 20 stores the “state” column and the “operation” column of the photo DB 207, respectively (FIG. 24: S246). If there is no matching “state” and “operation”, nothing is stored.

  Next, the electronic album creation server 20 performs the following operation according to various conditions such as whether data is stored in the “object name” of the photograph DB 207 by the processing device 201 (FIG. 24: S247). In the "" column.

  First, when data is stored in the “object name” field of the photo DB 207 (FIG. 24: S247, YES), the electronic album creation server 20 performs the following processing. That is, the electronic album creation server 20 automatically determines the position of the object corresponding to the data in the “object name” column as viewed from the person who is the subject of the photograph DB 208 by the processing device 201 in the following three patterns. Analysis is performed (FIG. 24: S248), and a title is automatically added to each record, and the data is stored in the “title” column of the photograph DB 207 (FIG. 24: S249 to S255).

  For example, when the position of the object corresponding to the data in the “object name” column is behind the subject (FIG. 24: S249), the processing of case 1-1 is performed (FIG. 24: S250). In this process, if the stored "display name" is blank, the fixed phrase in the title column is [location: "major category" "medium category" "sub category" and "object name" taken in the background] And In addition, if the stored “display name” is one person, the fixed text in the title column is [Location: “major category” “medium category” “minor category” and “display name” is “object name”. [Photographed with “state” and “motion” on the back]. In addition, if there are two "Display Names" stored, the fixed text in the title column is [Location: "Major Category" "Medium Category" "Sub Category" and "Display Name" and "Display Name" “Shooting” with “state” and “motion” with “object name” in the background. If “situation” and “motion” are blank, the “situation” and “motion” parts are not added to the title.

  Further, when the position of the object corresponding to the data in the “object name” field is almost the same size as the subject at the left and right, front and back positions of the subject (FIG. 24: S251), this processing is performed (FIG. 24: S252). In this process, if the stored "display name" is blank, the fixed phrase in the title column is [Location: "Large Category", "Medium Category" and "Small Category" as "Object Name"] . Also, if the stored “display name” is one person, the fixed text in the title column is [Location: “major category” “medium category” “minor category” and “display name” is “object name”. “Scene” and “Operation” to shoot]. Furthermore, if the stored “display name” is two, the data in the title column is [location: “major category” “medium category” “minor category” and “display name” and “display name” are “ “Object name”, “state”, “motion” and “shoot”. If “situation” and “motion” are blank, the “situation” and “motion” parts are not added to the title.

  Furthermore, when the position of the object corresponding to the data in the “object name” field is a position other than the above cases 1-1 and 1-2 or when no person is present in the subject (FIG. 24: S253), the case 1-3 Processing is performed (FIG. 24: S254). In this process, the fixed phrase in the title column is [Location: “Large Category” “Medium Category” “Small Category” “Object Name”].

  On the other hand, if no data is stored in the “object name” column of the photograph DB 207 (FIG. 9) (FIG. 24: S247, NO), the processing of case 2 is performed (FIG. 24: S257). In Case 2, the electronic album creation server 20 uses the processing device 201 to automatically add a title to the photo DB 208 data, one record at a time, and store it in the “title” column of the photo DB 208 by the following process.

  First, when the stored “display name” is blank, the data in the title column is set to [location: “large category”, “medium category” and “small category”]. If there is only one stored “display name”, the standard text in the title column is [Location: “major category” “medium category” “minor category” “display name” “mode” “motion” "Shoot". In addition, if there are two “Display Names” stored, the boilerplate text in the title column is [Location: “Major Category” “Medium Category” “Small Category” with “Display Name” and “Display Name”. “Scene” and “Operation” to shoot]. If “situation” and “motion” are blank, the “situation” and “motion” parts are not added to the title.

  Next, the electronic album creation server 20 notifies the processing device 201 that the data of the photo DB 207 has been transmitted to the mail address (for example, HANAKO @ JP) of the user terminal 10 or posted on the WEB (FIG. 25). : S258).

  When the user terminal 10 receives the data (FIG. 25: S109), the user terminal 10 checks the content to see if the “title” matches “photograph (image data)” (FIG. 25: S110). If correction is desired (FIG. 25: S111, YES), the correct title is entered in the “correction” column by the user operation (FIG. 25: S112). For example, this time, assume that the photograph NO1 has changed. After the correction, the user terminal 10 transmits the corrected photo DB 207 to the electronic album creation server 20 (FIG. 25: S113).

  The electronic album creation server 20 receives the corrected photo DB 207 by the processing device 201 (FIG. 25: S259), and when there is an input in the “correction” column (FIG. 25: S260, YES), The data is overwritten in the “title” column and the data is rewritten (FIG. 25: S261). If there is no correction, the process proceeds to S262.

  Next, the electronic album creation server 20 uses the processing device 201 to set the “major section (for example, Miyajima)” in the cover DB 208 and the “major section (for example, Miyajima)” in the cover DB 208 for each “major section” in the photograph DB 207. (FIG. 25: S263), the matched “cover (for example, picture or photo)” is extracted (FIG. 25: S264), and stored in the “cover” column of the photo DB 207 (FIG. 25: S265). After storage, the photograph DB 207 is sorted in the order of the first key (major section) and the second key (shooting date and time) (FIG. 25: S266).

  After sorting, the electronic album creation server 20 adds a “cover” for each “major category” in the photo DB 207 by the processing device 201 to automatically create an electronic album (FIG. 25: S267). An “album completion notification” 222 is automatically created from the member DB 202 (FIG. 25: S268), and notification is given to the web address of the user terminal 10 (for example, HANAKO @ JP) (FIG. 25: S269).

  Upon receiving the “album completion notification” 222 (FIG. 25: S114), the user terminal 10 knows that the album has been completed and can log in to the WEB and browse the electronic album. As a result, if necessary, it is possible to easily make an order for writing on a CD or a photo printing order on the WEB. Also, since it is not media management at hand, easy management can be realized, and it can be used in any environment where the Internet is connected anytime and anywhere.

  The above operations are summarized as follows.

  The user terminal 10 registers as a member in advance. When using the service, the user logs in to the electronic album creation server 20 with the specified user ID and password, and enters the personal name and shooting period displayed on the photo. The receiving trader terminal 30 receives the batch NO and personal information from the electronic album creation server 20 and transports the batch in which the number is described to the user terminal 10. Furthermore, the user terminal 10 transmits a photograph taken by a digital camera equipped with a GPS function.

  The electronic album creation server 20 stores the object name in the reception data DB 203, and automatically acquires the object name from the object history DB 204 based on the shape of the object, the shooting time, the GPS position, and the direction when an object other than a person exists. In addition, the region name or location for each of the large, medium, and small categories is also selected from the GPS position and direction of the location DB 205. When an object exists, the arrangement of the object viewed from the subject is analyzed, and the title of each photograph is automatically acquired according to the position of the object.

  Even when a person with a batch is photographed, the batch number of the photograph is analyzed, and the display name can be automatically acquired, so it is added to the title. These pieces of information are collectively stored in the photo DB 207, and the user terminal 10 confirms the content of the title.

  The user terminal 10 also has a means for indicating in the correction column if there is any correction in the contents and transmitting it again to the electronic album creation server 20. On the electronic album creation server 20, the data is rearranged and the cover is added to the data from the cover DB 208 in the major division.

  Through the above operation, an electronic album can be automatically created.

  That is, in the present embodiment, when using an electronic album, a user ID, a password, etc. are registered in advance when using the electronic album creation server. After logging in, “display name” and “shooting period” are registered, and the shot electronic data is transmitted to the WEB. The receiving trader terminal receives the above information from the server, issues a designated batch, and transports it to the user terminal. The digital camera includes a GPS function position recording device and the like, which enables automatic analysis of the object on the server from the location and the shape of the object in the photograph. Furthermore, if there is a person with a batch attached to the subject, it is possible to read the "display name" from the batch and read the person's appearance from the facial expression and action of the person, so the object name and shooting location for each photo The title can be automatically added using the display name, facial expression, and appearance.

  An album cover is automatically selected for each major category, and an electronic album is automatically created based on these data.

  After the creation of the electronic album, it offers a variety of uses that can be used as abundant services such as writing to CDs and developing photos at the request of users.

  Next, the effect of this embodiment will be described.

  As described above, conventional electronic albums only have the function of uploading and saving photos taken with a digital camera as they are on the NET, and whether the title of each photo remains unspecified or not manually entered. Many people have forgotten where they were taken after a few days, and it is difficult to assign a title. There was a problem such as becoming only preservation of.

  On the other hand, in this embodiment, the above problems are solved, and the following effects can be obtained.

  (1) Since a shooting position can be recognized by adding a position information (GPS) function to a digital camera, a photo title can be automatically assigned.

  (2) It is possible to identify individuals by automatically analyzing objects in the photo or by shooting with individual batches, and it is possible to automatically analyze the facial expressions and movements of people. As well as more detailed titles.

  (3) It is possible to automatically create an album on the NET that can be stored on a medium rather than simply storing data.

  (4) Since the album is stored as electronic data, it can be stored on a medium and a photo development request can be requested from the NET according to the user's request, and various services can be provided.

  (5) Even if you forget the outline of where the photo was taken several days after it was taken or if you took a lot of photos, you can automatically get a title for each photo. This saves time and makes it possible to create a more memorable album.

  In this embodiment, a digital camera having a GPS function is used. However, since only position information can be acquired, it is possible to sort and store data by sorting by location. . However, the title of one photo cannot be added automatically by the function of the digital camera. The specified manufacturer name will be followed by a serial number.

  In this embodiment, the GPS function of the camera can be used to automatically create a title based on the acquired position data, and the photograph taken by a friend or the like by posting map information using the GPS position Since it can be explained when it is desired to recommend a question or a shooting spot, it is also possible for a friend or the like to take a picture at the same place or display it as map information.

  Also, since it is an electronic album, it is possible to select and add music while browsing to make a full-fledged album.

  In the present embodiment, since an electronic album can be automatically created simply by sending a batch of people (subjects) with a batch and showing the batch, and transmitting the video from the digital camera, the electronic album currently operated The site can also be launched as a new business with membership.

In the present embodiment, the case where “batch” is used as an attachment for personal identification has been described. However, the present invention is not limited to this, and an object shown in a photograph, whether it is an IC chip or a QR code. Anything can be used as long as it can be automatically recognized and personally identified.
In addition, other services such as media writing, development, and mail service can be provided. Even if there are no landmarks, detailed map information can be posted by the GPS position function, so that it can be posted on the WEB as guidance for shooting spots, and it is thought that introduction of sightseeing spots will lead to activation of the town.

(Second Embodiment)
FIG. 26 shows an electronic album creating apparatus according to the second embodiment of the present invention.

  An electronic album creation apparatus 21 shown in FIG. 26 includes a DB 200 and a processing apparatus 201 that are the same as the electronic album creation server of the first embodiment. The processing apparatus 201 includes a subject analysis unit 221 and a title addition unit 222. And an electronic album creation unit 223.

  The subject analysis unit 221 executes processing corresponding to, for example, the above-described S201 to S246 (FIGS. 20 to 24), and the subject person and the object are detected from the electronic data of the photograph taken by the imaging device (not shown). It discriminates, and analyzes a subject attribute including a person attribute including the facial expression and state of the determined person, an object attribute including the object name of the object, and a positional relationship between the person and the object.

  The title adding unit 222 executes processing corresponding to, for example, the above-described S247 to S257 (FIG. 24), and inserts a phrase representing the analyzed subject attribute into a predetermined portion of a preset fixed phrase for the title. Add a title for each photo.

  The electronic album creation unit 223 executes, for example, the above-described processing of S258 to S269 (FIG. 25), and creates an electronic album from electronic data of a photo with a title added.

  In this configuration, when the subject analysis unit 221 includes a person with a personal identification wearing item (for example, the above-described badge) registered in advance as a subject person, the person's display name from the wearing item is displayed as a person attribute. The title adding unit 222 may add a title for each photo by inserting the display name of the analyzed person into a predetermined position of the fixed phrase for the title.

  Further, the electronic data includes position information of the imaging device, the subject analysis unit 221 analyzes the shooting location from the position information as the subject attribute, and the title adding unit 222 uses a word / phrase indicating the analyzed shooting location as a standard for the title The title may be added to each photo by inserting it at a predetermined location in the sentence, and the electronic album creating unit 223 may extract the cover of the electronic album from the cover data set in advance according to the analyzed shooting location. .

  The subject analysis unit 221 may record electronic data of photographs taken at the same shooting location at a preset time, and analyze the subject object from the history.

  Therefore, this embodiment can obtain the same effects as the first embodiment, and can be used not only in the form of a server on the network but also in the form of a stand-alone PC or the like. .

(Third embodiment)
FIG. 27 shows a terminal device provided with an electronic album creating apparatus according to the third embodiment of the present invention.

  A terminal device 400 including the imaging device 401 and the display device 402 shown in FIG. 27 is configured by a mobile terminal such as a mobile phone, for example, and has the same electronic functions as those in the second embodiment in addition to a call, mail, Internet connection function, and the like. The album creation device 21 (DB 200, processing device 201 (subject analysis unit 221, title addition unit 222, and electronic album creation unit 223)) is installed.

  Therefore, in this embodiment, the same effects as the first embodiment can be obtained, and all processing is performed on the terminal device side without using an external device such as a server. There are also advantages such as further improvement in convenience.

(Fourth embodiment)
FIG. 28 shows an imaging apparatus provided with an electronic album creation apparatus according to the fourth embodiment of the present invention.

  An imaging apparatus 400 including an imaging unit 501 and a display unit 502 illustrated in FIG. 28 is configured by, for example, a digital camera, and has an imaging function and the like, as well as the electronic album creation apparatus 21 (DB 200, processing apparatus) similar to the second embodiment. 201 (subject analysis unit 221, title addition unit 222, and electronic album creation unit 223).

  Therefore, the present embodiment can obtain the same effects as the first embodiment and performs all processing on the imaging apparatus side without using an external device such as a server. There are also advantages such as further improvement in convenience.

  Note that the hardware and software configurations of the electronic album creation device according to each of the above embodiments are not particularly limited, and any electronic device can be used as long as the functions of the DB 200 and the processing device 201 described above can be realized. Can be applied. For example, the circuit may be configured independently for each function, or may be configured by integrating a plurality of functions into a single circuit and integrated. Alternatively, all functions may be realized mainly by software processing.

  Further, when realizing at least a part of the functions of the electronic album creating apparatus using a program code, the program code and a recording medium for recording the program code are included in the category of the present invention. In this case, when the above functions are realized in cooperation with other software such as an operating system, those program codes are also included.

  Although the present invention has been described with reference to the exemplary embodiments and examples, the present invention is not limited to the above exemplary embodiments and examples. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

  As described above, the present invention is an application of an electronic album creating apparatus, method, program, system, server, information processing apparatus, terminal apparatus, and imaging apparatus that creates an electronic album from electronic data of a photograph taken by a camera. Is available.

DESCRIPTION OF SYMBOLS 10 User terminal 20 Electronic album creation server 21 Electronic album creation apparatus 30 Reception supplier terminal 100 Network 200 DB (database)
201 processing unit 202 member DB
203 Reception data DB
204 Object history DB
205 Location DB
206 Object DB
207 Photo DB
208 Cover DB
209 Personal identification DB
210 Facial expression DB
211 Operation DB
221 Subject analysis unit 222 Title addition unit 223 Electronic album creation unit 300 Network 400 Terminal device 500 Imaging device

Claims (17)

The person and object of the subject are discriminated from the electronic data of the photograph taken by the imaging device, the human attribute including the facial expression and appearance of the discriminated person, the object attribute including the object name of the object, and the positional relationship between the person and the object A subject analysis unit that analyzes subject attributes including
A title adding unit for adding a title for each photograph by inserting a word corresponding to the analyzed subject attribute at a predetermined position of a preset subject sentence;
An electronic album creating apparatus, comprising: an electronic album creating unit that creates an electronic album from electronic data of a photo with a title added. The subject analysis unit analyzes the display name of the person from the attachment as the person attribute when a person with a personal identification attachment attached to the person of the subject is included,
The electronic album creating apparatus according to claim 1, wherein the title adding unit adds a title for each photograph by inserting a display name of the analyzed person into a predetermined position of the fixed phrase for the title. The electronic data includes position information of the imaging device,
The subject analysis unit analyzes the shooting location from the position information as the subject attribute,
The title adding unit adds a title for each photo by inserting a word representing the analyzed shooting location into a predetermined location of the fixed phrase for the title,
The electronic album creating apparatus according to claim 1, wherein the electronic album creating unit extracts a cover of the electronic album from cover data set in advance according to the analyzed shooting location.   4. The subject analysis unit according to claim 1, wherein the subject analysis unit records electronic data of photographs taken at the same photographing location at a preset time and analyzes an object of the subject from the history. The electronic album creation device described in 1. The person and the object of the subject are discriminated from the electronic data of the photograph taken by the imaging device, the human attribute including the facial expression and appearance of the discriminated person, the object attribute including the object name of the object, and the positional relationship between the person and the object Analyzing subject attributes including
Add a title for each photo by inserting a phrase corresponding to the analyzed subject attribute into a predetermined part of a preset subject sentence,
An electronic album creation method comprising creating an electronic album from electronic data of a photo with a title added. Further, when the person of the subject includes a person with a pre-registered personal identification attachment, the person attribute is analyzed from the attachment as the person attribute,
6. The electronic album creating method according to claim 5, wherein a title is added to each photograph by inserting the display name of the analyzed person into a predetermined portion of the fixed phrase for the title. The electronic data includes position information of the imaging device,
Further, as the subject attribute, the shooting location is analyzed from the position information,
A title is added to each photo by inserting a phrase representing the analyzed shooting location into a predetermined portion of the fixed phrase for the title,
7. The electronic album creating method according to claim 5, wherein a cover of the electronic album is extracted from cover data set in advance according to the analyzed shooting location.   Furthermore, the electronic data of the photograph image | photographed at the same imaging | photography place at the preset time are recorded, The object of a to-be-photographed object is analyzed from the log | history, The electronic in any one of Claim 5 to 7 characterized by the above-mentioned. How to create an album. On the computer,
The person and the object of the subject are discriminated from the electronic data of the photograph taken by the imaging device, the human attribute including the facial expression and appearance of the discriminated person, the object attribute including the object name of the object, and the positional relationship between the person and the object Subject analysis processing for analyzing subject attributes including
A title addition process for adding a title for each photo by inserting a phrase corresponding to the analyzed subject attribute into a predetermined portion of a preset subject sentence;
An electronic album creation program for executing an electronic album creation process for creating an electronic album from electronic data of a photo with a title added. When the subject analysis process includes a person with a personal identification wearing object registered in advance in the person of the subject, the display name of the person is analyzed from the wearing object as the person attribute,
10. The electronic album creating program according to claim 9, wherein the title adding process adds a title for each photograph by inserting the display name of the analyzed person into a predetermined position of the fixed phrase for the title. The electronic data includes position information of the imaging device,
The subject analysis process analyzes the shooting location from the position information as the subject attribute,
The title addition process adds a title for each photo by inserting a word representing the analyzed shooting location into a predetermined location of the fixed phrase for the title,
11. The electronic album creating program according to claim 9, wherein the electronic album creating process extracts a cover of the electronic album from cover data set in advance according to the analyzed shooting location.   12. The subject analysis process according to claim 9, wherein electronic data of photographs taken at the same photographing location at a preset time is recorded, and an object of the subject is analyzed from the history. The electronic album creation program described in. A server functioning as the electronic album creating apparatus according to any one of claims 1 to 4;
An electronic album creating system comprising: a terminal device that transmits electronic data of a photograph taken by an imaging device to the server.   5. A server that functions as the electronic album creating apparatus according to claim 1.   An information processing apparatus that functions as the electronic album creating apparatus according to claim 1. An electronic album creating apparatus according to any one of claims 1 to 4,
A terminal device comprising an imaging device for taking a photograph.   An imaging apparatus comprising the electronic album creating apparatus according to claim 1.

Images