Nothing Special   »   [go: up one dir, main page]

CN111291285A - Image annotation method, device and computer-readable storage medium - Google Patents

Image annotation method, device and computer-readable storage medium Download PDF

Info

Publication number
CN111291285A
CN111291285A CN201811506514.9A CN201811506514A CN111291285A CN 111291285 A CN111291285 A CN 111291285A CN 201811506514 A CN201811506514 A CN 201811506514A CN 111291285 A CN111291285 A CN 111291285A
Authority
CN
China
Prior art keywords
image
web page
annotation
position information
label
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811506514.9A
Other languages
Chinese (zh)
Inventor
边文星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN201811506514.9A priority Critical patent/CN111291285A/en
Publication of CN111291285A publication Critical patent/CN111291285A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention discloses an image annotation method, an image annotation device and a computer readable storage medium. The image annotation method comprises the following steps: for a WEB page opened based on a browser, acquiring position information of at least one label on the image, wherein the WEB page comprises the image, and the image is displayed on the WEB page in an original size; storing the location information of the at least one annotation; and when the WEB page is opened again based on the browser, acquiring the current size of the image, the original size of the image and the position information of the at least one label, recalculating the current position information of the at least one label, and displaying the at least one label on the WEB page according to the recalculated current position information of the at least one label. The image annotation method ensures the adaptation of the echoed annotation and the size of the current image by recalculating the annotation position information, thereby ensuring the effectiveness of the annotation.

Description

Image annotation method, device and computer-readable storage medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to an image annotation method, an image annotation device, and a computer-readable storage medium.
Background
And (3) marking the images in the WEB page, namely adding external marks such as points, lines, boxes and the like on various images contained in the WEB page. The label on the WEB image can be a one-time label, that is, the label disappears when the WEB page is opened next time, or can be a label capable of being redisplayed, that is, the label is still displayed when the WEB page is opened next time. For the annotation that can be reproduced, we hope to achieve the following effects: when a WEB page is opened each time, if the sizes of the WEB page and the image change, the annotations should change accordingly. However, it is a problem worth studying how to realize adaptive change of the position and shape of the mark.
Disclosure of Invention
In view of the above, the present invention is directed to an image annotation method, an image annotation apparatus, and a computer-readable storage medium for processing annotation of an image in a WEB page, which can solve the above problems.
According to an aspect of the present invention, there is provided an image annotation method, including:
for a WEB page opened based on a browser, acquiring position information of at least one label on the image, wherein the WEB page comprises the image, and the image is displayed on the WEB page in an original size;
storing the location information of the at least one annotation; and
and when the WEB page is opened again based on the browser, acquiring the current size of the image, the original size of the image and the position information of the at least one label, recalculating the current position information of the at least one label, and displaying the at least one label on the WEB page according to the recalculated current position information of the at least one label.
Optionally, the server stores the location information of the at least one label.
Optionally, at least a part of the operation of the image annotation method is implemented in a cascading style sheet.
Optionally, the method further comprises: and during the period from the opening of the WEB page based on the browser to the closing of the WEB page, the image of the WEB page is written and locked at the server side.
Optionally, the at least one annotation comprises a point and/or a box.
Optionally, the position information of the labeling point is coordinate information of the labeling point, and the position information of the labeling box includes a coordinate of an endpoint at the upper right corner of the box, a box width, and a box height.
Optionally, the method further comprises: deleting the generated label on the WEB page before the step of displaying the at least one label on the WEB page according to the recalculated position information of the at least one label.
Optionally, the image annotation method is implemented based on a crop.
According to a second aspect of the embodiments of the present invention, there is provided an image annotation apparatus including:
the parameter reading module is used for opening a WEB page based on a browser and acquiring the position information of at least one label on the image, wherein the WEB page comprises the image, and the image is displayed on the WEB page in an original size;
the information storage module is used for storing the position information of the at least one label; and
and the annotation playback module is used for acquiring the current size of the image, the original size of the image and the position information of the at least one annotation when the WEB page is opened again based on the browser, recalculating the current position information of the at least one annotation, and displaying the at least one annotation on the WEB page according to the recalculated current position information of the at least one annotation.
Optionally, the location information of the at least one label is stored at the server side.
Optionally, the method further comprises: and the locking module is used for writing and locking the image of the WEB page at the server side during the period from the opening of the WEB page based on the browser to the closing of the WEB page.
According to a third aspect of the embodiments of the present invention, there is provided a computer-readable storage medium storing computer instructions, which when executed, implement any one of the image annotation methods described above.
According to a fourth aspect of the embodiments of the present invention, there is provided an image annotation apparatus including:
a memory for storing computer instructions;
a processor coupled to the memory, the processor configured to perform an image annotation method implementing any of the above based on computer instructions stored by the memory.
One embodiment of the present invention has the following advantages or benefits: and after the WEB page is opened for the first time, adding a label on the image in the WEB page, and when the WEB page is opened again, recalculating the label of the current position information and displaying the label back on the image of the WEB page so as to ensure the effectiveness of the label.
Drawings
The above and other objects, features and advantages of the present invention will become more apparent from the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:
FIG. 1 is a flow chart of an image annotation method according to an embodiment of the invention;
FIG. 2 is a diagram illustrating an image annotated by an image annotation method according to an embodiment of the invention;
FIG. 3 is a schematic structural diagram of an image annotation device according to an embodiment of the invention;
FIG. 4 is a block diagram of an image annotation apparatus according to an embodiment of the present invention.
Detailed Description
Various embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. In the various figures, like elements are represented by like or similar reference numerals. For purposes of clarity, the various features in the drawings are not necessarily drawn to scale. Moreover, certain well-known elements may not be shown in the figures.
Fig. 1 shows a flowchart of an image annotation method according to an embodiment of the present invention, which specifically includes the following steps.
In step S101, for a WEB page opened based on a browser, position information of at least one annotation on an image is acquired.
In step S102, the location information of at least one annotation is stored.
In step S103, when the WEB page is opened again based on the browser, the current size of the image, the original size of the image, and the position information of the at least one annotation are obtained, the position information of the annotation is recalculated, and the at least one annotation is displayed on the WEB page according to the recalculated current position information of the at least one annotation.
The image annotation method provided by this embodiment is applied to images included in a WEB page. According to the embodiment, when a user marks on an image contained in a WEB page, the marked position information is obtained and recorded. The position information is position information with respect to the original size of the image. That is, position information to be added when an image is displayed in an original size (the actual width and height of the original image file) on a WEB page. The label can be one or more. The tagged location information may be recorded locally or at the server side. When the WEB page is opened again through the browser, the current size of the image (enlarged or reduced based on the original image) and the position information of the stored label are obtained, the current position information of the label is recalculated according to the current size and the original size, and at least one label is displayed on the WEB page according to the recalculated current position information of at least one label. The WEB pages opened twice may refer to the same WEB page or different WEB pages, but the WEB pages opened twice must both include the image.
The present embodiment is based on a browser implementation. And after the WEB page is opened for the first time, adding a label on the image in the WEB page, and when the WEB page is opened again, recalculating the label position and displaying the label back on the image of the WEB page so as to ensure the effectiveness of the label.
FIG. 2 is a schematic diagram of an image labeled by the image labeling method according to one embodiment of the invention. In the figure, 201 is a block and 202 is a point. The position information of 201 is the position information of the box, and the position information indicates the position of 201 in the current image. The position information is represented by coordinates of an end point at the upper right corner and the width and height of the box, or by coordinates of two end points at a diagonal line, for example. 202 is the coordinates of the point, which represents the position of the point in the current image.
The above embodiment is implemented based on the modification of the chopper. Crop is a piece of picture cropping jQuery plug-in that is simple to use and powerful.
1) Denoted by boxes
The location information may be obtained by Cropper's getData method for a box in the image. For example, one exemplary location information is represented using the following data structure:
{ "x":323, "y":170, "width":268, "height":89, "rotate":0, "scaleX":1, "scaleY":1}, where x and y represent the coordinates of the upper right end point of the box, width and height represent the width and height of the box, rotate represents the angle of rotation, and scaleX and scaleY represent the horizontal direction scale and the vertical direction scale, respectively.
After the position information is obtained, the position information is stored, and the next step is to display back on the image. The position information of the box is first recalculated according to the following formula:
the display coordinate is real coordinate (display width/real width) or real coordinate (display height/real height), where the real coordinate refers to a coordinate of a certain point of four end points of a box marked on the image of the original size, the display coordinate is a coordinate of the point on the WEB page opened by the browser at this time, the display width is a width of the image of the original size displayed at this time, and the real width is a width of the image of the original size. Similarly, the display width and the display height of the current frame can be calculated accordingly. This part of the computation can be implemented by the function provided by Jquery.
Then consider the scaling and movement of the box. The method zoom and move in Cropper are correspondingly modified, firstly, a DIV is newly designed, a displayed style is well defined, a CSS class name is defined, then the converted data is added into the Cropper-container DIV through an apendto method, and then a box is displayed according to the conversion result, so that the function that the marked area can change along with the zooming and the moving of the image is completed. Furthermore, before the step of displaying the box, a $ ("div"). remove ('. jdbox') is performed once, which operation also requires that the displayed original box be deleted.
2) Marked as a point
And adding a setPontMode point mode in a cropper to an original setDragMode dragging mode, modifying a method for taking a square frame in a source code of the cropper, judging whether the new method is a point-taking coordinate mode, and directly obtaining the current coordinate instead of dragging the mouse to select an area when the method is the point-taking coordinate mode, wherein the method for obtaining the coordinate is also carried out by using a getData method.
Firstly, an original setDragMode dragging mode is added with a setPointMode point mode, a method for taking a square frame is modified in a source code of a chopper, whether the mode is a point-taking coordinate mode is newly added or not is judged, when the mode is the point-taking coordinate mode, a mouse cannot be dragged to select an area, the current coordinate is directly obtained, and the method for obtaining the coordinate of the point is also carried out by using a getData method.
And then the coordinates of the marked points are converted. Data for the image display width and height and the original width and height are obtained using getcanvas data, resulting in data in the following format, for example:
{ "left":58, "top":30, "width":681, "height":383, "naturalWidth":1280, "naturalHeight": 720}, where left and top represent the new offset to the left and the new offset to the top, weight and height represent the display width and height, and naturalWidth and naturalHeight represent the true width and height of the image. The display coordinates are calculated by the following conversion formula:
display coordinates (display width height/true width height).
Of course, the implementation of the present invention is not limited to the chopper, and for example, the above-described embodiments may be implemented by using a self-designed script. In addition, the above labels may be line segments in addition to the boxes and dots.
It should be noted that, since the above-described embodiment is implemented on the front side based on a browser, the location information of the annotation may be stored on the server side, and therefore, write-lock processing needs to be performed on the image or WEB page. Label conflicts are avoided by write locking. Of course, the location information of the callout can also be stored only locally at the front end, so that the corresponding callout can be seen only when the WEB page is opened by using the local electronic device.
FIG. 3 is a schematic structural diagram of an image annotation device according to an embodiment of the invention. As shown in fig. 2, the image annotation device 30 includes a parameter reading module 301, an information storage module 302 and an annotation playback module 303.
The parameter reading module 301 obtains position information of at least one label on an image for a WEB page opened based on a browser, where the WEB page includes the image and the image is displayed in an original size on the WEB page.
The information storage module 302 is configured to store the location information of at least one label.
The annotation playback module 303 is configured to, when the WEB page is opened again based on the browser, obtain the current size of the image, the original size of the image, and the at least one piece of annotated location information, recalculate the current location information of the annotation, and display the at least one annotation on the WEB page according to the recalculated current location information of the at least one annotation.
The image annotation device annotates images contained in a WEB page. The labels may be boxes, dots, circles, ellipses, line segments, etc. When a user marks an image contained in a WEB page, acquiring and recording the position information of the current mark. The position information represents absolute position information. That is, position information of a box when an image is displayed in an original size (the actual width and height of an original image file) on a WEB page. The label may be one or more. The marked position information can be further recorded to the server side, for example, when the WEB page is closed by adopting a browser, the marked position information is submitted to the server side. When the WEB page is opened again through the browser, the current size of the image (which is enlarged or reduced compared with the original image) and the stored labeled position information are obtained, the labeled current position information is recalculated according to the current size and the original size, and the label is displayed on the WEB page according to the recalculated labeled current position information. The WEB pages opened twice may refer to the same WEB page or different WEB pages, but the WEB pages opened twice must both include the image.
It should be understood that the image annotation apparatus of the present embodiment corresponds to the above-described image annotation method. The image marking device is adopted to mark the image, and the size adaptation of the echoed mark and the current image is ensured by recalculating the marked position information, thereby ensuring the effectiveness of the mark.
The image annotation device further comprises a locking module, wherein the locking module is used for writing and locking the image in the WEB page or the WEB page at the server side during the period from the opening of the WEB page based on the browser to the closing of the WEB page.
Fig. 4 is a block diagram showing a consultation amount predicting apparatus according to an embodiment of the present invention. The apparatus shown in fig. 4 is only an example and should not limit the functionality and scope of use of embodiments of the present invention in any way.
Referring to fig. 4, the control apparatus of the consultation amount prediction includes a processor 401, a memory 402, and an input-output device 403 connected through a bus. Memory 402 includes Read Only Memory (ROM) and Random Access Memory (RAM), with various computer instructions and data required to perform system functions being stored in memory 402, and with various computer instructions being read by processor 401 from memory 402 to perform various appropriate actions and processes. An input portion 5 of an input/output device including a keyboard, a mouse, and the like; an output section including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section including a hard disk and the like; and a communication section including a network interface card such as a LAN card, a modem, or the like. The memory 402 also stores the following computer instructions to perform the operations specified by the advisory volume prediction method of embodiments of the present invention: for a WEB page opened based on a browser, acquiring position information of at least one label on the image, wherein the WEB page comprises the image, and the image is displayed on the WEB page in an original size; storing the location information of the at least one annotation; and when the WEB page is opened again based on the browser, acquiring the current size of the image, the original size of the image and the position information of the at least one label, recalculating the position information of the at least one label, and displaying the at least one label on the WEB page according to the recalculated position information of the at least one label.
Accordingly, an embodiment of the present invention provides a computer-readable storage medium, which stores computer instructions that, when executed, implement the operations specified by the above-mentioned consulting volume prediction method.
The flowcharts and block diagrams in the figures and block diagrams illustrate the possible architectures, functions, and operations of the systems, methods, and apparatuses according to the embodiments of the present invention, and may represent a module, a program segment, or merely a code segment, which is an executable instruction for implementing a specified logical function. It should also be noted that the executable instructions that implement the specified logical functions may be recombined to create new modules and program segments. The blocks of the drawings, and the order of the blocks, are thus provided to better illustrate the processes and steps of the embodiments and should not be taken as limiting the invention itself.
The various modules or units of the system may be implemented in hardware, firmware or software. The software includes, for example, a code program formed using various programming languages such as JAVA, C/C + +/C #, SQL, and the like. Although the steps and sequence of steps of the embodiments of the present invention are presented in method and method diagrams, the executable instructions of the steps implementing the specified logical functions may be re-combined to create new steps. The sequence of the steps should not be limited to the sequence of the steps in the method and the method illustrations, and can be modified at any time according to the functional requirements. Such as performing some of the steps in parallel or in reverse order.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
While embodiments in accordance with the invention have been described above, these embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. The invention is limited only by the claims and their full scope and equivalents.

Claims (13)

1. An image annotation method, comprising:
for a WEB page opened based on a browser, acquiring position information of at least one label on an image, wherein the WEB page comprises the image, and the image is displayed on the WEB page in an original size;
storing the location information of the at least one annotation; and
and when the WEB page is opened again based on the browser, acquiring the current size of the image, the original size of the image and the position information of the at least one label, recalculating the current position information of the at least one label, and displaying the at least one label on the WEB page according to the recalculated current position information of the at least one label.
2. The image annotation method of claim 1, wherein the server stores the location information of the at least one annotation.
3. The image annotation method of claim 1, wherein at least a portion of the operations of the image annotation method are implemented in a cascading style sheet.
4. The image annotation method according to claim 1, further comprising: and during the period from the opening of the WEB page based on the browser to the closing of the WEB page, the image of the WEB page is written and locked at the server side.
5. The image annotation method of claim 1, wherein the at least one annotation comprises a point and/or a box.
6. The image annotation method according to claim 5, wherein the position information of the point is coordinate information of the point, and the position information of the box includes coordinates of an end point at the upper right corner of the box, a box width, and a box height.
7. The image annotation method according to claim 1, further comprising: deleting the existing label on the WEB page before the step of displaying the at least one label on the WEB page according to the recalculated current position information of the at least one label.
8. The image annotation method of claim 1, wherein the image annotation method is implemented based on a crop.
9. An image annotation apparatus, comprising:
the parameter reading module is used for opening a WEB page based on a browser and acquiring position information of at least one label on an image, wherein the WEB page comprises the image, and the image is displayed on the WEB page in an original size;
the information storage module is used for storing the position information of the at least one label; and
and the annotation playback module is used for acquiring the current size of the image, the original size of the image and the position information of the at least one annotation when the WEB page is opened again based on the browser, recalculating the current position information of the at least one annotation, and displaying the at least one annotation on the WEB page according to the recalculated current position information of the at least one annotation.
10. The image annotation device of claim 9, wherein the location information of the at least one annotation is stored on the server side.
11. The image annotation apparatus according to claim 9, further comprising: and the locking module is used for writing and locking the image of the WEB page at the server side during the period from the opening of the WEB page based on the browser to the closing of the WEB page.
12. A computer-readable storage medium storing computer instructions which, when executed, implement the image annotation method of any one of claims 1 to 8.
13. An image annotation apparatus, comprising:
a memory for storing computer instructions;
a processor coupled to the memory, the processor configured to perform an image annotation method according to any one of claims 1 to 8 based on computer instructions stored by the memory.
CN201811506514.9A 2018-12-10 2018-12-10 Image annotation method, device and computer-readable storage medium Pending CN111291285A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811506514.9A CN111291285A (en) 2018-12-10 2018-12-10 Image annotation method, device and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811506514.9A CN111291285A (en) 2018-12-10 2018-12-10 Image annotation method, device and computer-readable storage medium

Publications (1)

Publication Number Publication Date
CN111291285A true CN111291285A (en) 2020-06-16

Family

ID=71021050

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811506514.9A Pending CN111291285A (en) 2018-12-10 2018-12-10 Image annotation method, device and computer-readable storage medium

Country Status (1)

Country Link
CN (1) CN111291285A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114120121A (en) * 2021-11-29 2022-03-01 北京百度网讯科技有限公司 Target processing method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070183679A1 (en) * 2004-02-05 2007-08-09 Vodafone K.K. Image processing method, image processing device and mobile communication terminal
CN101377776A (en) * 2007-08-29 2009-03-04 中国科学院自动化研究所 Method for searching interactive image
CN103425690A (en) * 2012-05-22 2013-12-04 湖南家工场网络技术有限公司 Picture information labeling and displaying method based on cascading style sheets
CN104424232A (en) * 2013-08-26 2015-03-18 阿里巴巴集团控股有限公司 Web page annotation method and device
CN108510084A (en) * 2018-04-04 2018-09-07 百度在线网络技术(北京)有限公司 Method and apparatus for generating information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070183679A1 (en) * 2004-02-05 2007-08-09 Vodafone K.K. Image processing method, image processing device and mobile communication terminal
CN101377776A (en) * 2007-08-29 2009-03-04 中国科学院自动化研究所 Method for searching interactive image
CN103425690A (en) * 2012-05-22 2013-12-04 湖南家工场网络技术有限公司 Picture information labeling and displaying method based on cascading style sheets
CN104424232A (en) * 2013-08-26 2015-03-18 阿里巴巴集团控股有限公司 Web page annotation method and device
CN108510084A (en) * 2018-04-04 2018-09-07 百度在线网络技术(北京)有限公司 Method and apparatus for generating information

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114120121A (en) * 2021-11-29 2022-03-01 北京百度网讯科技有限公司 Target processing method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
US8775923B1 (en) Web page restoration
AU2005202722B2 (en) Common charting using shapes
US20050183005A1 (en) Systems and methods for freeform annotations
US11875108B2 (en) Annotating documents on a mobile device
CN111857893B (en) Method and device for generating annotation graph
WO2022057470A1 (en) Bill content recognition method and apparatus, and computer device, and medium
DK2126720T3 (en) PROCEDURE FOR CONNECTING AN AMENDED DOCUMENT AND ORIGINAL DOCUMENT FOR COMPARISON AND PREPARATION OF DIFFERENCES
CN108228816A (en) A kind of loading method and device of waterfall flow graph piece
CN111651966A (en) Method, device and electronic device for generating data report file
CN115659917A (en) Document format restoration method and device, electronic equipment and storage equipment
US20250029367A1 (en) Component identification method and apparatus, electronic device, and storage medium
CN111291285A (en) Image annotation method, device and computer-readable storage medium
CN113821146B (en) Global annotation method and device, terminal device and storage medium
CN112365402B (en) Intelligent winding method and device, storage medium and electronic equipment
CN111428452B (en) Annotation data storage method and device
CN111563157A (en) Thumbnail display method and device
CN111914517A (en) Document hyperlink creating method and device, electronic equipment and readable storage medium
CN112306336A (en) Document content display method and device
CN113468452B (en) Remote sensing data visual interface interaction method and device and electronic equipment
CN106649707B (en) Method and device for managing image content label
JP2017027319A (en) Display/editing/storage method, device, and processing program of document documentation data
CN115757871A (en) Video annotation method, device, equipment, medium and product
CN110941947A (en) Document editing method and device, computer storage medium and terminal
CN113704650A (en) Information display method, device, system, equipment and storage medium
CN111522939B (en) Method and device for processing notes, computer storage medium and terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination