Nothing Special   »   [go: up one dir, main page]

EP0448803B1 - Système de commande d'affichage vidéo - Google Patents

Système de commande d'affichage vidéo Download PDF

Info

Publication number
EP0448803B1
EP0448803B1 EP90124078A EP90124078A EP0448803B1 EP 0448803 B1 EP0448803 B1 EP 0448803B1 EP 90124078 A EP90124078 A EP 90124078A EP 90124078 A EP90124078 A EP 90124078A EP 0448803 B1 EP0448803 B1 EP 0448803B1
Authority
EP
European Patent Office
Prior art keywords
flash
area
frame
monitoring device
video monitoring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP90124078A
Other languages
German (de)
English (en)
Other versions
EP0448803A2 (fr
EP0448803A3 (en
Inventor
Rainer Grundig E.M.V. Max Grundig Rumland
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Grundig EMV Elektromechanische Versuchsanstalt Max Grundig GmbH
Original Assignee
Grundig EMV Elektromechanische Versuchsanstalt Max Grundig GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Grundig EMV Elektromechanische Versuchsanstalt Max Grundig GmbH filed Critical Grundig EMV Elektromechanische Versuchsanstalt Max Grundig GmbH
Priority to AT90124078T priority Critical patent/ATE102726T1/de
Publication of EP0448803A2 publication Critical patent/EP0448803A2/fr
Publication of EP0448803A3 publication Critical patent/EP0448803A3/de
Application granted granted Critical
Publication of EP0448803B1 publication Critical patent/EP0448803B1/fr
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19639—Details of the system layout
    • G08B13/19652—Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19634—Electrical details of the system, e.g. component blocks for carrying out specific functions

Definitions

  • the invention relates to a video control device for the detection of stationary and moving objects in a delimited, preferably flat area with the aid of a surveillance camera.
  • Light barriers are often used to detect such objects. Although this type of monitoring is not very complex, it has the disadvantage that only objects that interrupt a light beam are recognized, so that the network of light beams must be very narrow. In order to recognize lying people or flat obstacles, the light barriers must be installed very low, which, however, can easily lead to errors in the evaluation, e.g. if There is snow. Additional video surveillance is necessary so that the surveillance area can be checked for the cause of the alarm in the event of an alarm by the surveillance personnel, so that the train is not stopped in the event of a false alarm.
  • a more advantageous method is monitoring with television cameras and automatic evaluation with a video controller.
  • movements are detected here, so that a pedestrian or a car in the surveillance area triggers the alarm. Since in this type of monitoring two images in succession are checked for changes, the detection of an object depends on its movement. Objects at rest are not recognized.
  • a source of error arises from changes in the image caused by the moving shadow of passing clouds or trees moving in the wind. In the dark there are problems with the light cones of car headlights.
  • the object of the invention is therefore to provide a monitoring device that is both stationary and also reliably detects moving objects in the surveillance area and at the same time reduces the probability of false alarms.
  • This object is achieved by taking two images for evaluation and storing them in an image memory, one of the images being taken without artificial lighting, while the second image with a flash which is arranged opposite the camera, the axis of the radiation cone of the Flash forms an angle with the axis of the camera, which is less than 180 °, is recorded.
  • a difference image is now created from the two images stored in the image memory, which only contains portions which have arisen from the lighting by the flash, while portions which have arisen due to the normal light are extinguished. If there is an object in the monitored area, the difference image results in a signal in the shadow areas that arise behind an object on the side facing away from the flash. The extent of these signals is evaluated. An alarm is triggered when a shadow is detected.
  • the monitoring device With the monitoring device according to the invention, three-dimensional objects can be recognized, it being irrelevant whether these are moving or at rest. By hiding the part of the image that is created by normal lighting, changes in the image that are caused by shadows as a result of normal lighting and the like and that lead to interference in known image processing systems are suppressed.
  • the area to be monitored can be limited by a mask if the detection area of the camera is larger than the area to be monitored.
  • the mask is electronically determined so that the excluded areas are not taken into account in the evaluation.
  • a second flash device which is arranged at a short distance next to the first, so that, for example, ruts in the snow in the direction of the plane in which the axis of the camera optics and the flash radiation cone lying, do not cause shadows. It is advantageous if the axis of the second flash has a slightly changed angle to the camera axis.
  • Limiting the spectral range of the flash and advantageously also of the camera also contributes to increasing the reliability of the evaluation, since the interference is reduced by this exclusion.
  • the TV cameras with semiconductor sensors CCD cameras
  • CCD cameras can still process a range from dark red to infrared, the blue, green and yellow areas are suppressed and an appropriate optical filter makes the scene still appear natural.
  • the image signals triggered by a limited spectral range can be fed to a central monitoring station for evaluation.
  • the light loss caused by the filter is compensated for by opening the diaphragm by 2 to 3 steps.
  • FIG. 1 shows a block diagram of an arrangement according to the invention
  • FIG. 2 shows the arrangement of flash unit (hereinafter referred to as flash) and camera using the example of a level crossing
  • FIG. 3 shows the image section with a restricted area and a three-dimensional object.
  • the camera 1 is connected to the masking device 2. Cables lead from this masking device 2 to the synch separator 3, to the image processing unit 12 and to the switch S1, which optionally connects the signal at the output of the masking device 2 to the image memory 6 or to the image memory 7.
  • the switch S1 is controlled by the switch control 5.
  • the synch separator 3 is still connected to the field recognition 4. This in turn has a connection to the switch control 5 and to the flash control 8, which is connected to the switch S2 and to the flash 9.
  • the image memories 6 and 7 are also connected to the differential circuit 11, to which the image processing unit 12 connects.
  • a connection leads from the image processing unit 12 to the alarm transmitter 13, which is connected to an alarm output unit 14.
  • the camera 1 and the flash 9 are arranged elevated on opposite sides of the surveillance area.
  • a possible arrangement is shown in FIG. 2a using the example of a level crossing.
  • the arrangement can consist of the camera K and the flash B or of the camera K and the flashes B1 and B2. Furthermore, an arrangement with more than two flashes is also possible if the area to be monitored has other conditions that require this.
  • a side view of the arrangement is shown in Fig. 2b. 2c shows a view from above.
  • the switch S2 is coupled to the barrier at a level crossing so that it activates the monitoring device when the barrier is closed.
  • the camera When the monitoring device is activated, the camera first records a first field and then a second field with flash lighting. These video signals pass through the masking device 2, in which everything that does not belong to the area to be monitored is hidden.
  • the masking device 2 In Figure 3a, the parts that are masked out by the masking device are shown hatched, so that only the area between the barriers remains. In the masking device 2 However, ascertained bumps or the rails, which can also interfere with the evaluation, can be hidden.
  • the manipulated in the masking device 2 image signal is firstly applied to the synch separator 3, in which the synchronization signals are separated, which are then processed in the field recognition 4.
  • the image portions hidden by the mask are fed to the image processing unit, so that these image portions are not taken into account in the image evaluation.
  • the manipulated image signal is optionally sent to the image memory 6 or the image memory 7 via the switch S1.
  • the switch S1 is brought into the respectively required position by the switch control 5, a switching signal being given by the field recognition 4 to the switch control 5.
  • the control takes place in such a way that a first field is stored in the image memory 6. This first field is under normal conditions, i.e. taken by the camera without flash.
  • the field detection 4 again sends a switching signal to the switch control 5 and the flash control 8 and the flash image now generated is stored in the image memory 7.
  • the field detection can output a switching signal after each field or every frame, which is evaluated in the switch control 5 or in the flash control 8.
  • the evaluation can advantageously take place in such a way that after the first Field in the image memory 6, one field is not evaluated and the next field is then written into the image memory 7, the flash 9 being triggered by the flash controller 8 when this field was recorded.
  • This field now contains image information that was obtained due to the normal lighting and additionally the image information that was caused by the flash.
  • the two fields are located in the image memories 6 and 7 and are subsequently manipulated in the differential circuit 11 by forming the difference from the corresponding image points of the image memory 6 and the image memory 7 pixel by pixel.
  • the resulting image which is evaluated in the image processing unit 12, only contains image information that was caused by the light of the flash. When displaying this image on the monitor, everything would be largely shown and visible, just like a normal picture. However, the disturbing external light sources, such as car headlights and their light cones, and their effects, such as the shadows caused by these light sources, are missing. Shadows are also invisible, which are caused by passing clouds or trees swaying in the wind and which can only be eliminated with great effort or not at all in the image evaluation using known image recording methods.
  • the image information that only results from the light of the flash creates a shadow on the side of the object facing away from the flash, as shown in FIG. 3 is represented by the area S, which indicates the presence of a three-dimensional object O in the surveillance area.
  • the unlit side of the object also remains black and is also referred to as shadow in the following.
  • the simplest way to evaluate the image is to use a shadow, i.e. recognize an area whose image values have black levels. If such an area is recognized, the alarm device 13 can emit an alarm, which is indicated acoustically or optically by the alarm output unit 14.
  • the image evaluation in the image processing unit 12 can be expanded as far as is necessary for meaningful monitoring. For example, the extent and shape of the area can be evaluated with a black level. In this way, an alarm can be suppressed, for example by a cigarette packet. Thanks to a more complex image processing system, brightening of the shadows created by scattered light can also be taken into account.
  • the size of the shadow depends on the position to the flash. An object that is close to the flash creates a smaller shadow than an object of the same size that is further away because the angle of incidence is flatter here.
  • Three-dimensional objects which, as already mentioned, are constantly in the same area in the area to be monitored, can be masked out by the masking device 2 or they can be excluded from the evaluation in the image processing unit 12.
  • An adaptation to different places of use is easily possible here, in that when the monitoring system is set up, the monitoring area is recorded in the manner described above and the shadows that are created are taught in and are not taken into account in the evaluation in the monitoring area.
  • the surveillance camera of the surveillance system is also used for surveillance by surveillance personnel, i.e. for displaying an image on a monitor, the field that was additionally exposed by flash can be replaced by the previous field stored in the other image memory.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Processing (AREA)
  • Selective Calling Equipment (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Claims (8)

  1. Système de contrôle vidéo pour la détection d'objets à trois dimensions mobiles et immobiles dans un champ délimité plat à l'aide d'une caméra de télévision, caractérisé en ce que le système comprend :
    - un dispositif de flash sur le côté du champ à surveiller opposé à la caméra de télévision, les axes du faisceau lumineux du flash et de l'objectif de la caméra formant de préférence un angle inférieur à 180°,
    - un agencement de mémorisation d'images dans lequel sont enregistrées et stockées une image avec déclenchement de flash et une image sans déclenchement de flash,
    - un circuit de différenciation dans lequel on produit à partir des deux images une image de différenciation qui ne contient que les parties d'informations qui ont été données par la lumière du flash,
    - une unité de traitement d'images qui, en présence d'un objet à trois dimensions dans le champ surveillé, identifie et évalue les parties d'images ombrées obtenues sur l'image différentielle par l'éclairage au flash de l'objet.
  2. Système de contrôle vidéo selon la revendication 1, caractérisé en ce que le système contient un générateur d'alarme qui est déclenché lors de l'identification d'un objet à trois dimensions.
  3. Système de contrôle vidéo selon la revendication 1 ou 2, caractérisé en ce que le système contient un filtre qui élimine des petites parties d'images ombrées qui sont dues à des inégalités du sol à l'intérieur du champ à surveiller.
  4. Système de contrôle vidéo selon la revendication 1 ou 2, caractérisé en ce qu'il est prévu une mémoire dans laquelle sont stockées les ombres parasites présentes en permanence et en ce que ces parties d'image avec les signaux d'image stockés sont envoyés à l'unité de traitement d'images pour compensation des signaux parasites.
  5. Système de contrôle vidéo selon une ou plusieurs des revendications 1 à 4, caractérisé en ce que le champ spectral de la caméra et celui du flash sont délimités par un filtre optique.
  6. Système de contrôle vidéo selon une ou plusieurs des revendications 1 à 5, caractérisé en ce qu'il est prévu un générateur de masque électronique qui limite le champ à surveiller lors de l'évaluation et en ce que les parties d'image hors de la zone délimitée ne sont pas évaluées.
  7. Système de contrôle selon une ou plusieurs des revendications 1 à 6, caractérisé en ce qu'il est prévu un second dispositif de flash pour augmenter la sécurité de l'évaluation.
  8. Système de contrôle vidéo selon une ou plusieurs des revendications 1 à 7, caractérisé en ce que les dispositifs de flash et la caméra sont agencés plus ou moins à la même hauteur au-dessus du plan de la surface à surveiller.
EP90124078A 1990-03-28 1990-12-13 Système de commande d'affichage vidéo Expired - Lifetime EP0448803B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AT90124078T ATE102726T1 (de) 1990-03-28 1990-12-13 Videokontroll-einrichtung.

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE4009912A DE4009912A1 (de) 1990-03-28 1990-03-28 Videokontroll-einrichtung
DE4009912 1990-03-28

Publications (3)

Publication Number Publication Date
EP0448803A2 EP0448803A2 (fr) 1991-10-02
EP0448803A3 EP0448803A3 (en) 1992-09-23
EP0448803B1 true EP0448803B1 (fr) 1994-03-09

Family

ID=6403218

Family Applications (1)

Application Number Title Priority Date Filing Date
EP90124078A Expired - Lifetime EP0448803B1 (fr) 1990-03-28 1990-12-13 Système de commande d'affichage vidéo

Country Status (3)

Country Link
EP (1) EP0448803B1 (fr)
AT (1) ATE102726T1 (fr)
DE (2) DE4009912A1 (fr)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4436856C2 (de) * 1994-10-16 1998-07-02 Christian Lutz Zugbremseinrichtung
DE19507812A1 (de) * 1995-03-06 1996-09-12 Marinitsch Waldemar Verfahren und Vorrichtung zum Identifizieren und Lokalisieren eines Objektes
DE19623524A1 (de) * 1996-06-13 1998-01-02 Pintsch Bamag Ag Einrichtung zur Gefahrenraumüberwachung an einem Bahnübergang
EP1079351B1 (fr) * 1999-08-27 2005-05-11 Siemens Building Technologies AG Dispositif de surveillance d'un espace
DE10044689A1 (de) * 2000-09-08 2002-03-21 Idm Gmbh Infrarot Sensoren Vorrichtung zur Überwachung eines Bereichs eines Raumes
WO2003018402A1 (fr) * 2001-08-27 2003-03-06 Edouard Menoud Systeme de detection de corps etrangers sur les pistes d'aeroports
ES2260403T3 (es) 2002-03-11 2006-11-01 Inventio Ag Sistema de vigilancia por video mediante sensor semiconductor de imagen en 3d y fuente de luz infrarroja.
JP2006520307A (ja) * 2003-03-20 2006-09-07 インベンテイオ・アクテイエンゲゼルシヤフト 三次元センサを用いるエレベータエリアの監視
FR2887061B1 (fr) * 2005-06-08 2007-08-17 Sagem Procede d'analyse d'une presence dans un espace
DE202007002260U1 (de) * 2007-02-15 2008-06-26 Leuze Electronic Gmbh & Co Kg Optoelektronische Vorrichtung
CN107300722A (zh) * 2017-07-18 2017-10-27 孙天宇 一种机场跑道异物检测系统

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0629707B2 (ja) * 1986-10-17 1994-04-20 株式会社日立製作所 光切断線計測装置
FR2606572A1 (fr) * 1986-11-07 1988-05-13 Faiveley Ets Procede et dispositif pour detecter la presence d'un corps dans une zone predeterminee

Also Published As

Publication number Publication date
EP0448803A2 (fr) 1991-10-02
ATE102726T1 (de) 1994-03-15
DE4009912A1 (de) 1991-10-02
EP0448803A3 (en) 1992-09-23
DE59004935D1 (de) 1994-04-14

Similar Documents

Publication Publication Date Title
DE3634628C2 (fr)
DE69815977T2 (de) Gegen globale veränderungen unempfindlicher videobewegungsdetektor
DE69526397T2 (de) Geschlossenes Fernsehüberwachungssystem mit fahrbarer Kamera und selbsttätiger Zielerfassung
EP0448803B1 (fr) Système de commande d'affichage vidéo
DE602005001627T2 (de) Vorrichtung zur Extraktion von Fussgängern
DE19709799A1 (de) Einrichtung zur Videoüberwachung einer Fläche
DE19700811A1 (de) Verfahren und Vorrichtung zur Ansteuerung von Türanlage in Abhängigkeit von der Anwesenheit von Personen
DE112010003000T5 (de) Sichtsystem zum Überwachen von Menschen in dynamischen Umgebungen
EP1543270A1 (fr) Procede et dispositif pour securiser une zone de risque
DE102017218917A1 (de) Überwachungsvorrichtung, Industrieanlage, Verfahren zur Überwachung sowie Computerprogramm
EP1273516A1 (fr) Dispositif pour la saisie d'information optique
DE19621612A1 (de) Verfahren und Vorrichtung zur optischen Freiraumüberwachung
EP0356734A2 (fr) Dispositif détecteur d'intrusion à caméras vidéo
DE9409202U1 (de) Vorrichtung zur Überwachung von zu sichernden Bereichen
DE3214254A1 (de) Verfahren zum erkennen von bewegungen in video-kamera-bildern
WO2020038984A1 (fr) Procédé et arrangement pour reconnaître des décharges en couronne d'une installation ayant des moyens d'exploitation
DE10049366A1 (de) Verfahren zum Überwachen eines Sicherheitsbereichs und entsprechendes System
DE102007032091B3 (de) Verfahren zum Überwachen eines höhengleichen Bahnübergangs
DE2255876A1 (de) Fernsehsystem, insbesondere fuer ueberwachungszwecke
DE60033210T2 (de) Vorrichtung zur Übertragung von digitalen Videobildern
WO1997004428A1 (fr) Systeme de surveillance interactif
DE19749136C2 (de) Verfahren und Vorrichtung zum Erfassen von Bewegungen
DE102017207729A1 (de) Verfahren und Vorrichtung zur Detektion eines sich nicht in einem Erfassungsbereich einer Kamera befindlichen Objekts
DE102009043080B4 (de) Verfahren zur Detektion von Rauch und/oder Flammen und Detektionssystem
DE19744694B4 (de) Videobewegungsmeldeeinrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT CH DE DK FR GB IT LI

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT CH DE DK FR GB IT LI

17P Request for examination filed

Effective date: 19921022

17Q First examination report despatched

Effective date: 19930624

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT CH DE DK FR GB IT LI

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.

Effective date: 19940309

Ref country code: DK

Effective date: 19940309

REF Corresponds to:

Ref document number: 102726

Country of ref document: AT

Date of ref document: 19940315

Kind code of ref document: T

GBT Gb: translation of ep patent filed (gb section 77(6)(a)/1977)

Effective date: 19940314

REF Corresponds to:

Ref document number: 59004935

Country of ref document: DE

Date of ref document: 19940414

ET Fr: translation filed
PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 19941202

Year of fee payment: 5

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 19941220

Year of fee payment: 5

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: AT

Payment date: 19941230

Year of fee payment: 5

Ref country code: FR

Payment date: 19941230

Year of fee payment: 5

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
REG Reference to a national code

Ref country code: CH

Ref legal event code: PFA

Free format text: GRUNDIG E.M.V. ELEKTRO- MECHANISCHE VERSUCHSANSTALT MAX GRUNDIG GMBH & CO. KG

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Effective date: 19951213

Ref country code: GB

Effective date: 19951213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Effective date: 19951231

Ref country code: LI

Effective date: 19951231

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 19951213

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Effective date: 19960830

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20100216

Year of fee payment: 20

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20101213