Nothing Special   »   [go: up one dir, main page]

JPH06164409A - Band division encoding method - Google Patents

Band division encoding method

Info

Publication number
JPH06164409A
JPH06164409A JP4306699A JP30669992A JPH06164409A JP H06164409 A JPH06164409 A JP H06164409A JP 4306699 A JP4306699 A JP 4306699A JP 30669992 A JP30669992 A JP 30669992A JP H06164409 A JPH06164409 A JP H06164409A
Authority
JP
Japan
Prior art keywords
band
coding
encoding
circuit
buffer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP4306699A
Other languages
Japanese (ja)
Inventor
Takatoshi Nishio
卓敏 西尾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Priority to JP4306699A priority Critical patent/JPH06164409A/en
Publication of JPH06164409A publication Critical patent/JPH06164409A/en
Pending legal-status Critical Current

Links

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Image Processing (AREA)

Abstract

PURPOSE:To maintain a high quality signal with respect to audiovisual characteristics by providing a means which gives a priority level to each band in a limited intra-buffer capacity and determining the code volume of each band by this priority level to adjust the bit generation volume due to encoding between bands. CONSTITUTION:The audio signal inputted from a signal input terminal 101 is divided into four bands S1 to S4 in the order from the lowest frequency band by a band dividing circuit 102. When the band S1 has 5.5M-bit intra-buffer capacity, the quantization width is limited to the range of '4' to '13', and it is not changed because it is within the range. A multiplexer 108 performs this discrimination to send '9', '11', and '14' as the quantization width to first, second, and fourth encoding circuits 103, 104, and 106 respectively and sends the same '8' as before a prescribed time interval to a third encoding circuit 105. If a condition that the quantization width of bands other than the band S is not smaller than that of the band S1 is imposed, the multiplexer sends '9' to the third encoding circuit 105.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【産業上の利用分野】本発明は、画像信号、オーディオ
信号等の信号を帯域分割回路によって複数の周波数帯域
に分割して符号化を行う帯域分割符号化方法に関するも
のである。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a band division coding method for dividing a signal such as an image signal, an audio signal or the like into a plurality of frequency bands by a band division circuit for coding.

【0002】[0002]

【従来の技術】画像信号、オーディオ信号等の高能率符
号化技術の一つにサブバンド符号化が知られている。以
下にオーディオ信号を入力とした場合の帯域分割符号化
装置の従来例について説明する。
2. Description of the Related Art Subband coding is known as one of high-efficiency coding techniques for image signals, audio signals and the like. A conventional example of the band division encoding device when an audio signal is input will be described below.

【0003】図4は、従来の帯域分割符号化方法を実現
する帯域分割符号化装置の一例を示すブロック図であ
る。図4において、401は信号入力端子、402は帯域分割
回路、403は第一符号化回路、404は第二符号化回路、40
5は第三符号化回路、406は第四符号化回路、407はマル
チプレクサ回路、408は信号出力端子である。以下、図
4を用いて動作を説明する。
FIG. 4 is a block diagram showing an example of a band division coding apparatus for realizing a conventional band division coding method. In FIG. 4, 401 is a signal input terminal, 402 is a band dividing circuit, 403 is a first encoding circuit, 404 is a second encoding circuit, 40
5 is a third encoding circuit, 406 is a fourth encoding circuit, 407 is a multiplexer circuit, and 408 is a signal output terminal. The operation will be described below with reference to FIG.

【0004】信号入力端子401 より入力されるオーディ
オ信号は、帯域分割回路402 により4つの帯域に分割さ
れる。分割された4つの信号は、それぞれ第一符号化回
路403、第二符号化回路404、第三符号化回路405、第四
符号化回路406に入力され、各々の符号化回路で符号化
される。符号化の際には所定の転送速度に合うように予
めビット割当を各符号化回路に配分しておく。第一符号
化回路403、第二符号化回路404、第三符号化回路405、
第四符号化回路406により符号化された信号は、マルチ
プレクサ回路407で多重化され信号出力端子408に出力さ
れる(例えば、N.S.Jayant-Peter Noll 著「Digital Co
ding of Waveform」 pp486-509)。
The audio signal input from the signal input terminal 401 is divided into four bands by the band dividing circuit 402. The four divided signals are input to the first coding circuit 403, the second coding circuit 404, the third coding circuit 405, and the fourth coding circuit 406, respectively, and coded by each coding circuit. . At the time of encoding, bit allocation is previously allocated to each encoding circuit so as to match a predetermined transfer rate. A first encoding circuit 403, a second encoding circuit 404, a third encoding circuit 405,
The signal encoded by the fourth encoding circuit 406 is multiplexed by the multiplexer circuit 407 and output to the signal output terminal 408 (see, for example, "Digital Co.," written by NS Jayant-Peter Noll.
ding of Waveform "pp486-509).

【0005】[0005]

【発明が解決しようとする課題】しかしながら上記の様
な構成では、各帯域に対するビット割当が一意的であ
り、時々刻々と変化する入力信号の性質に応じた符号化
が行なわれず、また帯域分割した信号の情報変化にも対
応していないため、高品質な符号化を行なえない、とい
う問題点を有していた。
However, in the above-mentioned configuration, the bit allocation to each band is unique, the coding is not performed according to the property of the input signal which changes from moment to moment, and the band is divided. There is a problem that high quality coding cannot be performed because it does not correspond to a change in signal information.

【0006】[0006]

【課題を解決するための手段】上記課題を解決するため
に本発明の帯域分割符号化方法は、転送速度を制御する
ためにバッファと、前記バッファ内容量を予め定められ
た時間間隔tで監視し、前記間隔tで観測された各帯域
の符号化歪量を用いて各帯域に優先順位をつける手段と
を有し、前記優先順位から所定の方法で各帯域の符号量
を決める符号量制御信号を各帯域毎に送出することによ
り符号化量を制御するようにしたものである。
In order to solve the above-mentioned problems, a band-division coding method of the present invention monitors a buffer for controlling a transfer rate and a buffer internal capacity at a predetermined time interval t. And a means for prioritizing each band by using the coding distortion amount of each band observed at the interval t, and a code amount control for determining the code amount of each band from the priority by a predetermined method. The coding amount is controlled by sending a signal for each band.

【0007】[0007]

【作用】本発明は、上記した方法により、限られたバッ
ファ内容量の中で、各帯域に優先順位をつける手段を有
し、その優先順位により各帯域の符号量を決めることに
より符号化によるビット発生量を帯域間で調整でき視聴
覚特性上で高品質な信号を保持することができる。
According to the present invention, by the method described above, there is provided means for prioritizing each band within the limited buffer capacity, and the coding amount is determined by determining the code amount of each band based on the priority. The bit generation amount can be adjusted between bands, and a high-quality signal can be held in terms of audiovisual characteristics.

【0008】[0008]

【実施例】以下、本発明の帯域分割符号化方法につい
て、図面を参照しながら説明する。
DESCRIPTION OF THE PREFERRED EMBODIMENTS The band division coding method of the present invention will be described below with reference to the drawings.

【0009】図1は、本発明の帯域分割符号化方法を実
現する帯域分割符号化装置の一実施例を示すブロック図
である。図1において、101は信号入力端子、102は帯域
分割回路、103は第一符号化回路、104は第二符号化回
路、105は第三符号化回路、106は第四符号化回路、107
は符号化量制御回路、108はマルチプレクサ回路、109は
信号出力端子である。以上の様に構成された帯域分割符
号化装置について、以下図1を用いて符号化方法の動作
を説明する。
FIG. 1 is a block diagram showing an embodiment of a band division coding apparatus for realizing the band division coding method of the present invention. In FIG. 1, 101 is a signal input terminal, 102 is a band division circuit, 103 is a first encoding circuit, 104 is a second encoding circuit, 105 is a third encoding circuit, 106 is a fourth encoding circuit, 107.
Is a coding amount control circuit, 108 is a multiplexer circuit, and 109 is a signal output terminal. The operation of the coding method of the band division coding apparatus configured as described above will be described below with reference to FIG.

【0010】信号入力端子101より入力されるオーディ
オ信号は、帯域分割回路102により周波数の低い帯域か
らS1、S2、S3、S4の4つの帯域に分割される。分割
された4つの帯域信号は以下の様に符号化される。第一
符号化回路103は、S1帯域信号に対してDCT符号化を
行う。第二符号化回路104は、S2帯域信号に対してDP
CM符号化を行う。第三符号化回路105は、S3帯域信号
に対してPCM符号化を行う。第四符号化回路106は、
4帯域信号に対してPCM符号化を行う。そしてマル
チプレクサ回路108は、第一符号化回路103、第二符号化
回路104、第三符号化回路105、第四符号化回路106によ
り符号化された信号を多重化して信号出力端子109に出
力する。
The audio signal input from the signal input terminal 101 is divided by the band dividing circuit 102 into four bands of S 1 , S 2 , S 3 and S 4 from the low frequency band. The divided four band signals are coded as follows. The first encoding circuit 103 performs DCT encoding on the S 1 band signal. The second encoding circuit 104 uses DP for the S 2 band signal.
CM coding is performed. The third encoding circuit 105 performs PCM encoding on the S 3 band signal. The fourth encoding circuit 106,
PCM encoding is performed on the S 4 band signal. The multiplexer circuit 108 multiplexes the signals encoded by the first encoding circuit 103, the second encoding circuit 104, the third encoding circuit 105, and the fourth encoding circuit 106, and outputs the multiplexed signal to the signal output terminal 109. .

【0011】以下、符号化量制御回路107が出力する符
号量制御信号が量子化幅とする場合の例を示すが、本発
明はこれにのみ限定される訳ではなく、可変長テーブル
を変更させる信号等、符号化量を制御できるものなら構
わない。符号化量制御回路107は、第一符号化回路103、
第二符号化回路104、第三符号化回路105、第四符号化回
路106から時間間隔t間に生じた符号化歪の量を受け取
る。今、仮にそれらをD1、D2、D3、D4とする。
1、S2、S3、S4の4つの帯域には予めK1、K2、K
3、K4という重み付け係数を有しており、符号化量制御
回路107は、D1×K 1、D2×K2、D3×K3、D4×K4
を計算して歪の大きい順に優先順位をつける。その結
果、S2、S1、S4、S3の帯域の順であったとする。更
に符号化量制御回路107は、現在のバッファ内容量と間
隔tの間に変化したバッファ内容量をマルチプレクサ回
路108 から受け取る。今、仮にその容量をそれぞれ5.5M
bit、+11000bitとする。また時間間隔tだけ前の符号量
制御信号、ここでは量子化幅であるが、これが第一符号
化回路103には8で、第二符号化回路104に10で、第三符
号化回路105は8で、第四符号化回路106は13であったと
する。
The code output from the coding amount control circuit 107 will be described below.
An example in which the signal control signal has a quantization width is shown below.
Ming is not limited to this, variable length table
If you can control the amount of coding, such as a signal that changes
I don't know. The coding amount control circuit 107 includes a first coding circuit 103,
Second encoding circuit 104, third encoding circuit 105, fourth encoding circuit
Receives from path 106 the amount of coding distortion that has occurred during time interval t.
It Now suppose they D1, D2, D3, DFourAnd
S1, S2, S3, SFourK in advance for the four bands1, K2, K
3, KFourHas a weighting coefficient of
Circuit 107 is D1× K 1, D2× K2, D3× K3, DFour× KFour
Is calculated, and the priority is given in the order of the largest distortion. That conclusion
Fruit, S2, S1, SFour, S3It is assumed that the order of the bands is. Change
The coding amount control circuit 107
The buffer capacity changed during the interval t
Take from road 108. Now suppose that capacity is 5.5M each
bit and +11000 bit. Also, the code amount before the time interval t
The control signal, here the quantization width, is the first code
8 for the encoding circuit 103, 10 for the second encoding circuit 104, and 3 for the third encoding circuit.
The encoding circuit 105 was 8 and the fourth encoding circuit 106 was 13.
To do.

【0012】図2は、バッファ内容量とバッファ変化量
による優先順位毎の量子化幅の増減を示す図である。図
2から、バッファ内容量5.5Mbit 、変化量が +11000bit
であれば優先順位の上位3帯域が量子化幅を変更するこ
とが分かり、S2、S1、S4の3帯域が選択され、各々
量子化幅を1だけ大きくする。図3は、バッファ内容量
に対して S1の帯域がとりうる量子化幅の範囲を黒くぬ
って示してある図である。この図3から、S1の帯域が
バッファ内容量5.5Mbit の場合、量子化幅が4〜13の
範囲に限定されていることが分かるが、範囲内に収まっ
ているので変更はされない。以上の判定を行ないマルチ
プレクサ回路108は、量子化幅を第一符号化回路103に9
を、第二符号化回路104に11を、第四符号化回路106に14
を送出し、第三符号化回路105にt間前と同じ8を送出
する。但しS1以外の帯域が、S 1の帯域の量子化幅以下
にはならないという条件がついている場合には、S3
帯域の量子化幅は9となり第三符号化回路105に量子化
幅9を送出する。
FIG. 2 shows the buffer capacity and the buffer change amount.
FIG. 7 is a diagram showing increase / decrease in quantization width for each priority order according to FIG. Figure
From 2, the buffer capacity is 5.5 Mbit, the change amount is + 11000bit
If so, the three highest priority bands can change the quantization width.
And S2, S1, SFour3 bands are selected, each
Increase the quantization width by 1. Figure 3 shows the buffer capacity
Against S1Black out the range of quantization width that the band of
FIG. From this FIG. 3, S1The bandwidth of
If the buffer capacity is 5.5 Mbit, the quantization width is 4 to 13
You can see that it is limited to the range, but it is within the range
Therefore, it is not changed. The above judgment is performed
The plexer circuit 108 outputs the quantization width to the first encoding circuit 103 by 9
To the second encoding circuit 104 and 14 to the fourth encoding circuit 106.
Is sent, and the same 8 as before t is sent to the third encoding circuit 105.
To do. However, S1Bands other than S 1Below the quantization width of the band
If the condition is not satisfied, S3of
The quantization width of the band becomes 9 and is quantized by the third encoding circuit 105.
Send a width of 9.

【0013】なお、本実施例においては入力信号をオー
ディオ信号とし、帯域分割数を4帯域としており、更に
符号化回路の符号化方法をDCT,DPCM,PCMと
したが本発明はこれらのみに限定されるものではなく、
他の信号や帯域数、符号化方法であってもかまわない。
また量子化幅を1〜16に設定して、図2の様に優先順
位が決定され、図3の様にバッファ内容量に対する符号
量制御信号の制限を行なっているがこれにのみ限定され
るものではない。更に優先順位を決定する方法、優先順
位から符号化量制御信号を決定する方法もこれにのみ限
定されるものではない。
In this embodiment, the input signal is an audio signal, the number of band divisions is 4, and the coding method of the coding circuit is DCT, DPCM, PCM, but the present invention is limited to these. Not what is done,
Other signals, number of bands, and encoding method may be used.
Further, by setting the quantization width to 1 to 16, the priority is determined as shown in FIG. 2 and the code amount control signal for the capacity in the buffer is limited as shown in FIG. 3, but it is limited to this. Not a thing. Furthermore, the method of determining the priority order and the method of determining the coding amount control signal from the priority order are not limited to this.

【0014】[0014]

【発明の効果】以上のように本発明によれば、限られた
バッファ内容量の中で、各帯域に優先順位をつける手段
を有し、その優先順位により各帯域の符号量を決めるこ
とにより、符号化によるビット発生量を帯域間で調整で
き、視聴覚特性的に高品質な信号を保持することができ
る。
As described above, according to the present invention, there is provided means for prioritizing each band within the limited buffer capacity, and the code amount of each band is determined by the priority. The amount of bits generated by encoding can be adjusted between bands, and a high-quality signal can be held in terms of audiovisual characteristics.

【0015】更に、バッファ内容量に対する符号量制御
信号の制限を行うことでバッファのオーバーフロー、ア
ンダーフローをさせずに符号量を制御できる。
Further, by limiting the code amount control signal with respect to the capacity in the buffer, the code amount can be controlled without causing overflow or underflow of the buffer.

【図面の簡単な説明】[Brief description of drawings]

【図1】本発明の帯域分割符号化方法の一実施例の帯域
分割符号化装置の構成を示すブロック図
FIG. 1 is a block diagram showing a configuration of a band division encoding apparatus according to an embodiment of a band division encoding method of the present invention.

【図2】本発明の帯域分割符号化方法の一実施例を示す
説明図
FIG. 2 is an explanatory diagram showing an embodiment of a band division encoding method of the present invention.

【図3】本発明の帯域分割符号化方法の一実施例を示す
説明図
FIG. 3 is an explanatory diagram showing an embodiment of a band division encoding method of the present invention.

【図4】従来の帯域分割符号化方法の帯域分割符号化装
置の構成を示すブロック図
FIG. 4 is a block diagram showing a configuration of a conventional band division encoding device of a band division encoding method.

【符号の説明】[Explanation of symbols]

102 帯域分割回路 103 第一符号化回路 104 第二符号化回路 105 第三符号化回路 106 第四符号化回路 107 符号化量制御回路 108 マルチプレクサ回路 102 band division circuit 103 first encoding circuit 104 second encoding circuit 105 third encoding circuit 106 fourth encoding circuit 107 encoding amount control circuit 108 multiplexer circuit

Claims (4)

【特許請求の範囲】[Claims] 【請求項1】入力信号を複数の周波数帯域に分割して符
号化を行う帯域分割符号化方法において、転送速度を制
御するためにバッファと、前記バッファ内容量を予め定
められた時間間隔tで監視し、前記間隔tで観測された
各帯域の符号化歪量を用いて各帯域に優先順位をつける
手段とを有し、前記優先順位、前記バッファ内容量、及
び前記バッファ内容量の変化量から所定の方法で各帯域
の符号量を決める符号量制御信号を各帯域毎に送出する
ことにより符号化量を制御することを特徴とする帯域分
割符号化方法。
1. A band division encoding method for dividing an input signal into a plurality of frequency bands for encoding, and a buffer for controlling a transfer rate and a capacity in the buffer at a predetermined time interval t. Means for prioritizing each band by using the coding distortion amount of each band observed at the interval t, and monitoring the priority, the buffer capacity, and the change amount of the buffer capacity. A band division coding method, wherein the coding amount is controlled by transmitting a code amount control signal for determining the code amount of each band by a predetermined method for each band.
【請求項2】各帯域の符号化歪量に所定の重み付け係数
を掛け合わせて大きいものから順に優先順位をつけ、現
在のバッファ内容量と間隔tのバッファ内容変化量から
前記優先順位の高い特定の帯域を決定して、前記特定の
帯域だけ時間間隔t前に送出した符号量制御信号と異な
った符号量制御信号を送出することを特徴とする請求項
1記載の帯域分割符号化方法。
2. A coding weighting amount of each band is multiplied by a predetermined weighting coefficient to give a priority order in descending order, and the high priority order is specified from the current buffer capacity and the buffer content change amount at the interval t. 2. The band division encoding method according to claim 1, wherein the code amount control signal different from the code amount control signal transmitted by the specific band before the time interval t is transmitted.
【請求項3】符号量制御信号のとりうる範囲が、現バッ
ファ内容量によって一定範囲内に特定されることを特徴
とする請求項2記載の帯域分割符号化方法。
3. The band division encoding method according to claim 2, wherein the range that the code amount control signal can take is specified within a certain range by the capacity in the current buffer.
【請求項4】符号量制御信号は量子化幅で与えられ、最
も低い周波数帯域以外の帯域が受け取る前記量子化幅
は、最も低い周波数帯域が受け取る量子化幅以下になら
ないことを特徴とする請求項3記載の帯域分割符号化方
法。
4. The code amount control signal is given by a quantization width, and the quantization width received by a band other than the lowest frequency band is not less than a quantization width received by the lowest frequency band. Item 4. The band division encoding method according to Item 3.
JP4306699A 1992-11-17 1992-11-17 Band division encoding method Pending JPH06164409A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP4306699A JPH06164409A (en) 1992-11-17 1992-11-17 Band division encoding method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP4306699A JPH06164409A (en) 1992-11-17 1992-11-17 Band division encoding method

Publications (1)

Publication Number Publication Date
JPH06164409A true JPH06164409A (en) 1994-06-10

Family

ID=17960246

Family Applications (1)

Application Number Title Priority Date Filing Date
JP4306699A Pending JPH06164409A (en) 1992-11-17 1992-11-17 Band division encoding method

Country Status (1)

Country Link
JP (1) JPH06164409A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100381372B1 (en) * 2001-06-15 2003-04-26 주식회사 엑스텔테크놀러지 Apparatus for feature extraction of speech signals
KR100391935B1 (en) * 1998-12-28 2003-07-16 프라운호퍼-게젤샤프트 츄어 푀르더룽 데어 안게반텐 포르슝에.파우. Method and devices for coding or decoding and audio signal of bit stream
US10951891B2 (en) 2017-10-05 2021-03-16 Canon Kabushiki Kaisha Coding apparatus capable of recording raw image, control method therefor, and storage medium storing control program therefor

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100391935B1 (en) * 1998-12-28 2003-07-16 프라운호퍼-게젤샤프트 츄어 푀르더룽 데어 안게반텐 포르슝에.파우. Method and devices for coding or decoding and audio signal of bit stream
KR100381372B1 (en) * 2001-06-15 2003-04-26 주식회사 엑스텔테크놀러지 Apparatus for feature extraction of speech signals
US10951891B2 (en) 2017-10-05 2021-03-16 Canon Kabushiki Kaisha Coding apparatus capable of recording raw image, control method therefor, and storage medium storing control program therefor

Similar Documents

Publication Publication Date Title
AU650219B2 (en) Statistical multiplexer for a multichannel image compression system
KR20050084400A (en) Adaptive encoding of digital multimedia information
KR970701984A (en) Buffer management in variable bit-rate compression systems
JPH05122166A (en) Method of coding signal
EP0708566B1 (en) Method and system for controlling a video data encoder buffer
JPH0730589A (en) Data transmitter
EP0665547B1 (en) Encoding and decoding system
US5893065A (en) Apparatus for compressing audio data
JPH06164409A (en) Band division encoding method
JPH07250103A (en) Communication system for time-series information
JPH0669811A (en) Encoding circuit and decoding circuit
JP2868646B2 (en) Image signal encoding device
JPH09312625A (en) Data multiplexer and its method
WO1997038532A1 (en) Buffer control in a coded data transmission system
EP0803989B1 (en) Method and apparatus for encoding of a digitalized audio signal
JP2868633B2 (en) Video encoding device
JP3364335B2 (en) Multi-program encoder / transmitter with bit rate control function
JPH066779A (en) Band division encoding method
JPH0686253A (en) Moving image data transmitter
JP2687681B2 (en) Image coding device
JPH0242835A (en) Method and device for decoding band division type code
JPH09325797A (en) Coding method for multi-channel audio data and its coding device
JPH0151117B2 (en)
JPH06291672A (en) Band dividing and encoding device
JPH05252050A (en) Information transmitter

Legal Events

Date Code Title Description
FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 6

Free format text: PAYMENT UNTIL: 20090620

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 7

Free format text: PAYMENT UNTIL: 20100620

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100620

Year of fee payment: 7

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110620

Year of fee payment: 8

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120620

Year of fee payment: 9

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120620

Year of fee payment: 9

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130620

Year of fee payment: 10

LAPS Cancellation because of no payment of annual fees