Nothing Special   »   [go: up one dir, main page]

WO2010003557A1 - Apparatus and method for generating a bandwidth extended signal - Google Patents

Apparatus and method for generating a bandwidth extended signal Download PDF

Info

Publication number
WO2010003557A1
WO2010003557A1 PCT/EP2009/004603 EP2009004603W WO2010003557A1 WO 2010003557 A1 WO2010003557 A1 WO 2010003557A1 EP 2009004603 W EP2009004603 W EP 2009004603W WO 2010003557 A1 WO2010003557 A1 WO 2010003557A1
Authority
WO
WIPO (PCT)
Prior art keywords
patch
input signal
band
signal
patching algorithm
Prior art date
Application number
PCT/EP2009/004603
Other languages
French (fr)
Inventor
Frederik Nagel
Sascha Disch
Max Neuendorf
Stefan Bayer
Marc Gayer
Markus Lohwasser
Nikolaus Rettelbach
Ulrich Krämer
Original Assignee
Frauenhofer- Gesellschaft Zur Förderung Der Angewandten Forschung E. V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to BR122017003818-4A priority Critical patent/BR122017003818B1/en
Priority to ES09776840.2T priority patent/ES2461141T3/en
Priority to EP09776840.2A priority patent/EP2291842B1/en
Priority to KR1020117000441A priority patent/KR101239812B1/en
Priority to AU2009267460A priority patent/AU2009267460B2/en
Priority to BRPI0910528-0A priority patent/BRPI0910528B1/en
Priority to MX2011000365A priority patent/MX2011000365A/en
Priority to CN2009801270931A priority patent/CN102105931B/en
Priority to PL09776840T priority patent/PL2291842T3/en
Priority to JP2011516992A priority patent/JP5255699B2/en
Application filed by Frauenhofer- Gesellschaft Zur Förderung Der Angewandten Forschung E. V. filed Critical Frauenhofer- Gesellschaft Zur Förderung Der Angewandten Forschung E. V.
Priority to CA2729474A priority patent/CA2729474C/en
Priority to RU2011100134/08A priority patent/RU2512090C2/en
Priority to TW098122551A priority patent/TWI415116B/en
Priority to ARP090102552A priority patent/AR072483A1/en
Publication of WO2010003557A1 publication Critical patent/WO2010003557A1/en
Priority to ZA2010/09164A priority patent/ZA201009164B/en
Priority to US13/004,314 priority patent/US8880410B2/en
Priority to HK11108364.8A priority patent/HK1154112A1/en
Priority to US15/341,763 priority patent/USRE47180E1/en
Priority to US16/230,764 priority patent/USRE49801E1/en
Priority to US18/342,715 priority patent/US20230343357A1/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/038Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation

Definitions

  • Embodiments according to the invention relate to audio signal processing and, in particular, to an apparatus and a method for generating a bandwidth extended signal from an input signal, an apparatus and a method for providing a bandwidth reduced signal based on an input signal and an audio signal.
  • Perceptually adapted coding of audio signals providing a substantial data rate reduction for efficient storage and transmission of these signals, has gained wide acceptance in many fields.
  • Many coding algorithms are known, e.g., MPEG 1/2 Layer 3 ("MP3") or MPEG 4 AAC (Advanced Audio Coding).
  • MP3 MPEG 1/2 Layer 3
  • MPEG 4 AAC Advanced Audio Coding
  • the synthesis filterbank belonging to a special analysis filterbank receives bandpass signals of the audio signal in the lower band and envelope-adjusted bandpass signals of the lower band which are harmonically patched into the upper band.
  • the output signal of the synthesis filterbank is an audio signal extended with regard to its original bandwidth which is transmitted from the encoder side to the decoder side by the core coder operating a very low data rate.
  • filterbank calculations and patching in the filterbank domain may become a high computational effort.
  • phase vocoder for bandwidth extension.
  • frequency lines move further apart from each other. If gaps exist in the spectrum, e.g. by quantization, the same are even increased by the spreading. In an energy adaption, remaining lines in the spectrum receive too much energy compared to the respective lines in the original signal.
  • Fig. 13 shows a schematic illustration of a bandwidth extension 1300 using a phase vocoder.
  • two patches 1312, 1314 are added to a low frequency band 1302 of a signal.
  • the upper cut-off frequency 1320 of the signal also called Xover frequency (crossover frequency) is the low-end frequency of the neighboring patch 1312 and the double of the x-over frequency is the upper cut-off frequency of the neighboring patch 1312 and the lower cut-off frequency of the next patch 1314.
  • the phase vocoder doubles the frequency of the frequency lines of the low frequency band 1302 of the signal to obtain the neighboring patch 1312 and triples the frequencies of the frequency lines of the low frequency band 1302 of the signal to obtain the next patch 1314.
  • a spectral density of the neighboring patch 1312 is only half of a spectral density of the low frequency band 1302 of the signal and the spectral density of the next patch 1314 is only one third of the spectral density of the low frequency band 1302 of the signal.
  • phase vocoders Some examples for phase vocoders and their applications are presented in "Frederik Nagel and Sascha Disch, A Harmonic Bandwidth Extension Method for Audio Codecs," ICASSP'09 and “M. Puckette. Phase-locked Vocoder. IEEE ASSP Conference on Applications of Signal Processing to Audio and Acoustics, Mohonk 1995.”, R ⁇ bel, A.: Transient detection and preservation in the phase vocoder; citeseer.ist.psu.edu/679246.html”, “Laroche L., Dolson M.: Improved phase vocoder timescale modification of audio", IEEE Trans. Speech and Audio Processing, Vol. 7, No. 3, pp. 323—332” and United States Patent 6549884.
  • WO 00/45379 contains a method and an apparatus for enhancement of source coding systems utilizing high frequency reconstruction.
  • the application addresses the problem of insufficient noise contents in a reconstructed highband by adaptive noise-floor addition. Adding noise may fill the gaps, but the audio quality or subjective quality may not be increased sufficiently.
  • An embodiment of the invention provides an apparatus for generating a bandwidth extended signal from an input signal.
  • the input signal is represented, for a first band by a first resolution data and for a second band by a second resolution data, the second resolution being lower than the first resolution.
  • the apparatus comprises a patch generator and a combiner.
  • the patch generator is configured to generate a first patch from the first band of the input signal according to a first patching algorithm and configured to generate a second patch from the first band of the input signal according to a second patching algorithm.
  • a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm.
  • the combiner is configured to combine the first patch, the second patch and the first band of the input signal to obtain the bandwidth extended signal.
  • the apparatus for generating a bandwidth extended signal is configured to scale the input signal according to the first patching algorithm and according to the second patching algorithm or to scale the first patch and the second patch, so that the bandwidth extended signal fulfils a spectral envelope criterion.
  • Embodiments according to the present invention are based on the central idea that a patch with low spectral density (which means, for example, the patch comprises gaps in comparison to a low frequency band of the input signal) is combined with a patch with high spectral density (which means, for example, the patch comprises only few gaps or no gaps in comparison with the low frequency band of the input signal) for extending the bandwidth of an input signal. Since both patches are generated based on the input signal, the high frequency bandwidth extension of the low frequency band of the input signal may provide a good approximation of the original audio signal.
  • the first and the second patch may be scaled before (by scaling the input signal) or after generation to fulfill a spectral envelope criterion, since the spectral envelope of the original audio signal should be considered for the reconstruction of the high frequency band of the input signal. In this way, the subjective quality or the audio quality of the bandwidth extended signal may be significantly increased.
  • the first patching algorithm is a harmonic patching algorithm.
  • the first patch is generated so that only frequencies that are integer multiples of frequencies of the first band of the input signal are contained by the first patch.
  • the second patching algorithm may be a mixing patching algorithm. This means, for example, that the second patch may be generated, so that the second patch contains frequencies that are integer multiples of frequencies of the first band of the input signal and frequencies that are not integer multiples of frequencies of the first band of the input signal. Therefore, the spectral density of the second patch is higher than the spectral density of the first patch.
  • missing frequency lines of the first patch may be filled by frequency lines of the second patch. In this way, the gaps of the harmonic bandwidth extension according to the first patching algorithm may be filled by the second patch and the audio quality of the bandwidth extended signal may be significantly improved.
  • Some embodiments according to the invention relate to an apparatus for providing a bandwidth reduced signal based on an input signal.
  • the apparatus comprises a spectral envelope data determiner, a patch scaling control data generator, and an output interface.
  • the spectral envelope data determiner is configured to determine spectral envelope data based on the high frequency band of the input signal.
  • the patch scaling control data generator is configured to generate patch scaling control data for scaling the bandwidth reduced signal at the decoder or for scaling a first patch and a second patch by the decoder, so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion.
  • the spectral envelope criterion is based on the spectral envelope data.
  • the first patch is generated from a low frequency band of the bandwidth reduced signal according to a first patch algorithm and the second patch is generated from the low frequency band of the bandwidth reduced signal according to a second patching algorithm.
  • a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm.
  • the output interface is configured to combine a low frequency band of the input signal, the spectral envelope data, and the power scaling control data to obtain the bandwidth reduced signal. Further, the output interface is configured to provide the bandwidth reduced signal for transmission or storage.
  • Some further embodiments according to the invention relate to an audio signal comprising a first band and a second band.
  • the first band is represented by a first resolution data and the second band is represented by a second resolution data.
  • the second resolution is lower than the first resolution.
  • the second resolution data is based on spectral envelope data of the second band and patch-scaling control data of the second band for scaling the audio signal at a decoder or for scaling a first patch and a second patch by the decoder, so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion.
  • the spectral envelope criterion is based on the spectral envelope data.
  • the first patch is generated from the first band of the audio signal according to a first patching algorithm and the second patch is generated from the first band of the audio signal according to a second patching algorithm.
  • a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generator according to the first patching algorithm.
  • Fig. 1 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal
  • Fig. 2a is a schematic illustration of a generated first patch
  • Fig. 2b is a schematic illustration of a generated first and second patch
  • Fig. 3a is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal
  • Fig. 3b is a schematic illustration of a clipped sinusoidal input signal
  • Fig. 3c is a schematic illustration of a half wave rectified sinusoidal input signal
  • Fig. 3d is a schematic illustration of a clipped and full wave rectified sinusoidal input signal
  • Fig. 4 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal
  • Fig. 5a is a schematic illustration of a filterbank implementation of a phase vocoder
  • Fig. 5b is a detailed illustration of a filter of Fig. 5a;
  • Fig. 5c is a schematic illustration for the manipulation of the magnitude signal and the frequency signal in a filter channel of Fig. 5a;
  • Fig. 6 is a schematic illustration of a transformation implementation of a phase vocoder
  • Fig. 7 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal
  • Fig. 8 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal
  • Fig. 9 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal
  • Fig. 10 is a block diagram of an apparatus for providing a bandwidth reduced signal based on an input signal
  • Fig. 1 1 is a flow chart of a method for generating a bandwidth extended signal from an input signal
  • Fig. 12 is a flow chart of a method for providing a bandwidth reduced signal based on an input signal
  • Fig. 13 is a schematic illustration of a known bandwidth extension algorithm.
  • Fig. 1 shows a block diagram of an apparatus 100 for generating a bandwidth extended signal 122 for an input signal 102 according to an embodiment of the invention.
  • the input signal 102 is represented, for a first band by a first resolution data, and for a second band by a second resolution data, the second resolution being lower than the first resolution.
  • the apparatus 100 comprises a patch generator 110 connected to a combiner 120.
  • the patch generator 120 generates a first patch 112 from the first band of the input signal 102 according to a first patching algorithm and generates a second patch 114 from the first band of the input signal 102 according to a second patching algorithm.
  • a spectral density of the second patch 114 generated according to the second patching algorithm is higher than a spectral density of the first patch 112 generated according to the first patching algorithm.
  • the combiner 120 combines the first patch 1 12, the second patch 114 and the first band of the input signal 102 to obtain the bandwidth extended signal 122.
  • the apparatus 100 for generating a bandwidth extended signal 122 scales the input signal 102 according to the first patching algorithm and according to the second patching algorithm or scales the first patch 1 12 and the second patch 1 14 so that the bandwidth extended signal 122 fulfills a spectral envelope criterion.
  • Spectral density means, for example, the density of different frequencies or frequency lines within a frequency band. For example, a frequency band reaching from OHz to lOkHz comprising frequency portions with frequencies of 4kHz and 8kHz has a lower spectral density than the same frequency band comprising frequency portions with frequencies of 2kHz, 4kHz, 6kHz, 8kHz and 10kHz. Since the spectral density of the first patch 112 is lower than the spectral density of the second patch 114, the first patch 112 comprises gaps in comparison with the second patch 114. Therefore, the second patch 114 may be used to fill these gaps. Since both patches are based on the first band of the input signal 102, both patches are related to the characteristic of the original signal corresponding to the input signal 102.
  • the bandwidth extended signal 122 may be a good approximation of the original signal and the subjective quality or the audio quality of the bandwidth extension signal 122 may be significantly improved by using the described concept. In this way, more energy may be distributed between the remaining lines and, for example, a unnatural sound may be avoided.
  • the first patching algorithm may be a harmonic patching algorithm. Therefore, the patch generator 110 may generate the first patch 112 comprising only frequencies that are integer multiples of frequencies of the first band of the input signal 102.
  • a harmonic bandwidth extension may provide a good approximation of the tonal structure of the original signal, but this patching algorithm will leave gaps between the harmonic frequencies. These gaps may be filled by the second patch.
  • the second patching algorithm may be a mixing patching algorithm, which means that the patch generator 110 may generate the second patch 114 comprising integer multiples of frequencies of the first band of the input signal 102 (harmonic frequencies) and frequencies that are not integer multiples of the frequencies of the first band of the input signal 102 (non-harmonic frequencies).
  • the non-harmonic frequencies may be used for filling the gaps of the first patch 1 12. It may also be possible to combine the whole second patch 114 (including the harmonic frequencies) with the first patch 112. In this example, an amplification of the harmonic frequencies due to the combination of the harmonic frequency portions of the first patch 112 and the second patch 1 14 may be taken into account by appropriately scaling the first patch 112 and/or the second patch 1 14.
  • the first patch 1 12 and the second patch 114 comprise at least partly the same frequency range.
  • the first patch 1 12 comprises a frequency band reaching from 4kHz to 8kHz and the second patch 114 comprises a frequency band from 6kHz to 1 OkHz.
  • a lower cut of frequency of the first patch is equal to a lower cut of frequency of the second patch and an upper cut of frequency of the first patch 112 is equal to an upper cut of frequency of the second patch 114.
  • both patches comprise a frequency band reaching from 4kHz to 8kHz.
  • Figs. 2a and 2b show an example for a first patch 1 12 according to a first patching algorithm 212 and a second patch 114 according to a second patching algorithm 214.
  • Fig. 2a shows only the first patches 1 12
  • Fig. 2b shows the first patches 1 12 and the corresponding second patches 114.
  • Fig. 2a illustrates an example 200 for the first band 202 of the input signal 102 and two first patches 112 generated according to the first patching algorithm 212.
  • a patch comprises the same bandwidth as the first band 202 of the input signal 102.
  • the bandwidth may also be different.
  • the upper cut-off frequency 220 of the first band 202 of the input signal 102 is denoted 'Xover' frequency (crossover frequency).
  • patches start at a frequency equal to a multiple of the crossover frequency Xover 220.
  • the frequency lines within the first patches 112 are integer multiples of the frequency lines of the first band 202 of the input signal 102 and may, for example, be generated by a phase vocoder.
  • These first patches 1 12 comprise gaps in terms of missing frequency lines in comparison to the first band 202 of the input signal 102.
  • Fig. 2b additionally shows an example 250 for the two corresponding second patches 114.
  • These patches are generated according to the second patching algorithm 214 and comprise harmonic and non-harmonic frequencies.
  • the non-harmonic frequency lines may be used to fill the gaps of the first patches 112.
  • the frequency lines of the second patches 114 may be generated, for example, by a non-linear distortion.
  • the gaps may not be filled arbitrarily as, for example, by filling the gaps with noise.
  • the gaps are filled based on the first resolution data of the first band of the input signal and, therefore, based on the original signal.
  • the first band of the input signal 102 may represent, for example, the low frequency band of an original audio signal encoded with high resolution.
  • the second band of the input signal 102 may represent, for example, a high frequency band of the original audio signal and may be quantized by one or more parameters as, for example, spectral envelope data, noise data and/or missing harmonic data with low resolution.
  • An original audio signal may be, for example, an audio signal recorded by a microphone before processing or encoding.
  • Scaling the input signal according to the first patching algorithm and according to the second patching algorithm means, for example, that the input signal is scaled once according to the first patching algorithm before the first patch is generated and then the first patch is generated based on the scaled input signal, and that the input signal is scaled once according to the second patching algorithm before the second patch is generated and then the second patch is generated based on the scaled input signal, so that after the combination of the first patch, the second patch and the first band of the input signal, the bandwidth extended signal fulfills a spectral envelope criterion.
  • the first patch and the second patch are scaled after their generation, so that the bandwidth extended signal also fulfills a spectral envelope criterion.
  • a scaling of the input signal according to the first patching algorithm and according to the second patching algorithm in combination with a scaling of the first patch and the second patch may be possible.
  • the combiner 120 may be, for example, an adder and the bandwidth extended signal 122 may be a weighted sum of the first patch 112, the second patch 1 14 and the first band of the input signal 102.
  • Fulfilling a spectral envelope criterion means, for example, that a spectral envelope of the bandwidth extended signal is based on a spectral envelope data contained by the input signal.
  • the spectral envelope data may be generated by an encoder and may represent the second band of an original signal. In this way, the spectral envelope of the bandwidth extended signal may be a good approximation of the spectral envelope of the original signal.
  • the apparatus 100 may also comprise a core decoder for decoding the first band of the input signal 102.
  • the patch generator 110 and the combiner 120 may be, or example, specially designed hardware or part of a processor or micro controller or may be a computer program configured to run on a computer or a micro controller.
  • the apparatus 100 may be part of a decoder or an audio decoder.
  • Fig. 3a shows a block diagram of an apparatus 300 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention.
  • the patch generator 110 comprises a phase vocoder 310 for generating the first patch and an amplitude clipper 320 for generating the second patch 114.
  • the phase vocoder 310 and the amplitude clipper 320 are connected to the combiner 120.
  • the phase vocoder 310 may spread the first band of the input audio signal 102 to generate the first patch 112 comprising harmonic frequencies.
  • the amplitude clipper 320 may clip the input signal 102 to generate the second patch 114 comprising harmonic and non-harmonic frequencies.
  • a half-wave rectifier, a full-wave rectifier, a mixer or a diode used in the quadratic region of the characteristic curve may be used to generate non-harmonic frequencies based on the input signal 102 by a non-linear processing step.
  • Figs. 3b, 3c and 3d show examples for clipped and/or rectified input signals 102 to generate non-harmonic frequencies.
  • Fig. 3b shows a schematic illustration 350 of a clipped sinusoidal input signal 102. By clipping the signal, points of discontinuity in the form of abrupt changes of the signal slope 380 are caused and harmonic and non-harmonic portions with higher frequencies are generated.
  • Fig. 3c shows a schematic illustration 360 of a half-wave rectified sinusoidal input signal 102, also causing points of discontinuity 380. Further, a combination of clipping and rectifying may be possible.
  • Fig. 3d shows a schematic illustration 370 of a clipped and full-wave rectified sinusoidal input signal 102 causing different points of discontinuity 380.
  • a patch generated according to such a patching algorithm may comprise a high spectral density.
  • Fig. 4 shows a block diagram of an apparatus 400 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention.
  • the apparatus 400 is similar to the apparatus shown in Fig. 3a, but additionally comprises a spectral line selector 410.
  • the phase vocoder 310 and the amplitude clipper 320 are connected to the spectral line selector 410 and the spectral line selector 410 is connected to the combiner 120.
  • the spectral line selector 410 may select a plurality of frequency lines of the second patch 114 to obtain a modified second patch 414 that may be complementary to the first patch.
  • a frequency line of the second patch 114 may be selected if a corresponding frequency line of the first patch 112 is missing.
  • the spectral line selector 410 selects frequency lines of the second patch 114 for filling gaps of the first patch 1 12 and may disregard frequencies of the second patch 114 already contained by the first patch 112. In this way, the modified second patch 414 may comprise gaps at frequencies already contained by the first patch 112.
  • the combiner 120 combines the first patch 1 12, the modified second patch 414 and the first band of the input signal 102.
  • the spectral line selector 410 may be, for example, part of the patch generator 110 (as shown in Fig. 4) or a separate unit.
  • Fig. 5a shows a filterbank implementation of a phase vocoder, wherein an audio signal is fed to an input 500 and obtained at an output 510.
  • each channel of the schematic filterbank illustrated in Fig. 5a includes a bandpass filter 501 and a downstream oscillator 502. Output signals of all oscillators from every channel are combined by a combiner, which is, for example, implemented as an adder and indicated at 503 in order to obtain the output signal.
  • Each filter 501 is implemented such that it provides an amplitude signal on the one hand and a frequency signal on the other hand.
  • the amplitude signal and the frequency signal are time signals illustrating a development of the amplitude in a filter 501 over time, while the frequency signal represents a development of the frequency of the signal filtered by a filter 501.
  • FIG. 5b A schematical setup of filter 501 is illustrated in Fig. 5b.
  • Each filter 501 of Fig. 5a may be set up as in Fig. 5b, wherein, however, only the frequencies fj supplied to the two input mixers 551 and the adder 552 are different from channel to channel.
  • the mixer output signals of the mixers 551 are both lowpass filtered by lowpasses 553, wherein the lowpass signals are different insofar as they were generated by local oscillator frequencies (LO frequencies), which are out of phase by 90°.
  • the upper lowpass filter 553 provides a quadrature signal 554, while the lower filter 553 provides an in-phase signal 555.
  • phase signal is supplied to a phase unwrapper 558. At the output of the element 558, there is no phase value present any more, which is always between 0 and 360°, but a phase value, which increases linearly.
  • phase/frequency converter 559 which may, for example, be implemented as a simple phase difference calculator, which subtracts a phase of a previous point in time from a phase at a current point in time to obtain a frequency value for the current point in time or any other means for obtaining an approximation of a phase derivative.
  • This frequency value is added to the constant frequency value fj of the filter channel i to obtain a temporarily varying frequency value at the output 560.
  • the phase vocoder achieves a separation of the spectral information and the temporal information.
  • the spectral information is contained in the special channel or in the frequency fj, which provides the direct portion of the frequency for each channel, while the temporal information is contained in the frequency deviation or the magnitude evolution over time, respectively.
  • Fig. 5c shows a manipulation as it is executed for the generation of the first patch according to the invention, in particular, using the phase vocoder 310 and, in more detail, inserted at the location of the dashed line of the illustrated circuit in Fig. 5a.
  • time scaling e.g. the amplitude signals A(t) in each channel or the frequency of the signals f(t) in each channel may be decimated or interpolated.
  • an interpolation i.e. a temporal extension or spreading of the signals A(t) and f(t) is performed to obtain spread signals A'(t) and f (t), wherein the interpolation is controlled by the spreading factor 598.
  • the spreading factor can be selected, for example, so that the phase vocoder generates harmonic frequencies.
  • the phase variation i.e. the value before the addition of the constant frequency by the adder 552
  • the frequency of each individual oscillator 502 in Fig. 5a is not changed.
  • the temporal change of the overall audio signal is slowed down, however, i.e. by the factor 2.
  • the result is a temporally spread tone having the original pitch, i.e. the original fundamental wave with its harmonics.
  • the audio signal may be shrunk back to its original duration, e.g. by decimation of a factor 2, while all frequencies are doubled simultaneously. This leads to a pitch transposition by the factor 2 wherein, however, an audio signal is obtained which has the same length as the original audio signal, i.e. the same number of samples.
  • a transformation implementation of a phase vocoder may also be used as depicted in figure 6.
  • the audio signal 698 is fed into an FFT processor, or more generally, into a Short-Time- Fourier-Transformation (STFT) processor 600 as a sequence of time samples.
  • STFT Short-Time- Fourier-Transformation
  • the FFT processor 600 is implemented to perform a temporal windowing of an audio signal in order to then, by means of an subsequent FFT, calculate both a magnitude spectrum and also a phase spectrum, wherein this calculation is performed for successive spectra which are related to blocks of the audio signal that are strongly overlapping.
  • a new spectrum may be calculated, wherein a new spectrum may be calculated also e.g. only for each twentieth new sample.
  • This distance 'a' in samples between two spectra is preferably given by a controller 602.
  • the controller 602 is further implemented to feed an IFFT processor 604 which is implemented to operate in an overlap-add operation.
  • the IFFT processor 604 is implemented such that it performs an inverse Short-Time-Fourier-Transformation by performing one IFFT per spectrum based on a magnitude spectrum and a phase spectrum, in order to then perform an overlap-add operation to obtain the resulting time signal.
  • the overlap add operation is configured to eliminate the blocking effects introduced by the analysis window.
  • a temporal spreading of the time signal is achieved by the distance 'b' between two spectra, as they are processed by the IFFT processor 604, being greater than the distance 'a' between the spectra used in the generation of the FFT spectra.
  • the basic idea is to spread the audio signal by the inverse FFTs simply being spaced further apart than the analysis FFTs. As a result, spectral changes in the synthesized audio signal occur more slowly than in the original audio signal.
  • phase rescaling in block 606 Without a phase rescaling in block 606, this would, however, lead to frequency artifacts.
  • the time interval here is the time interval between successive FFTs.
  • the inverse FFTs are being spaced farther apart from each other, this means that the 45° phase increase occurs across a longer time interval. This means that the frequency of this signal portion was unintentionally modified.
  • the phase is rescaled by exactly the same factor by which the audio signal was spread in time. The phase of each FFT spectral value is thus increased by the factor b/a, so that this unintentional frequency modification is eliminated.
  • the spreading in Fig. 6 is achieved by the distance between two IFFT spectra being greater than the distance between two FFT spectra, i.e. 'b' being greater than 'a', wherein, however, for an artifact prevention a phase rescaling is executed according to the ratio 'b/a'.
  • the distance 'b' can be selected, for example, so that the phase vocoder generates harmonic frequencies.
  • Fig. 7 shows a block diagram of an apparatus 700 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention.
  • the apparatus 700 is similar to the apparatus shown in Fig. 1, but comprises a power controller 710, a first power adjustment means 720 and a second power adjustment means 730.
  • the power controller 710 is connected to the first power adjustment means 720 and to the second power adjustment means 730.
  • the first power adjustment means 720 and the second power adjustment means 730 are connected to the patch generator 110.
  • the power controller 710 may control the scaling of the input signal according to the first and the second patching algorithm based on spectral envelope data contained by the input signal and based on patch scaling control data contained by the input signal.
  • a patch scaling control parameter may be stored by a patch-scaling control parameter memory, which may be part of the power controller 710 or a separate unit.
  • the first power adjustment means 720 may scale the input signal 102 according to the first patching algorithm and the second power adjustment means 730 may scale the input signal 102 according to the second patching algorithm.
  • the input signal 102 may be pre-processed, so that the first and the second patch can be generated, so that the bandwidth extended signal fulfills the spectral envelope criterion.
  • the spectral envelope data may define the spectral envelope of the bandwidth extended signal 122 and the patch scaling control data or patch scaling control parameter may set the ratio between the first patch 112 and the second patch 114 or may set the absolute values of the first patch 112 and/or the second patch 1 14.
  • the first power adjustment means 720 and the second power adjustment means 730 may be part of the power controller 710 or separate units as shown in Fig. 7.
  • the power controller 710 may be part of the patch generator 110 or a separate unit as also shown in Fig. 7.
  • the power adjustment means 720, 730 may be, for example, amplifiers or filters controlled by the power controller 710.
  • FIG. 8 shows a block diagram of an apparatus 800 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention.
  • the apparatus 800 is similar to the apparatus shown in Fig. 7, but the power adjustment means 720, 730 are arranged between the patch generator 110 and the combiner 120.
  • the patch generator 1 10 is connected to the first power adjustment means 720 and connected to the second power adjustment means 730.
  • the first power adjustment means 720 and the second power adjustment means 730 are connected to the combiner 120.
  • the first patch 112 can be scaled by the first power adjustment means 720 according to the first patching algorithm and the second patch 1 14 can be scaled by the second power adjustment means 730 according to the second patching algorithm.
  • the power adjustment means are, again, controlled by the power controller 710 based on the spectral envelope data and the patch scaling control data or the patch scaling control parameter as described before.
  • first one patch may be scaled to realize a predefined ratio (for example, based on the patch scaling control data) between the two patches and then the combined patches are scaled (for example, based on the spectral envelope data) to fulfill the spectral envelope criterion.
  • the patch scaling control data may comprise, for example, a simple factor or a plurality of parameters for a power distribution scaling.
  • the patch scaling control data may indicate, for example, a power ratio between the first patch and the second patch over the full second band or full high frequency band or an absolute value for the power of the first patch and/or the second patch over the full second band or full high band and may be represented by at least one parameter.
  • the patch scaling data comprises a factor for each of a plurality of subbands together constituting the second band or high frequency band, e.g. similar to the spectral envelope data per subband in spectral bandwidth replication applications.
  • the patch scaling data may also indicate a transfer function of a filter.
  • parameters of a transfer function of a filter for scaling the first patch and/or parameters of a transfer function of a filter for scaling the second patch may be contained in the input signal.
  • the parameters may represent a function of frequency.
  • Another alternative may be patch scaling control parameters representing a differential function of the first patch and the second patch.
  • the scaling of the input signal or the scaling of the first patch and the second patch may be based on the patch scaling control data comprising at least one parameter.
  • Fig. 9 shows a block diagram of an apparatus 900 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention.
  • the apparatus 900 is similar to the apparatus shown in Fig. 8, but comprises additionally a noise adder 910, a missing harmonic adder 920, a noise power adjustment means 940 and a missing harmonic power adjustment means 950.
  • the noise adder 910 is connected to the noise power adjustment means 940, which is connected to the combiner 120.
  • the missing harmonic adder 920 is connected to the missing harmonic power adjustment means 950, which is connected to the combiner 120.
  • the power controller 710 is connected to the noise power adjustment means 940 and the missing harmonic power adjustment means 950.
  • the noise adder 910 may generate a noise patch 912 based on a noise data contained by the input signal 102.
  • the noise patch 912 may be scaled by the noise power adjustment means 940.
  • the power controller 710 may control the noise power adjustment means 940 based on the spectral envelope data and/or noise scaling data contained in the input signal 102. In this way, the noise of an original signal may be approximated to improve the audio quality of the bandwidth extended signal.
  • the missing harmonic adder 920 may generate a missing harmonic patch 922 based on a missing harmonic data contained in the input signal.
  • the missing harmonic patch 922 may contain harmonic frequencies, which may only occur in the high frequency band of the original signal and, therefore, cannot be reproduced, if only the information of the low frequency band of the original signal in terms of the first band of the input signal 102 is available.
  • the missing harmonic data may provide information about these missing harmonics.
  • the missing harmonic patch 922 may be scaled by the missing harmonic power adjustment means 950.
  • the power controller 710 may control the missing harmonic power adjustment means 950 based on the spectral envelope data or based on a missing harmonic scaling data contained by the
  • the combiner 120 may combine the first patch 112, the second patch 114, the first band of the input signal 102, the noise patch 912 and the missing harmonic patch 922 to obtain the bandwidth extended signal 122.
  • the power controller 710 in combination with the power adjustment means, may scale the first patch 112, the second patch 114, the noise patch 912 and the missing harmonic patch 922 based on the spectral envelope data, so that the spectral envelope criterion is fulfilled.
  • Fig. 10 shows a block diagram of an apparatus 1000 for providing a bandwidth reduced signal 1032 based on an input signal 1002 according to an embodiment of the invention.
  • the apparatus 1000 comprises a spectral envelope data determiner 1010, a patch scaling control data generator 1020 and an output interface 1030.
  • the spectral envelope data determiner 1010 and the patch scaling control data generator 1020 are connected to the output interface 1030.
  • the spectral envelope data determiner 1010 may determine spectral envelope data 1012 based on a high frequency band of the input signal 1002.
  • the patch scaling control data generator 1020 may generate patch scaling control data 1022 for scaling the bandwidth reduced signal 1032 at a decoder or for scaling a first patch and a second patch by the decoder so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion.
  • the spectral envelope criterion is based on the spectral envelope data.
  • the first patch is generated from a first band of the bandwidth reduced signal 1032 according to a first patching algorithm and the second patch is generated from the first band of the bandwidth reduced signal 1032 according to a second patching algorithm.
  • a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm.
  • the output interface 1030 combines a low frequency band of the input signal 1002, the spectral envelope data 1012 and the patch scaling control data 1022 to obtain the bandwidth reduced signal 1032. Further, the output interface 1030 provides the bandwidth reduced signal 1032 for transmission or storage.
  • the apparatus 1000 may also comprise a core coder for encoding the low frequency band of the input signal.
  • the core encoder may be, for example, a differential encoder, an entropy encoder or a perceptual audio encoder.
  • the apparatus 1000 may be part of an encoder configured to provide a signal for a decoder described above.
  • the patch scaling control data 1022 may comprise, for example, a simple factor or a plurality of parameters for a power distribution scaling.
  • the patch scaling control data may indicate, for example, a power ratio between the first patch and the second patch over the full high frequency band or an absolute value for the power of the first patch and/or the second patch over the full high frequency band and may be represented by at least one parameter.
  • the patch scaling data comprises a factor determined for each of a plurality of subbands together constituting the high frequency band, e.g. similar to the spectral envelope data per subband in spectral bandwidth replication applications.
  • the patch scaling data may also indicate a transfer function of a filter.
  • parameters of a transfer function of a filter for scaling the first patch and/or parameters of a transfer function of a filter for scaling the second patch may be determined for generating the patch scaling control data.
  • the parameters may be generated based on a function of frequency.
  • Another alternative may be generating patch scaling control parameters representing a differential function of the first patch and the second patch.
  • the patch scaling control data 1022 may be generated by analyzing the input signal 1002 and selecting patch scaling control parameters stored in a patch scaling control parameter memory based on the analysis of the input signal 1002 to obtain the patch scaling control data 1022.
  • the generation of the patch scaling control data 1022 may be realized by an analysis by synthesis approach.
  • the patch scaling control data generator 1020 may comprise additionally a patch generator (as described for the decoder) and a comparator.
  • the patch generator may generate a first patch from the low frequency band of the input signal 1002 according to a first patching algorithm and a second patch from the low frequency band of the input signal 1002 according to a second patching algorithm.
  • a spectral density of the second patch generated according to the second patching algorithm may be higher than a spectral density of the first patch generated according to the first patching algorithm.
  • the comparator may compare the first patch, the second patch and the high frequency band of the input signal to obtain the patch scaling control data 1022.
  • the apparatus 1000 may extract the patch scaling control data 1022 by comparing the patches or the combined patches with the input signal, which may, for example, be an original audio signal. Additionally, the apparatus 1000 may also comprise a spectral line selector, a power controller, a noise adder and/or a missing harmonic adder as described before. In this way, also the noise data, the noise patch scaling control data, the missing harmonic data and/or the missing harmonic patch scaling control data may be extracted by an analysis by synthesis approach.
  • Some embodiments according to the invention relate to an audio signal comprising a first band and a second band.
  • the first band is represented by a first resolution data and the second band is represented by a second resolution data, wherein the second resolution is lower than the first resolution.
  • the second resolution data is based on spectral envelope data of the second band and patch scaling control data of the second band for scaling the audio signal at a decoder or for scaling a first patch and a second patch by the decoder, so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion.
  • the spectral envelope criterion is based on the spectral envelope data.
  • the first patch is generated from the first band of the audio signal according to a first patching algorithm and the second patch is generated from the first band of the audio signal according to a second patching algorithm.
  • a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm.
  • the audio signal may be, for example, a bandwidth reduced signal based on an original audio signal.
  • the first band of the audio signal may represent a low frequency band of the original audio signal encoded with high resolution.
  • the second band of the audio signal may represent a high frequency band of the original audio signal and may be quantized at least by two parameters, a spectral envelope parameter represented by the spectral envelope data and a patch scaling control parameter represented by the patch scaling control data. Based on such an audio signal, a decoder according to the concept described above may generate a bandwidth extended signal providing a good approximation of the original audio signal with improved audio quality in comparison with known concepts.
  • Fig. 1 1 shows a flow chart of a method 1 100 for generating a bandwidth extended signal from an input signal according to an embodiment of the invention.
  • the input signal is represented, for a first band by a first resolution data, and for a second band by a second resolution data, the second resolution being lower than the first resolution.
  • the method 1 100 comprises generating 1 1 10 a first patch, generating 1120 a second patch, scaling 1130 the input signal or scaling 1130 the first patch and the second patch and combining 1 140 the first patch, the second patch and the first band of the input signal to obtain the bandwidth extended signal.
  • the first patch is generated 1110 from the first band of the input signal according to a first patching algorithm and the second band is generated 1120 from the first band of the input signal according to a second patching algorithm.
  • a spectral density of the second patch generated 1120 according to the second patching algorithm is higher than a spectral density of the first patch generated 1110 according to the first patching algorithm.
  • the input signal may be scaled 1130 according to the first patching algorithm and according to the second patching algorithm or the first patch and the second patch may be scaled 1130, so that the bandwidth extended signal fulfills a spectral envelope criterion.
  • the method 1100 may be extended by steps according to the concept described above.
  • the method 1100 may be, for example, realized as a computer program for running on a computer or micro controller.
  • Fig. 12 shows a flow chart of a method 1200 for providing a bandwidth reduced signal based on an input signal according to an embodiment of the invention.
  • the method 1200 comprises determining 1210 spectral envelope data based on a high frequency band of the input signal, generating 1220 patch scaling control data, combining 1230 a low frequency band of the input signal, the spectral envelope data and the patch scaling control data to obtain the bandwidth reduced signal and providing 1240 the bandwidth reduced signal for transmission or storage.
  • the patch scaling control data is generated 1220 for scaling the bandwidth reduced signal at a decoder or for scaling a first patch and a second patch by the decoder so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion.
  • the spectral envelope criterion is based on the spectral envelope data.
  • the first patch is generated from a low frequency band of the bandwidth reduced signal according to a first patching algorithm and the second patch is generated from the low frequency band of the bandwidth reduced signal according to a second patching algorithm.
  • a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm.
  • the method 1200 may be extended by steps according to the concept described above.
  • the method 1200 may be, for example, realized as a computer program for running on a computer or micro controller.
  • Some embodiments according to the invention relate to an apparatus for generating a bandwidth extended signal using a phase vocoder for bandwidth extension combined with non-linear distortion or noise-filling for a more dense spectrum.
  • phase vocoder for spectral spreading frequency lines move further apart. If gaps exist in the spectrum, e.g. by quantization, the same are even increased by the spreading.
  • remaining lines in the spectrum receive too much energy. This is prevented by filling the gaps, either by noise or by further harmonics, which may be gained by a nonlinear distortion of the signal. This way, more energy may be distributed between the remaining lines.
  • concentration of the energy in bands to only few frequency lines a unnatural or metallic sound results. The energy of formerly more bands is summed up to the remaining ones.
  • the spectrum may be densified again on the one hand by noise produced by the distortion, on the other hand by further harmonic portions steered by an appropriate selection of the signal portion to be distorted.
  • the bandwidth extended signal then may be, for example, a weighted sum of a filtered distorted signal and a signal, which was generated with the help of the phase vocoder.
  • the bandwidth extended signal may be a weighted sum of the first patch, the second patch and the first band of the input signal.
  • Some embodiments according to the invention relate to a concept suitable for all audio applications where the full bandwidth is not available. For example, for the broadcast of audio contents using digital radio services, internet streaming or other audio communication applications, the described concept may be applied.
  • the inventive scheme may also be implemented in software.
  • the implementation may be on a digital storage medium, particularly a floppy disk or a CD with electronically readable control signals capable of cooperating with a programmable computer system so that the corresponding method is executed.
  • the invention thus also consists in a computer program product with a program code stored on a machine-readable carrier for performing the inventive method, when the computer program product is executed on a computer.
  • the invention may thus also be realized as a computer program with a program code for performing the method, when the computer program product is executed on a computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Stereophonic System (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)
  • Transmitters (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Digital Transmission Methods That Use Modulated Carrier Waves (AREA)

Abstract

An apparatus for generating a bandwidth extended signal from an input signal comprises a patch generator and a combiner. The input signal is represented for a first band by a first resolution data, and for a second band by a second resolution data, the second resolution being lower than the first resolution. The patch generator generates a first patch from the first band of the input signal according to a first patching algorithm and generates a second patch from the first band of the input signal according to a second patching algorithm. A spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of a first patch generated according to the first patching algorithm. The combiner combines the first patch, the second patch and the first band of the input signal to obtain the bandwidth extended signal. The apparatus for generating a bandwidth extended signal scales the input signal according to the first patching algorithm and according to the second patching algorithm or scales the first patch and the second patch, so that the bandwidth extended signal fulfills a spectral envelope criterion.

Description

Apparatus and Method for Generating a Bandwidth Extended Signal
Description
Embodiments according to the invention relate to audio signal processing and, in particular, to an apparatus and a method for generating a bandwidth extended signal from an input signal, an apparatus and a method for providing a bandwidth reduced signal based on an input signal and an audio signal.
Perceptually adapted coding of audio signals, providing a substantial data rate reduction for efficient storage and transmission of these signals, has gained wide acceptance in many fields. Many coding algorithms are known, e.g., MPEG 1/2 Layer 3 ("MP3") or MPEG 4 AAC (Advanced Audio Coding). However, the coding used for this, in particular when operating at lowest bit rates, can lead to an reduction of subjective audio quality which is often mainly caused by an encoder side induced limitation of the audio signal bandwidth to be transmitted.
It is known from WO 98 57436 to subject the audio signal to a band limiting in such a situation on the encoder side and to encode only a lower band of the audio signal by means of a high quality audio encoder ("core coder"). The upper band, however, is only very coarsely characterized, i.e. by a set of parameters which reproduces the spectral envelope of the upper band. On the decoder side, the upper band is then synthesized. For this purpose, a harmonic transposition is proposed wherein the lower band of the decoded audio signal is supplied to a fϊlterbank. Filterbank channels of the lower band are connected to filterbank channels of the upper band, or are "patched", and each patched bandpass signal is subjected to an envelope adjustment. The synthesis filterbank belonging to a special analysis filterbank receives bandpass signals of the audio signal in the lower band and envelope-adjusted bandpass signals of the lower band which are harmonically patched into the upper band. The output signal of the synthesis filterbank is an audio signal extended with regard to its original bandwidth which is transmitted from the encoder side to the decoder side by the core coder operating a very low data rate. In particular, filterbank calculations and patching in the filterbank domain may become a high computational effort.
Complexity-reduced methods for a bandwidth extension of band-limited audio signals instead use a copying function of low-frequency signal portions (LF) into the high frequency range (HF) in order to approximate information missing due to the band limitation. Such methods are described in M. Dietz, L. Liljeryd, K. Kjδrling and 0. Kunz, "Spectral Band Replication, a novel approach in audio coding," in 1 12th AES Convention, Munich, May 2002; S. Meltzer, R. Bohm and F. Henn, "SBR enhanced audio codecs for digital broadcasting such as "Digital Radio Mondiale" (DRM)," 112th AES Convention, Munich, May 2002; T. Ziegler, A. Ehret, P. Ekstrand and M. Lutzky, "Enhancing mp3 with SBR: Features and Capabilities of the new mp3PRO Algorithm," in 112th AES Convention, Munich, May 2002; International Standard ISO/IEC 14496-3:2001 /FPDAM 1, "Bandwidth Extension," ISO/IEC, 2002, or "Speech bandwidth extension method and apparatus", Vasu Iyengar et al. US Patent Nr. 5,455,*
In these methods, no harmonic transposition is performed, but successive bandpass signals of the lower band are introduced into successive filterbank channels of the upper band. By this, a coarse approximation of the upper band of the audio signal is achieved. In a further step, this coarse approximation of the signal is then assimilated with respect to the original by a post processing using control information gained from the original signal. Here, e.g. scale factors serve for adapting the spectral envelope, an inverse filtering, and the addition of a noise floor for adapting tonality and a supplementation of sinusoidal signal portions for missing harmonics, as it is also described in the MPEG-4 High Efficiency Advanced Audio Coding (HE-AAC) standard.
Apart from this, further methods are using a phase vocoder for bandwidth extension. When applying the phase vocoder for spectral spreading, frequency lines move further apart from each other. If gaps exist in the spectrum, e.g. by quantization, the same are even increased by the spreading. In an energy adaption, remaining lines in the spectrum receive too much energy compared to the respective lines in the original signal.
Fig. 13 shows a schematic illustration of a bandwidth extension 1300 using a phase vocoder. In this example, two patches 1312, 1314 are added to a low frequency band 1302 of a signal. The upper cut-off frequency 1320 of the signal, also called Xover frequency (crossover frequency) is the low-end frequency of the neighboring patch 1312 and the double of the x-over frequency is the upper cut-off frequency of the neighboring patch 1312 and the lower cut-off frequency of the next patch 1314. The phase vocoder doubles the frequency of the frequency lines of the low frequency band 1302 of the signal to obtain the neighboring patch 1312 and triples the frequencies of the frequency lines of the low frequency band 1302 of the signal to obtain the next patch 1314. Therefore, a spectral density of the neighboring patch 1312 is only half of a spectral density of the low frequency band 1302 of the signal and the spectral density of the next patch 1314 is only one third of the spectral density of the low frequency band 1302 of the signal. By the concentration of the energy in bands (patches) to only few frequency lines, a substantial change in timbre results which differs from the original. The energy of formerly more bands (frequency lines) is summed up to the fewer remaining ones.
Some examples for phase vocoders and their applications are presented in "Frederik Nagel and Sascha Disch, A Harmonic Bandwidth Extension Method for Audio Codecs," ICASSP'09 and "M. Puckette. Phase-locked Vocoder. IEEE ASSP Conference on Applications of Signal Processing to Audio and Acoustics, Mohonk 1995.", Rδbel, A.: Transient detection and preservation in the phase vocoder; citeseer.ist.psu.edu/679246.html", "Laroche L., Dolson M.: Improved phase vocoder timescale modification of audio", IEEE Trans. Speech and Audio Processing, Vol. 7, No. 3, pp. 323—332" and United States Patent 6549884.
One approach for filling the gaps is shown in WO 00/45379. It contains a method and an apparatus for enhancement of source coding systems utilizing high frequency reconstruction. The application addresses the problem of insufficient noise contents in a reconstructed highband by adaptive noise-floor addition. Adding noise may fill the gaps, but the audio quality or subjective quality may not be increased sufficiently.
It is the object of the present invention to provide a concept for a bandwidth extension of audio signals which increases the subjective quality of bandwidth extended signals.
This object is solved by an apparatus according to claims 1 and 11, an audio signal according to claim 14, and a method according to claims 15 and 16.
An embodiment of the invention provides an apparatus for generating a bandwidth extended signal from an input signal. The input signal is represented, for a first band by a first resolution data and for a second band by a second resolution data, the second resolution being lower than the first resolution. The apparatus comprises a patch generator and a combiner. The patch generator is configured to generate a first patch from the first band of the input signal according to a first patching algorithm and configured to generate a second patch from the first band of the input signal according to a second patching algorithm. A spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm. The combiner is configured to combine the first patch, the second patch and the first band of the input signal to obtain the bandwidth extended signal. The apparatus for generating a bandwidth extended signal is configured to scale the input signal according to the first patching algorithm and according to the second patching algorithm or to scale the first patch and the second patch, so that the bandwidth extended signal fulfils a spectral envelope criterion.
Embodiments according to the present invention are based on the central idea that a patch with low spectral density (which means, for example, the patch comprises gaps in comparison to a low frequency band of the input signal) is combined with a patch with high spectral density (which means, for example, the patch comprises only few gaps or no gaps in comparison with the low frequency band of the input signal) for extending the bandwidth of an input signal. Since both patches are generated based on the input signal, the high frequency bandwidth extension of the low frequency band of the input signal may provide a good approximation of the original audio signal. Additionally, the first and the second patch may be scaled before (by scaling the input signal) or after generation to fulfill a spectral envelope criterion, since the spectral envelope of the original audio signal should be considered for the reconstruction of the high frequency band of the input signal. In this way, the subjective quality or the audio quality of the bandwidth extended signal may be significantly increased.
In some embodiments according to the invention, the first patching algorithm is a harmonic patching algorithm. In other words, the first patch is generated so that only frequencies that are integer multiples of frequencies of the first band of the input signal are contained by the first patch. In addition, the second patching algorithm may be a mixing patching algorithm. This means, for example, that the second patch may be generated, so that the second patch contains frequencies that are integer multiples of frequencies of the first band of the input signal and frequencies that are not integer multiples of frequencies of the first band of the input signal. Therefore, the spectral density of the second patch is higher than the spectral density of the first patch. By combining the first patch and the second patch, missing frequency lines of the first patch may be filled by frequency lines of the second patch. In this way, the gaps of the harmonic bandwidth extension according to the first patching algorithm may be filled by the second patch and the audio quality of the bandwidth extended signal may be significantly improved.
Some embodiments according to the invention relate to an apparatus for providing a bandwidth reduced signal based on an input signal. The apparatus comprises a spectral envelope data determiner, a patch scaling control data generator, and an output interface. The spectral envelope data determiner is configured to determine spectral envelope data based on the high frequency band of the input signal. The patch scaling control data generator is configured to generate patch scaling control data for scaling the bandwidth reduced signal at the decoder or for scaling a first patch and a second patch by the decoder, so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion. The spectral envelope criterion is based on the spectral envelope data. The first patch is generated from a low frequency band of the bandwidth reduced signal according to a first patch algorithm and the second patch is generated from the low frequency band of the bandwidth reduced signal according to a second patching algorithm. A spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm. The output interface is configured to combine a low frequency band of the input signal, the spectral envelope data, and the power scaling control data to obtain the bandwidth reduced signal. Further, the output interface is configured to provide the bandwidth reduced signal for transmission or storage.
Some further embodiments according to the invention relate to an audio signal comprising a first band and a second band. The first band is represented by a first resolution data and the second band is represented by a second resolution data. The second resolution is lower than the first resolution. The second resolution data is based on spectral envelope data of the second band and patch-scaling control data of the second band for scaling the audio signal at a decoder or for scaling a first patch and a second patch by the decoder, so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion. The spectral envelope criterion is based on the spectral envelope data. The first patch is generated from the first band of the audio signal according to a first patching algorithm and the second patch is generated from the first band of the audio signal according to a second patching algorithm. A spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generator according to the first patching algorithm.
Embodiments according to the invention will be detailed subsequently referring to the appended drawings, in which:
Fig. 1 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal;
Fig. 2a is a schematic illustration of a generated first patch;
Fig. 2b is a schematic illustration of a generated first and second patch;
Fig. 3a is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal; Fig. 3b is a schematic illustration of a clipped sinusoidal input signal;
Fig. 3c is a schematic illustration of a half wave rectified sinusoidal input signal;
Fig. 3d is a schematic illustration of a clipped and full wave rectified sinusoidal input signal;
Fig. 4 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal;
Fig. 5a is a schematic illustration of a filterbank implementation of a phase vocoder;
Fig. 5b is a detailed illustration of a filter of Fig. 5a;
Fig. 5c is a schematic illustration for the manipulation of the magnitude signal and the frequency signal in a filter channel of Fig. 5a;
Fig. 6 is a schematic illustration of a transformation implementation of a phase vocoder;
Fig. 7 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal;
Fig. 8 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal;
Fig. 9 is a block diagram of an apparatus for generating a bandwidth extended signal from an input signal;
Fig. 10 is a block diagram of an apparatus for providing a bandwidth reduced signal based on an input signal;
Fig. 1 1 is a flow chart of a method for generating a bandwidth extended signal from an input signal;
Fig. 12 is a flow chart of a method for providing a bandwidth reduced signal based on an input signal; and Fig. 13 is a schematic illustration of a known bandwidth extension algorithm.
In the following, the same reference numerals are partly used for objects and functional units having the same or similar functional properties and the description thereof with regard to a figure shall apply also to other figures in order to reduce redundancy in the description of the embodiments.
Fig. 1 shows a block diagram of an apparatus 100 for generating a bandwidth extended signal 122 for an input signal 102 according to an embodiment of the invention. The input signal 102 is represented, for a first band by a first resolution data, and for a second band by a second resolution data, the second resolution being lower than the first resolution. The apparatus 100 comprises a patch generator 110 connected to a combiner 120. The patch generator 120 generates a first patch 112 from the first band of the input signal 102 according to a first patching algorithm and generates a second patch 114 from the first band of the input signal 102 according to a second patching algorithm. A spectral density of the second patch 114 generated according to the second patching algorithm is higher than a spectral density of the first patch 112 generated according to the first patching algorithm. The combiner 120 combines the first patch 1 12, the second patch 114 and the first band of the input signal 102 to obtain the bandwidth extended signal 122. Further, the apparatus 100 for generating a bandwidth extended signal 122 scales the input signal 102 according to the first patching algorithm and according to the second patching algorithm or scales the first patch 1 12 and the second patch 1 14 so that the bandwidth extended signal 122 fulfills a spectral envelope criterion.
Spectral density means, for example, the density of different frequencies or frequency lines within a frequency band. For example, a frequency band reaching from OHz to lOkHz comprising frequency portions with frequencies of 4kHz and 8kHz has a lower spectral density than the same frequency band comprising frequency portions with frequencies of 2kHz, 4kHz, 6kHz, 8kHz and 10kHz. Since the spectral density of the first patch 112 is lower than the spectral density of the second patch 114, the first patch 112 comprises gaps in comparison with the second patch 114. Therefore, the second patch 114 may be used to fill these gaps. Since both patches are based on the first band of the input signal 102, both patches are related to the characteristic of the original signal corresponding to the input signal 102. Therefore, the bandwidth extended signal 122 may be a good approximation of the original signal and the subjective quality or the audio quality of the bandwidth extension signal 122 may be significantly improved by using the described concept. In this way, more energy may be distributed between the remaining lines and, for example, a unnatural sound may be avoided.
For example, the first patching algorithm may be a harmonic patching algorithm. Therefore, the patch generator 110 may generate the first patch 112 comprising only frequencies that are integer multiples of frequencies of the first band of the input signal 102. A harmonic bandwidth extension may provide a good approximation of the tonal structure of the original signal, but this patching algorithm will leave gaps between the harmonic frequencies. These gaps may be filled by the second patch. For example, the second patching algorithm may be a mixing patching algorithm, which means that the patch generator 110 may generate the second patch 114 comprising integer multiples of frequencies of the first band of the input signal 102 (harmonic frequencies) and frequencies that are not integer multiples of the frequencies of the first band of the input signal 102 (non-harmonic frequencies). The non-harmonic frequencies may be used for filling the gaps of the first patch 1 12. It may also be possible to combine the whole second patch 114 (including the harmonic frequencies) with the first patch 112. In this example, an amplification of the harmonic frequencies due to the combination of the harmonic frequency portions of the first patch 112 and the second patch 1 14 may be taken into account by appropriately scaling the first patch 112 and/or the second patch 1 14.
The first patch 1 12 and the second patch 114 comprise at least partly the same frequency range. For example, the first patch 1 12 comprises a frequency band reaching from 4kHz to 8kHz and the second patch 114 comprises a frequency band from 6kHz to 1 OkHz. In some embodiments according to the invention, a lower cut of frequency of the first patch is equal to a lower cut of frequency of the second patch and an upper cut of frequency of the first patch 112 is equal to an upper cut of frequency of the second patch 114. For example, both patches comprise a frequency band reaching from 4kHz to 8kHz.
Figs. 2a and 2b show an example for a first patch 1 12 according to a first patching algorithm 212 and a second patch 114 according to a second patching algorithm 214. For better illustration, Fig. 2a shows only the first patches 1 12 and Fig. 2b shows the first patches 1 12 and the corresponding second patches 114. Fig. 2a illustrates an example 200 for the first band 202 of the input signal 102 and two first patches 112 generated according to the first patching algorithm 212. In this example, a patch comprises the same bandwidth as the first band 202 of the input signal 102. The bandwidth may also be different. The upper cut-off frequency 220 of the first band 202 of the input signal 102 is denoted 'Xover' frequency (crossover frequency). In the example shown in Fig. 2a, patches start at a frequency equal to a multiple of the crossover frequency Xover 220. The frequency lines within the first patches 112 are integer multiples of the frequency lines of the first band 202 of the input signal 102 and may, for example, be generated by a phase vocoder. These first patches 1 12 comprise gaps in terms of missing frequency lines in comparison to the first band 202 of the input signal 102.
Fig. 2b additionally shows an example 250 for the two corresponding second patches 114. These patches are generated according to the second patching algorithm 214 and comprise harmonic and non-harmonic frequencies. The non-harmonic frequency lines may be used to fill the gaps of the first patches 112. The frequency lines of the second patches 114 may be generated, for example, by a non-linear distortion.
In this way, the gaps may not be filled arbitrarily as, for example, by filling the gaps with noise. The gaps are filled based on the first resolution data of the first band of the input signal and, therefore, based on the original signal.
The first band of the input signal 102 may represent, for example, the low frequency band of an original audio signal encoded with high resolution. The second band of the input signal 102 may represent, for example, a high frequency band of the original audio signal and may be quantized by one or more parameters as, for example, spectral envelope data, noise data and/or missing harmonic data with low resolution. An original audio signal may be, for example, an audio signal recorded by a microphone before processing or encoding.
Scaling the input signal according to the first patching algorithm and according to the second patching algorithm means, for example, that the input signal is scaled once according to the first patching algorithm before the first patch is generated and then the first patch is generated based on the scaled input signal, and that the input signal is scaled once according to the second patching algorithm before the second patch is generated and then the second patch is generated based on the scaled input signal, so that after the combination of the first patch, the second patch and the first band of the input signal, the bandwidth extended signal fulfills a spectral envelope criterion. Alternatively, the first patch and the second patch are scaled after their generation, so that the bandwidth extended signal also fulfills a spectral envelope criterion. Also a scaling of the input signal according to the first patching algorithm and according to the second patching algorithm in combination with a scaling of the first patch and the second patch may be possible.
The combiner 120 may be, for example, an adder and the bandwidth extended signal 122 may be a weighted sum of the first patch 112, the second patch 1 14 and the first band of the input signal 102. Fulfilling a spectral envelope criterion means, for example, that a spectral envelope of the bandwidth extended signal is based on a spectral envelope data contained by the input signal. The spectral envelope data may be generated by an encoder and may represent the second band of an original signal. In this way, the spectral envelope of the bandwidth extended signal may be a good approximation of the spectral envelope of the original signal.
The apparatus 100 may also comprise a core decoder for decoding the first band of the input signal 102.
The patch generator 110 and the combiner 120 may be, or example, specially designed hardware or part of a processor or micro controller or may be a computer program configured to run on a computer or a micro controller. The apparatus 100 may be part of a decoder or an audio decoder.
Fig. 3a shows a block diagram of an apparatus 300 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention. In this example, the patch generator 110 comprises a phase vocoder 310 for generating the first patch and an amplitude clipper 320 for generating the second patch 114. The phase vocoder 310 and the amplitude clipper 320 are connected to the combiner 120. The phase vocoder 310 may spread the first band of the input audio signal 102 to generate the first patch 112 comprising harmonic frequencies. In a non-linear processing step, the amplitude clipper 320 may clip the input signal 102 to generate the second patch 114 comprising harmonic and non-harmonic frequencies. Alternatively to the amplitude clipper 320, also a half-wave rectifier, a full-wave rectifier, a mixer or a diode used in the quadratic region of the characteristic curve may be used to generate non-harmonic frequencies based on the input signal 102 by a non-linear processing step.
Figs. 3b, 3c and 3d show examples for clipped and/or rectified input signals 102 to generate non-harmonic frequencies. Fig. 3b shows a schematic illustration 350 of a clipped sinusoidal input signal 102. By clipping the signal, points of discontinuity in the form of abrupt changes of the signal slope 380 are caused and harmonic and non-harmonic portions with higher frequencies are generated.
Alternatively, Fig. 3c shows a schematic illustration 360 of a half-wave rectified sinusoidal input signal 102, also causing points of discontinuity 380. Further, a combination of clipping and rectifying may be possible. Fig. 3d shows a schematic illustration 370 of a clipped and full-wave rectified sinusoidal input signal 102 causing different points of discontinuity 380.
By clipping and/or rectifying or applying other methods of nonlinear processing generating points of discontinuity 380, a wide spectrum of different frequencies may be generated. Therefore, a patch generated according to such a patching algorithm may comprise a high spectral density.
Fig. 4 shows a block diagram of an apparatus 400 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention. The apparatus 400 is similar to the apparatus shown in Fig. 3a, but additionally comprises a spectral line selector 410. The phase vocoder 310 and the amplitude clipper 320 are connected to the spectral line selector 410 and the spectral line selector 410 is connected to the combiner 120. The spectral line selector 410 may select a plurality of frequency lines of the second patch 114 to obtain a modified second patch 414 that may be complementary to the first patch. A frequency line of the second patch 114 may be selected if a corresponding frequency line of the first patch 112 is missing. In other words, the spectral line selector 410 selects frequency lines of the second patch 114 for filling gaps of the first patch 1 12 and may disregard frequencies of the second patch 114 already contained by the first patch 112. In this way, the modified second patch 414 may comprise gaps at frequencies already contained by the first patch 112.
In this example, the combiner 120 combines the first patch 1 12, the modified second patch 414 and the first band of the input signal 102.
The spectral line selector 410 may be, for example, part of the patch generator 110 (as shown in Fig. 4) or a separate unit.
In the following, with reference to Figs 5 and 6, possible implementations for a phase vocoder 310 are illustrated according to the present invention. Fig. 5a shows a filterbank implementation of a phase vocoder, wherein an audio signal is fed to an input 500 and obtained at an output 510. In particular, each channel of the schematic filterbank illustrated in Fig. 5a includes a bandpass filter 501 and a downstream oscillator 502. Output signals of all oscillators from every channel are combined by a combiner, which is, for example, implemented as an adder and indicated at 503 in order to obtain the output signal. Each filter 501 is implemented such that it provides an amplitude signal on the one hand and a frequency signal on the other hand. The amplitude signal and the frequency signal are time signals illustrating a development of the amplitude in a filter 501 over time, while the frequency signal represents a development of the frequency of the signal filtered by a filter 501.
A schematical setup of filter 501 is illustrated in Fig. 5b. Each filter 501 of Fig. 5a may be set up as in Fig. 5b, wherein, however, only the frequencies fj supplied to the two input mixers 551 and the adder 552 are different from channel to channel. The mixer output signals of the mixers 551 are both lowpass filtered by lowpasses 553, wherein the lowpass signals are different insofar as they were generated by local oscillator frequencies (LO frequencies), which are out of phase by 90°. The upper lowpass filter 553 provides a quadrature signal 554, while the lower filter 553 provides an in-phase signal 555. These two signals, i.e. Q, and I are supplied to a coordinate transformer 556 which generates a magnitude phase representation from the rectangular representation. The magnitude signal or amplitude signal, respectively, of Fig. 5a over time is output at an output 557. The phase signal is supplied to a phase unwrapper 558. At the output of the element 558, there is no phase value present any more, which is always between 0 and 360°, but a phase value, which increases linearly. This "unwrapped" phase value is supplied to a phase/frequency converter 559 which may, for example, be implemented as a simple phase difference calculator, which subtracts a phase of a previous point in time from a phase at a current point in time to obtain a frequency value for the current point in time or any other means for obtaining an approximation of a phase derivative. This frequency value is added to the constant frequency value fj of the filter channel i to obtain a temporarily varying frequency value at the output 560. The frequency value at the output 560 has a direct component = fj and an alternating component = the frequency deviation by which a current frequency of the signal in the filter channel deviates from the average frequency fj.
Thus, as illustrated in Figs. 5a and 5b, the phase vocoder achieves a separation of the spectral information and the temporal information. The spectral information is contained in the special channel or in the frequency fj, which provides the direct portion of the frequency for each channel, while the temporal information is contained in the frequency deviation or the magnitude evolution over time, respectively.
Fig. 5c shows a manipulation as it is executed for the generation of the first patch according to the invention, in particular, using the phase vocoder 310 and, in more detail, inserted at the location of the dashed line of the illustrated circuit in Fig. 5a. For time scaling, e.g. the amplitude signals A(t) in each channel or the frequency of the signals f(t) in each channel may be decimated or interpolated. For purposes of transposition, as it is useful for the present invention, an interpolation, i.e. a temporal extension or spreading of the signals A(t) and f(t) is performed to obtain spread signals A'(t) and f (t), wherein the interpolation is controlled by the spreading factor 598. The spreading factor can be selected, for example, so that the phase vocoder generates harmonic frequencies. By the interpolation of the phase variation, i.e. the value before the addition of the constant frequency by the adder 552, the frequency of each individual oscillator 502 in Fig. 5a is not changed. The temporal change of the overall audio signal is slowed down, however, i.e. by the factor 2. The result is a temporally spread tone having the original pitch, i.e. the original fundamental wave with its harmonics.
By performing the signal processing illustrated in Fig. 5c, the audio signal may be shrunk back to its original duration, e.g. by decimation of a factor 2, while all frequencies are doubled simultaneously. This leads to a pitch transposition by the factor 2 wherein, however, an audio signal is obtained which has the same length as the original audio signal, i.e. the same number of samples.
As an alternative to the filterband implementation illustrated in Fig. 5a, a transformation implementation of a phase vocoder may also be used as depicted in figure 6. Here, the audio signal 698 is fed into an FFT processor, or more generally, into a Short-Time- Fourier-Transformation (STFT) processor 600 as a sequence of time samples. The FFT processor 600 is implemented to perform a temporal windowing of an audio signal in order to then, by means of an subsequent FFT, calculate both a magnitude spectrum and also a phase spectrum, wherein this calculation is performed for successive spectra which are related to blocks of the audio signal that are strongly overlapping.
In an extreme case, for every new audio signal sample a new spectrum may be calculated, wherein a new spectrum may be calculated also e.g. only for each twentieth new sample. This distance 'a' in samples between two spectra is preferably given by a controller 602. The controller 602 is further implemented to feed an IFFT processor 604 which is implemented to operate in an overlap-add operation. In particular, the IFFT processor 604 is implemented such that it performs an inverse Short-Time-Fourier-Transformation by performing one IFFT per spectrum based on a magnitude spectrum and a phase spectrum, in order to then perform an overlap-add operation to obtain the resulting time signal. The overlap add operation is configured to eliminate the blocking effects introduced by the analysis window. A temporal spreading of the time signal is achieved by the distance 'b' between two spectra, as they are processed by the IFFT processor 604, being greater than the distance 'a' between the spectra used in the generation of the FFT spectra. The basic idea is to spread the audio signal by the inverse FFTs simply being spaced further apart than the analysis FFTs. As a result, spectral changes in the synthesized audio signal occur more slowly than in the original audio signal.
Without a phase rescaling in block 606, this would, however, lead to frequency artifacts. When, for example, one single frequency bin is considered for which successive phase values by 45° are implemented, this implies that the signal within this filterband increases in the phase with a rate of 1/8 of a cycle, i.e. by 45° per time interval, wherein the time interval here is the time interval between successive FFTs. If now the inverse FFTs are being spaced farther apart from each other, this means that the 45° phase increase occurs across a longer time interval. This means that the frequency of this signal portion was unintentionally modified. To eliminate this artifact, the phase is rescaled by exactly the same factor by which the audio signal was spread in time. The phase of each FFT spectral value is thus increased by the factor b/a, so that this unintentional frequency modification is eliminated.
While in the embodiment illustrated in Fig. 5c the spreading by interpolation of the amplitude/frequency control signals was achieved for one signal oscillator in the filterbank implementation of Fig. 5a, the spreading in Fig. 6 is achieved by the distance between two IFFT spectra being greater than the distance between two FFT spectra, i.e. 'b' being greater than 'a', wherein, however, for an artifact prevention a phase rescaling is executed according to the ratio 'b/a'. The distance 'b' can be selected, for example, so that the phase vocoder generates harmonic frequencies.
Fig. 7 shows a block diagram of an apparatus 700 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention. The apparatus 700 is similar to the apparatus shown in Fig. 1, but comprises a power controller 710, a first power adjustment means 720 and a second power adjustment means 730. The power controller 710 is connected to the first power adjustment means 720 and to the second power adjustment means 730. The first power adjustment means 720 and the second power adjustment means 730 are connected to the patch generator 110. The power controller 710 may control the scaling of the input signal according to the first and the second patching algorithm based on spectral envelope data contained by the input signal and based on patch scaling control data contained by the input signal. Alternatively, instead of the patch scaling control data contained by the input signal, at least one stored patch- scaling control parameter may be used. A patch scaling control parameter may be stored by a patch-scaling control parameter memory, which may be part of the power controller 710 or a separate unit. The first power adjustment means 720 may scale the input signal 102 according to the first patching algorithm and the second power adjustment means 730 may scale the input signal 102 according to the second patching algorithm. In other words, the input signal 102 may be pre-processed, so that the first and the second patch can be generated, so that the bandwidth extended signal fulfills the spectral envelope criterion. For this, the spectral envelope data may define the spectral envelope of the bandwidth extended signal 122 and the patch scaling control data or patch scaling control parameter may set the ratio between the first patch 112 and the second patch 114 or may set the absolute values of the first patch 112 and/or the second patch 1 14. The first power adjustment means 720 and the second power adjustment means 730 may be part of the power controller 710 or separate units as shown in Fig. 7. The power controller 710 may be part of the patch generator 110 or a separate unit as also shown in Fig. 7. The power adjustment means 720, 730 may be, for example, amplifiers or filters controlled by the power controller 710.
Alternatively, the scaling is done after generation of the patches. Fittingly, Fig. 8 shows a block diagram of an apparatus 800 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention. The apparatus 800 is similar to the apparatus shown in Fig. 7, but the power adjustment means 720, 730 are arranged between the patch generator 110 and the combiner 120. In this example, the patch generator 1 10 is connected to the first power adjustment means 720 and connected to the second power adjustment means 730. The first power adjustment means 720 and the second power adjustment means 730 are connected to the combiner 120. In this way, the first patch 112 can be scaled by the first power adjustment means 720 according to the first patching algorithm and the second patch 1 14 can be scaled by the second power adjustment means 730 according to the second patching algorithm. The power adjustment means are, again, controlled by the power controller 710 based on the spectral envelope data and the patch scaling control data or the patch scaling control parameter as described before.
Alternatively, also a scaling or power adjustment of only one of the both patches followed by combining the patches by the combiner 120 and scaling the combined patches before combining the combined patches with the first band of the input signal 102 may be possible. In other words, first one patch may be scaled to realize a predefined ratio (for example, based on the patch scaling control data) between the two patches and then the combined patches are scaled (for example, based on the spectral envelope data) to fulfill the spectral envelope criterion.
The patch scaling control data may comprise, for example, a simple factor or a plurality of parameters for a power distribution scaling. The patch scaling control data may indicate, for example, a power ratio between the first patch and the second patch over the full second band or full high frequency band or an absolute value for the power of the first patch and/or the second patch over the full second band or full high band and may be represented by at least one parameter. Alternatively, the patch scaling data comprises a factor for each of a plurality of subbands together constituting the second band or high frequency band, e.g. similar to the spectral envelope data per subband in spectral bandwidth replication applications. Alternatively, the patch scaling data may also indicate a transfer function of a filter. For example, parameters of a transfer function of a filter for scaling the first patch and/or parameters of a transfer function of a filter for scaling the second patch may be contained in the input signal. In this way, the parameters may represent a function of frequency. Another alternative may be patch scaling control parameters representing a differential function of the first patch and the second patch. According to this examples, the scaling of the input signal or the scaling of the first patch and the second patch may be based on the patch scaling control data comprising at least one parameter.
Fig. 9 shows a block diagram of an apparatus 900 for generating a bandwidth extended signal 122 from an input signal 102 according to an embodiment of the invention. The apparatus 900 is similar to the apparatus shown in Fig. 8, but comprises additionally a noise adder 910, a missing harmonic adder 920, a noise power adjustment means 940 and a missing harmonic power adjustment means 950. The noise adder 910 is connected to the noise power adjustment means 940, which is connected to the combiner 120. The missing harmonic adder 920 is connected to the missing harmonic power adjustment means 950, which is connected to the combiner 120. Further, the power controller 710 is connected to the noise power adjustment means 940 and the missing harmonic power adjustment means 950. The noise adder 910 may generate a noise patch 912 based on a noise data contained by the input signal 102.
The noise patch 912 may be scaled by the noise power adjustment means 940. The power controller 710 may control the noise power adjustment means 940 based on the spectral envelope data and/or noise scaling data contained in the input signal 102. In this way, the noise of an original signal may be approximated to improve the audio quality of the bandwidth extended signal. The missing harmonic adder 920 may generate a missing harmonic patch 922 based on a missing harmonic data contained in the input signal. The missing harmonic patch 922 may contain harmonic frequencies, which may only occur in the high frequency band of the original signal and, therefore, cannot be reproduced, if only the information of the low frequency band of the original signal in terms of the first band of the input signal 102 is available. The missing harmonic data may provide information about these missing harmonics. The missing harmonic patch 922 may be scaled by the missing harmonic power adjustment means 950. The power controller 710 may control the missing harmonic power adjustment means 950 based on the spectral envelope data or based on a missing harmonic scaling data contained by the input signal 102.
The combiner 120 may combine the first patch 112, the second patch 114, the first band of the input signal 102, the noise patch 912 and the missing harmonic patch 922 to obtain the bandwidth extended signal 122. The power controller 710, in combination with the power adjustment means, may scale the first patch 112, the second patch 114, the noise patch 912 and the missing harmonic patch 922 based on the spectral envelope data, so that the spectral envelope criterion is fulfilled.
Fig. 10 shows a block diagram of an apparatus 1000 for providing a bandwidth reduced signal 1032 based on an input signal 1002 according to an embodiment of the invention. The apparatus 1000 comprises a spectral envelope data determiner 1010, a patch scaling control data generator 1020 and an output interface 1030. The spectral envelope data determiner 1010 and the patch scaling control data generator 1020 are connected to the output interface 1030. The spectral envelope data determiner 1010 may determine spectral envelope data 1012 based on a high frequency band of the input signal 1002. The patch scaling control data generator 1020 may generate patch scaling control data 1022 for scaling the bandwidth reduced signal 1032 at a decoder or for scaling a first patch and a second patch by the decoder so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion. The spectral envelope criterion is based on the spectral envelope data. The first patch is generated from a first band of the bandwidth reduced signal 1032 according to a first patching algorithm and the second patch is generated from the first band of the bandwidth reduced signal 1032 according to a second patching algorithm. A spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm. The output interface 1030 combines a low frequency band of the input signal 1002, the spectral envelope data 1012 and the patch scaling control data 1022 to obtain the bandwidth reduced signal 1032. Further, the output interface 1030 provides the bandwidth reduced signal 1032 for transmission or storage.
The apparatus 1000 may also comprise a core coder for encoding the low frequency band of the input signal. The core encoder may be, for example, a differential encoder, an entropy encoder or a perceptual audio encoder.
The apparatus 1000 may be part of an encoder configured to provide a signal for a decoder described above. The patch scaling control data 1022 may comprise, for example, a simple factor or a plurality of parameters for a power distribution scaling. The patch scaling control data may indicate, for example, a power ratio between the first patch and the second patch over the full high frequency band or an absolute value for the power of the first patch and/or the second patch over the full high frequency band and may be represented by at least one parameter. Alternatively, the patch scaling data comprises a factor determined for each of a plurality of subbands together constituting the high frequency band, e.g. similar to the spectral envelope data per subband in spectral bandwidth replication applications. Alternatively the patch scaling data may also indicate a transfer function of a filter. For example, parameters of a transfer function of a filter for scaling the first patch and/or parameters of a transfer function of a filter for scaling the second patch may be determined for generating the patch scaling control data. In this way, the parameters may be generated based on a function of frequency. Another alternative may be generating patch scaling control parameters representing a differential function of the first patch and the second patch.
The patch scaling control data 1022 may be generated by analyzing the input signal 1002 and selecting patch scaling control parameters stored in a patch scaling control parameter memory based on the analysis of the input signal 1002 to obtain the patch scaling control data 1022.
Alternatively, the generation of the patch scaling control data 1022 may be realized by an analysis by synthesis approach. For this, the patch scaling control data generator 1020 may comprise additionally a patch generator (as described for the decoder) and a comparator. The patch generator may generate a first patch from the low frequency band of the input signal 1002 according to a first patching algorithm and a second patch from the low frequency band of the input signal 1002 according to a second patching algorithm. A spectral density of the second patch generated according to the second patching algorithm may be higher than a spectral density of the first patch generated according to the first patching algorithm. The comparator may compare the first patch, the second patch and the high frequency band of the input signal to obtain the patch scaling control data 1022. In other words, the concept described before is also applied to the apparatus 1000. In this way, the apparatus 1000 may extract the patch scaling control data 1022 by comparing the patches or the combined patches with the input signal, which may, for example, be an original audio signal. Additionally, the apparatus 1000 may also comprise a spectral line selector, a power controller, a noise adder and/or a missing harmonic adder as described before. In this way, also the noise data, the noise patch scaling control data, the missing harmonic data and/or the missing harmonic patch scaling control data may be extracted by an analysis by synthesis approach.
Some embodiments according to the invention relate to an audio signal comprising a first band and a second band. The first band is represented by a first resolution data and the second band is represented by a second resolution data, wherein the second resolution is lower than the first resolution. The second resolution data is based on spectral envelope data of the second band and patch scaling control data of the second band for scaling the audio signal at a decoder or for scaling a first patch and a second patch by the decoder, so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion. The spectral envelope criterion is based on the spectral envelope data. The first patch is generated from the first band of the audio signal according to a first patching algorithm and the second patch is generated from the first band of the audio signal according to a second patching algorithm. A spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm.
The audio signal may be, for example, a bandwidth reduced signal based on an original audio signal. The first band of the audio signal may represent a low frequency band of the original audio signal encoded with high resolution. The second band of the audio signal may represent a high frequency band of the original audio signal and may be quantized at least by two parameters, a spectral envelope parameter represented by the spectral envelope data and a patch scaling control parameter represented by the patch scaling control data. Based on such an audio signal, a decoder according to the concept described above may generate a bandwidth extended signal providing a good approximation of the original audio signal with improved audio quality in comparison with known concepts.
Fig. 1 1 shows a flow chart of a method 1 100 for generating a bandwidth extended signal from an input signal according to an embodiment of the invention. The input signal is represented, for a first band by a first resolution data, and for a second band by a second resolution data, the second resolution being lower than the first resolution. The method 1 100 comprises generating 1 1 10 a first patch, generating 1120 a second patch, scaling 1130 the input signal or scaling 1130 the first patch and the second patch and combining 1 140 the first patch, the second patch and the first band of the input signal to obtain the bandwidth extended signal. The first patch is generated 1110 from the first band of the input signal according to a first patching algorithm and the second band is generated 1120 from the first band of the input signal according to a second patching algorithm. A spectral density of the second patch generated 1120 according to the second patching algorithm is higher than a spectral density of the first patch generated 1110 according to the first patching algorithm. The input signal may be scaled 1130 according to the first patching algorithm and according to the second patching algorithm or the first patch and the second patch may be scaled 1130, so that the bandwidth extended signal fulfills a spectral envelope criterion.
Further, the method 1100 may be extended by steps according to the concept described above. The method 1100 may be, for example, realized as a computer program for running on a computer or micro controller.
Fig. 12 shows a flow chart of a method 1200 for providing a bandwidth reduced signal based on an input signal according to an embodiment of the invention. The method 1200 comprises determining 1210 spectral envelope data based on a high frequency band of the input signal, generating 1220 patch scaling control data, combining 1230 a low frequency band of the input signal, the spectral envelope data and the patch scaling control data to obtain the bandwidth reduced signal and providing 1240 the bandwidth reduced signal for transmission or storage. The patch scaling control data is generated 1220 for scaling the bandwidth reduced signal at a decoder or for scaling a first patch and a second patch by the decoder so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion. The spectral envelope criterion is based on the spectral envelope data. The first patch is generated from a low frequency band of the bandwidth reduced signal according to a first patching algorithm and the second patch is generated from the low frequency band of the bandwidth reduced signal according to a second patching algorithm. A spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm.
Further, the method 1200 may be extended by steps according to the concept described above. The method 1200 may be, for example, realized as a computer program for running on a computer or micro controller. Some embodiments according to the invention relate to an apparatus for generating a bandwidth extended signal using a phase vocoder for bandwidth extension combined with non-linear distortion or noise-filling for a more dense spectrum. When applying the phase vocoder for spectral spreading, frequency lines move further apart. If gaps exist in the spectrum, e.g. by quantization, the same are even increased by the spreading. In an energy adaptation, remaining lines in the spectrum receive too much energy. This is prevented by filling the gaps, either by noise or by further harmonics, which may be gained by a nonlinear distortion of the signal. This way, more energy may be distributed between the remaining lines. By the concentration of the energy in bands to only few frequency lines, a unnatural or metallic sound results. The energy of formerly more bands is summed up to the remaining ones.
If there are no gaps in the spectrum, but - at least - noise is present, a part of the energy remains in the noise floor. By application of non-linear distortion, the spectrum may be densified again on the one hand by noise produced by the distortion, on the other hand by further harmonic portions steered by an appropriate selection of the signal portion to be distorted.
The bandwidth extended signal then may be, for example, a weighted sum of a filtered distorted signal and a signal, which was generated with the help of the phase vocoder. In other words, the bandwidth extended signal may be a weighted sum of the first patch, the second patch and the first band of the input signal.
Some embodiments according to the invention relate to a concept suitable for all audio applications where the full bandwidth is not available. For example, for the broadcast of audio contents using digital radio services, internet streaming or other audio communication applications, the described concept may be applied.
While this invention has been described in terms of several embodiments, there are alterations, permutations, and equivalents which fall within the scope of this invention. It should also be noted that there are many alternative ways of implementing the methods and compositions of the present invention. It is therefore intended that the following appended claims be interpreted as including all such alterations, permutations and equivalents as fall within the true spirit and scope of the present invention.
In particular, it is pointed out that, depending on the conditions, the inventive scheme may also be implemented in software. The implementation may be on a digital storage medium, particularly a floppy disk or a CD with electronically readable control signals capable of cooperating with a programmable computer system so that the corresponding method is executed. In general, the invention thus also consists in a computer program product with a program code stored on a machine-readable carrier for performing the inventive method, when the computer program product is executed on a computer. Stated in other words, the invention may thus also be realized as a computer program with a program code for performing the method, when the computer program product is executed on a computer.

Claims

Claims
1. Apparatus (100; 300; 400; 700; 800; 900) for generating a bandwidth extended signal (122) from an input signal (102), wherein the input signal is represented, for a first band by a first resolution data, and for a second band by a second resolution data, the second resolution being lower than the first resolution, the apparatus comprising:
a patch generator (110) configured to generate a first patch (112) from the first band of the input signal (102) according to a first patching algorithm and configured to generate a second patch (114) from the first band of the input signal (102) according to a second patching algorithm, wherein a spectral density of the second patch (114) generated according to the second patching algorithm is higher than a spectral density of the first patch (112) generated according to the first patching algorithm; and
a combiner (120) configured to combine the first patch (112), the second patch (114) and the first band of the input signal (102) to obtain the bandwidth extended signal (122), wherein the apparatus for generating a bandwidth extended signal is configured to scale the input signal (102) according to the first patching algorithm and according to the second patching algorithm or to scale the first patch (112) and the second patch (1 14), so that the bandwidth extended signal fulfills (122) a spectral envelope criterion.
2. Apparatus according to claim 1 , wherein the first patching algorithm is a harmonic patching algorithm and the patch generator (110) is configured to generate the first patch (112), so that only frequencies that are integer multiples of frequencies of the first band of the input signal (102) are contained by the first patch (112).
3. Apparatus according to claims 1 or 2, wherein the second patching algorithm is a mixing patching algorithm and the patch generator (1 10) is configured to generate the second patch (114), so that the second patch (114) contains frequencies that are integer multiples of frequencies of the first band of the input signal (102) and contains frequencies that are not integer multiples of frequencies of the first band of the input signal (102).
4. Apparatus according to one of the claims 1 to 3, wherein a lower cut-off frequency of the first patch (112) is equal to a lower cut-off frequency of the second patch (114), and wherein an upper cut-off frequency of the first patch (112) is equal to an upper cut-off frequency of the second patch (114).
5. Apparatus according to one of the claims 1 to 4, comprising a phase vocoder (310) configured to generate the first patch (112) according to the first patching algorithm.
6. Apparatus according to one of the claims 1 to 5, comprising an amplitude clipper (320) configured to generate the second patch (114) according to the second patching algorithm by clipping the first band of the input signal (102).
7. Apparatus according to one of the claims 1 to 6, comprising a spectral line selector (410) configured to select a plurality of frequency lines of the second patch (114) to obtain a modified second patch (414), wherein a frequency line is selected, if a corresponding frequency line of the first patch (112) is missing, wherein the combiner (120) is configured to combine the first patch (112), the modified second patch (414) and the first band of the input signal (102).
8. Apparatus according to one of the claims 1 to 7, comprising a power controller (710) configured to control the scaling of the input signal (102) according to the first and the second patching algorithm or configured to control the scaling of the first patch (112) and the second patch (114), wherein the power controller 710 controls the scaling based on spectral envelope data contained by the input signal (102) and based on at least one stored patch scaling control parameter or patch scaling control data contained by the input signal (102).
9. Apparatus according to claim 8, comprising a first power adjustment means (720) configured to scale the input signal (102) according to the first patching algorithm or to scale the first patch (1 12), and comprising a second power adjustment means (730) configured to scale the input signal (102) according to the second patching algorithm or to scale the second patch (114), wherein the power controller (710) is configured to control the first power adjustment means (720) and the second power adjustment means (730).
10. Apparatus according to claim 8 or 9, comprising a noise adder (910) and a missing harmonic adder (920), wherein the noise adder (910) is configured to generate a noise patch (912) based on a noise data contained by the input signal, wherein the missing harmonic adder (920) is configured to generate a missing harmonic patch (922) based on a missing harmonic data contained by the input signal (102), wherein the power controller (710) is configured to control a scaling of the noise patch (912) and the missing harmonic patch (922) based on the spectral envelope data, and wherein the combiner (120) is configured to combine the first patch (112), the second patch (114), the first band of the input signal (102), the noise patch
(912) and the missing harmonic patch (922) to obtain the bandwidth extended signal (122), wherein the power controller 710 controls the scaling of the first patch (112), the second patch (114), the noise patch (912) and the missing harmonic patch (922) based on the spectral envelope data, so that the spectral envelope criterion is fulfilled.
11. Apparatus (1000) for providing a bandwidth reduced signal (1032) based on an input signal (1002), comprising:
a spectral envelope data determiner (1010) configured to determine spectral envelope data (1012) based on a high-frequency band of the input signal (1002);
a patch scaling control data generator (1020) configured to generate patch scaling control data (1022) for scaling the bandwidth reduced signal (1032) at a decoder or for scaling a first patch and a second patch by the decoder, so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion, wherein the spectral envelope criterion is based on the spectral envelope data (1012) wherein the first patch is generated from a first band of the bandwidth reduced signal (1032) according to a first patching algorithm and the second patch is generated from the first band of the bandwidth reduced signal (1032) according to a second patching algorithm, wherein a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm;
an output interface (1030) configured to combine a low frequency band of the input signal (1002), the spectral envelope data (1012) and the patch scaling control data (1022) to obtain the bandwidth reduced signal (1032) and configured to provide the bandwidth reduced signal (1032) for transmission or storage.
12. Apparatus according to claim 11, wherein the patch scaling control data generator comprises: the patch generator configured to generate a first patch from the low frequency band of the input signal (1002) according to a first patching algorithm and configured to generate a second patch from the low frequency band of the input signal (1002) according to a second patching algorithm, wherein a spectral density of the second patch generated according to the second patching algorithm is higher than the spectral density of the first patch generated according to the first patching algorithms; and
a comparator configured to compare the first patch, the second patch and the high frequency band of the input signal (1002) to obtain the patch scaling control data
(1022).
13. Apparatus according to claim 11, comprising a patch scaling control parameter memory configured to store and provide a plurality of patch scaling control parameters, wherein the patch scaling control data generator (1020) is configured to analyze the input signal (1002) and configured to generate the patch scaling control data (1022) based on stored patch scaling control parameters selected based on the analysis of the input signal (1002).
14. Audio signal comprising:
a first band represented by a first resolution data; and
a second band represented by a second resolution data, wherein the second resolution is lower than the first resolution, wherein the second resolution data is based on spectral envelope data of the second band and is based on patch scaling control data of the second band for scaling the audio signal at a decoder or for scaling a first patch and a second patch by the decoder,; so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion, wherein the spectral envelope criterion is based on the spectral envelope data, wherein the first patch is generated from the first band of the audio signal according to a first patching algorithm and the second patch is generated from the first band of the audio signal according to a second patching algorithm, wherein a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm.
15. Method (1 100) for generating a bandwidth extended signal from an input signal, wherein the input signal is represented, for a first band by a first resolution data, and for a second band by a second resolution data, the second resolution being lower than the first resolution, the method comprising:
generating (1110) a first patch from the first band of the input signal according to a first patching algorithm;
generating (1120) a second patch from the first band of the input signal according to a second patching algorithm, wherein a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm;
scaling (1130) the input signal according to the first patching algorithm and according to the second patching algorithm or scaling (1130) the first patch and the second patch, so that the bandwidth extended signal fulfills the spectral envelope criterion; and
combining (1140) the first patch, the second patch and the first band of the input signal to obtain the bandwidth extended signal.
16. Method (1200) for providing a bandwidth reduced signal based on an input signal, comprising:
determining (1210) a spectral envelope data based on a high frequency band of the input signal;
generating (1220) patch scaling control data for scaling the bandwidth reduced signal at a decoder or for scaling a first patch and a second patch by the decoder, so that a bandwidth extended signal generated by the decoder fulfills a spectral envelope criterion, wherein the spectral envelope criterion is based on the spectral envelope data, wherein the first patch is generated from a first band of the bandwidth reduced signal according to a first patching algorithm and a second patch is generated from the first band of the bandwidth reduced signal according to a second patching algorithm, wherein a spectral density of the second patch generated according to the second patching algorithm is higher than a spectral density of the first patch generated according to the first patching algorithm; combining (1230) a low frequency band of the input signal, the spectral envelope data and the patch scaling control data to obtain the bandwidth reduced signal;
providing (1240) the bandwidth reduced signal for a transmission or storage.
17. Computer program with a program code for performing the method according to claim 15 or 16, when the computer program runs on a computer or a microcontroller.
PCT/EP2009/004603 2008-07-11 2009-06-25 Apparatus and method for generating a bandwidth extended signal WO2010003557A1 (en)

Priority Applications (20)

Application Number Priority Date Filing Date Title
CA2729474A CA2729474C (en) 2008-07-11 2009-06-25 Apparatus and method for generating a bandwidth extended signal
ES09776840.2T ES2461141T3 (en) 2008-07-11 2009-06-25 Apparatus and procedure for generating an extended bandwidth signal
KR1020117000441A KR101239812B1 (en) 2008-07-11 2009-06-25 Apparatus and method for generating a bandwidth extended signal
AU2009267460A AU2009267460B2 (en) 2008-07-11 2009-06-25 Apparatus and method for generating a bandwidth extended signal
BRPI0910528-0A BRPI0910528B1 (en) 2008-07-11 2009-06-25 INSTRUMENT AND METHOD FOR GENERATING EXTENDED BANDWIDTH SIGNAL
MX2011000365A MX2011000365A (en) 2008-07-11 2009-06-25 Apparatus and method for generating a bandwidth extended signal.
CN2009801270931A CN102105931B (en) 2008-07-11 2009-06-25 Apparatus and method for generating a bandwidth extended signal
RU2011100134/08A RU2512090C2 (en) 2008-07-11 2009-06-25 Apparatus and method of generating wide bandwidth signal
JP2011516992A JP5255699B2 (en) 2008-07-11 2009-06-25 Apparatus and method for generating bandwidth extension signal
BR122017003818-4A BR122017003818B1 (en) 2008-07-11 2009-06-25 INSTRUMENT AND METHOD FOR GENERATING EXTENDED BANDWIDTH SIGNAL
EP09776840.2A EP2291842B1 (en) 2008-07-11 2009-06-25 Apparatus and method for generating a bandwidth extended signal
PL09776840T PL2291842T3 (en) 2008-07-11 2009-06-25 Apparatus and method for generating a bandwidth extended signal
TW098122551A TWI415116B (en) 2008-07-11 2009-07-03 Apparatus and method for generating a bandwidth extended signal
ARP090102552A AR072483A1 (en) 2008-07-11 2009-07-07 APPARATUS AND METHOD FOR GENERATING AN EXTENDED BANDWIDTH SIGNAL
ZA2010/09164A ZA201009164B (en) 2008-07-11 2010-12-21 Apparatus and method for generating a bandwidth extended signal
US13/004,314 US8880410B2 (en) 2008-07-11 2011-01-11 Apparatus and method for generating a bandwidth extended signal
HK11108364.8A HK1154112A1 (en) 2008-07-11 2011-08-10 Apparatus and method for generating a bandwidth extended signal
US15/341,763 USRE47180E1 (en) 2008-07-11 2016-11-02 Apparatus and method for generating a bandwidth extended signal
US16/230,764 USRE49801E1 (en) 2008-07-11 2018-12-21 Apparatus and method for generating a bandwidth extended signal
US18/342,715 US20230343357A1 (en) 2008-07-11 2023-06-27 Apparatus and Method for Generating a Bandwidth Extended Signal

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US7984908P 2008-07-11 2008-07-11
US61/079,849 2008-07-11

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/004,314 Continuation US8880410B2 (en) 2008-07-11 2011-01-11 Apparatus and method for generating a bandwidth extended signal

Publications (1)

Publication Number Publication Date
WO2010003557A1 true WO2010003557A1 (en) 2010-01-14

Family

ID=41162740

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2009/004603 WO2010003557A1 (en) 2008-07-11 2009-06-25 Apparatus and method for generating a bandwidth extended signal

Country Status (18)

Country Link
EP (1) EP2291842B1 (en)
JP (1) JP5255699B2 (en)
KR (1) KR101239812B1 (en)
CN (1) CN102105931B (en)
AR (1) AR072483A1 (en)
AU (1) AU2009267460B2 (en)
BR (2) BR122017003818B1 (en)
CA (1) CA2729474C (en)
CO (1) CO6541514A2 (en)
ES (1) ES2461141T3 (en)
HK (1) HK1154112A1 (en)
MX (1) MX2011000365A (en)
MY (1) MY163454A (en)
PL (1) PL2291842T3 (en)
RU (1) RU2512090C2 (en)
TW (1) TWI415116B (en)
WO (1) WO2010003557A1 (en)
ZA (1) ZA201009164B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011110499A1 (en) * 2010-03-09 2011-09-15 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing an audio signal using patch border alignment
WO2011128399A1 (en) * 2010-04-16 2011-10-20 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E. V. Apparatus, method and computer program for generating a wideband signal using guided bandwidth extension and blind bandwidth extension
WO2012010494A1 (en) * 2010-07-19 2012-01-26 Dolby International Ab Processing of audio signals during high frequency reconstruction
US20130263038A1 (en) * 2011-11-10 2013-10-03 Research In Motion Limited Touchscreen keyboard predictive display and generation of a set of characters
CN104221081A (en) * 2011-11-02 2014-12-17 瑞典爱立信有限公司 Generation of a high band extension of a bandwidth extended audio signal
US9240196B2 (en) 2010-03-09 2016-01-19 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for handling transient sound events in audio signals when changing the replay speed or pitch
US9318127B2 (en) 2010-03-09 2016-04-19 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Device and method for improved magnitude response and temporal alignment in a phase vocoder based bandwidth extension method for audio signals
WO2016149085A3 (en) * 2015-03-13 2016-11-17 Psyx Research, Inc. System and method for dynamic recovery of audio data and compressed audio enhancement
RU2607262C2 (en) * 2012-08-27 2017-01-10 Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. Device and method for reproducing an audio signal, device and method for generating encoded audio signal, computer program and encoded audio signal
RU2651218C2 (en) * 2014-02-13 2018-04-18 Квэлкомм Инкорпорейтед Harmonic extension of audio signal bands
US9997162B2 (en) 2012-09-17 2018-06-12 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for generating a bandwidth extended signal from a bandwidth limited audio signal
RU2682340C1 (en) * 2010-09-16 2019-03-19 Долби Интернешнл Аб Cross product-enhanced, subband block-based harmonic transposition
JP2021073535A (en) * 2010-01-19 2021-05-13 ドルビー・インターナショナル・アーベー Improved subband block based harmonic transposition
US20230386485A1 (en) * 2014-07-28 2023-11-30 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder and decoder using a frequency domain processor , a time domain processor, and a cross processing for continuous initialization
US12002476B2 (en) 2010-07-19 2024-06-04 Dolby International Ab Processing of audio signals during high frequency reconstruction

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102543086B (en) * 2011-12-16 2013-08-14 大连理工大学 Device and method for expanding speech bandwidth based on audio watermarking
EP2830060A1 (en) * 2013-07-22 2015-01-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Noise filling in multichannel audio coding
JP2016038435A (en) 2014-08-06 2016-03-22 ソニー株式会社 Encoding device and method, decoding device and method, and program
RU2589305C1 (en) * 2014-11-18 2016-07-10 Федеральное государственное казенное военное образовательное учреждение высшего профессионального образования "Военный учебно-научный центр Военно-воздушных сил "Военно-воздушная академия имени профессора Н.Е. Жуковского и Ю.А. Гагарина" (г. Воронеж) Министерства обороны Российской Федерации High-frequency signal generation method and device for its implementation
EP3121814A1 (en) * 2015-07-24 2017-01-25 Sound object techology S.A. in organization A method and a system for decomposition of acoustic signal into sound objects, a sound object and its use
TW202341126A (en) 2017-03-23 2023-10-16 瑞典商都比國際公司 Backward-compatible integration of harmonic transposer for high frequency reconstruction of audio signals

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US654988A (en) * 1900-03-16 1900-07-31 Leonhard Lederer Process of making acetyl cellulose.
US5455888A (en) * 1992-12-04 1995-10-03 Northern Telecom Limited Speech bandwidth extension method and apparatus
RU2256293C2 (en) * 1997-06-10 2005-07-10 Коудинг Технолоджиз Аб Improving initial coding using duplicating band
SE512719C2 (en) * 1997-06-10 2000-05-02 Lars Gustaf Liljeryd A method and apparatus for reducing data flow based on harmonic bandwidth expansion
EP0945852A1 (en) * 1998-03-25 1999-09-29 BRITISH TELECOMMUNICATIONS public limited company Speech synthesis
SE9903553D0 (en) * 1999-01-27 1999-10-01 Lars Liljeryd Enhancing conceptual performance of SBR and related coding methods by adaptive noise addition (ANA) and noise substitution limiting (NSL)
SE0004163D0 (en) * 2000-11-14 2000-11-14 Coding Technologies Sweden Ab Enhancing perceptual performance or high frequency reconstruction coding methods by adaptive filtering
US7260541B2 (en) 2001-07-13 2007-08-21 Matsushita Electric Industrial Co., Ltd. Audio signal decoding device and audio signal encoding device
KR20040035749A (en) * 2001-08-31 2004-04-29 코닌클리케 필립스 일렉트로닉스 엔.브이. Bandwidth extension of a sound signal
JP4380174B2 (en) * 2003-02-27 2009-12-09 沖電気工業株式会社 Band correction device
CA2526261A1 (en) * 2003-05-20 2004-12-02 Matsushita Electric Industrial Co., Ltd. Method and apparatus for extending band of audio signal using higher harmonic wave generator
JP2005010621A (en) * 2003-06-20 2005-01-13 Matsushita Electric Ind Co Ltd Voice band expanding device and band expanding method
CN101044553B (en) * 2004-10-28 2011-06-01 松下电器产业株式会社 Scalable encoding apparatus, scalable decoding apparatus, and methods thereof
KR100647336B1 (en) * 2005-11-08 2006-11-23 삼성전자주식회사 Apparatus and method for adaptive time/frequency-based encoding/decoding
JP5141180B2 (en) * 2006-11-09 2013-02-13 ソニー株式会社 Frequency band expanding apparatus, frequency band expanding method, reproducing apparatus and reproducing method, program, and recording medium

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
DIETZ M ET AL: "SPECTRAL BAND REPLICATION, A NOVEL APPROACH IN AUDIO CODING", AUDIO ENGINEERING SOCIETY CONVENTION PAPER, NEW YORK, NY, US, vol. 112, no. 5553, 10 May 2002 (2002-05-10), pages 1 - 08, XP009020921 *
M. WOLTERS: "A closer look into MPEG-4 High Efficiency AAC", AES CONVENTION PAPER, 10 October 2003 (2003-10-10)
TSG-SA WG4: "3GPP TS 26.404 version 2.0.0 Enhanced aacPlus General Audio Codec; Encoder specification; Spectral Band Replication (SBR) part (Release 6)", 3GPP DRAFT; SP-040636, 3RD GENERATION PARTNERSHIP PROJECT (3GPP), MOBILE COMPETENCE CENTRE ; 650, ROUTE DES LUCIOLES ; F-06921 SOPHIA-ANTIPOLIS CEDEX ; FRANCE, vol. TSG SA, no. Palm Springs, CA, USA; 20040902, 2 September 2004 (2004-09-02), XP050202963 *
WOLTERS M ET AL: "A CLOSER LOOK INTO MPEG-4 HIGH EFFICIENCY AAC", PREPRINTS OF PAPERS PRESENTED AT THE AES CONVENTION, XX, XX, vol. 115, 10 October 2003 (2003-10-10), XP008063876 *

Cited By (68)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021073535A (en) * 2010-01-19 2021-05-13 ドルビー・インターナショナル・アーベー Improved subband block based harmonic transposition
JP7551023B1 (en) 2010-01-19 2024-09-13 ドルビー・インターナショナル・アーベー Improved subband block based harmonic transposition
JP7522331B1 (en) 2010-01-19 2024-07-24 ドルビー・インターナショナル・アーベー Improved subband block based harmonic transposition
JP7475410B2 (en) 2010-01-19 2024-04-26 ドルビー・インターナショナル・アーベー Improved subband block based harmonic transposition
JP2023011648A (en) * 2010-01-19 2023-01-24 ドルビー・インターナショナル・アーベー Improvement of harmonic transposition based on subband block
JP7160968B2 (en) 2010-01-19 2022-10-25 ドルビー・インターナショナル・アーベー Improved harmonic transposition based on subband blocks
US11495236B2 (en) 2010-03-09 2022-11-08 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing an input audio signal using cascaded filterbanks
US10770079B2 (en) 2010-03-09 2020-09-08 Franhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing an input audio signal using cascaded filterbanks
US9792915B2 (en) 2010-03-09 2017-10-17 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing an input audio signal using cascaded filterbanks
US9905235B2 (en) 2010-03-09 2018-02-27 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Device and method for improved magnitude response and temporal alignment in a phase vocoder based bandwidth extension method for audio signals
US10032458B2 (en) 2010-03-09 2018-07-24 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing an input audio signal using cascaded filterbanks
US11894002B2 (en) 2010-03-09 2024-02-06 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung Apparatus and method for processing an input audio signal using cascaded filterbanks
AU2011226211B2 (en) * 2010-03-09 2014-01-09 Dolby International Ab Apparatus and method for processing an audio signal using patch border alignment
CN103038819A (en) * 2010-03-09 2013-04-10 弗兰霍菲尔运输应用研究公司 Apparatus and method for processing an audio signal using patch border alignment
WO2011110499A1 (en) * 2010-03-09 2011-09-15 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing an audio signal using patch border alignment
US9318127B2 (en) 2010-03-09 2016-04-19 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Device and method for improved magnitude response and temporal alignment in a phase vocoder based bandwidth extension method for audio signals
US9240196B2 (en) 2010-03-09 2016-01-19 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for handling transient sound events in audio signals when changing the replay speed or pitch
US9305557B2 (en) 2010-03-09 2016-04-05 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing an audio signal using patch border alignment
JP2013525833A (en) * 2010-04-16 2013-06-20 フラウンホーファーゲゼルシャフト ツール フォルデルング デル アンゲヴァンテン フォルシユング エー.フアー. Apparatus, method and computer program for generating a wideband signal using guided bandwidth extension and blind bandwidth extension
US9805735B2 (en) 2010-04-16 2017-10-31 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus, method and computer program for generating a wideband signal using guided bandwidth extension and blind bandwidth extension
RU2527735C2 (en) * 2010-04-16 2014-09-10 Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. Apparatus, method and computer programme for generating broadband signal using controlled bandwidth expansion and blind bandwidth expansion
CN102947882A (en) * 2010-04-16 2013-02-27 弗劳恩霍夫应用研究促进协会 Apparatus, method and computer program for generating a wideband signal using guided bandwidth extension and blind bandwidth extension
AU2011239995B2 (en) * 2010-04-16 2014-01-16 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E. V. Apparatus, method and computer program for generating a wideband signal using guided bandwidth extension and blind bandwidth extension
WO2011128399A1 (en) * 2010-04-16 2011-10-20 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E. V. Apparatus, method and computer program for generating a wideband signal using guided bandwidth extension and blind bandwidth extension
US9640184B2 (en) 2010-07-19 2017-05-02 Dolby International Ab Processing of audio signals during high frequency reconstruction
US11031019B2 (en) 2010-07-19 2021-06-08 Dolby International Ab Processing of audio signals during high frequency reconstruction
US12131742B2 (en) 2010-07-19 2024-10-29 Dolby International Ab Processing of audio signals during high frequency reconstruction
EP3288032A1 (en) * 2010-07-19 2018-02-28 Dolby International AB Processing of audio signals during high frequency reconstruction
US9911431B2 (en) 2010-07-19 2018-03-06 Dolby International Ab Processing of audio signals during high frequency reconstruction
EP3291230A1 (en) * 2010-07-19 2018-03-07 Dolby International AB Processing of audio signals during high frequency reconstruction
US12106761B2 (en) 2010-07-19 2024-10-01 Dolby International Ab Processing of audio signals during high frequency reconstruction
US12106762B2 (en) 2010-07-19 2024-10-01 Dolby International Ab Processing of audio signals during high frequency reconstruction
RU2659487C2 (en) * 2010-07-19 2018-07-02 Долби Интернешнл Аб Coder and decoder of sound signal, method of generation of control data from sound signal and method for decoding the bit flow
EP3544009A1 (en) * 2010-07-19 2019-09-25 Dolby International AB Processing of audio signals during high frequency reconstruction
EP3544008A1 (en) * 2010-07-19 2019-09-25 Dolby International AB Processing of audio signals during high frequency reconstruction
US10283122B2 (en) 2010-07-19 2019-05-07 Dolby International Ab Processing of audio signals during high frequency reconstruction
US12002476B2 (en) 2010-07-19 2024-06-04 Dolby International Ab Processing of audio signals during high frequency reconstruction
WO2012010494A1 (en) * 2010-07-19 2012-01-26 Dolby International Ab Processing of audio signals during high frequency reconstruction
AU2011281735B2 (en) * 2010-07-19 2014-07-24 Dolby International Ab Processing of audio signals during High Frequency Reconstruction
EP3544007A1 (en) * 2010-07-19 2019-09-25 Dolby International AB Processing of audio signals during high frequency reconstruction
EP2765572A1 (en) * 2010-07-19 2014-08-13 Dolby International AB Processing of audio signals during high frequency reconstruction
EP4210051A1 (en) * 2010-07-19 2023-07-12 Dolby International AB Processing of audio signals during high frequency reconstruction
AU2022215250B2 (en) * 2010-07-19 2023-02-02 Dolby International Ab Processing of audio signals during high frequency reconstruction
EP3723089A1 (en) * 2010-07-19 2020-10-14 Dolby International AB Processing of audio signals during high frequency reconstruction
US9117459B2 (en) 2010-07-19 2015-08-25 Dolby International Ab Processing of audio signals during high frequency reconstruction
EP3285258A1 (en) * 2010-07-19 2018-02-21 Dolby International AB Processing of audio signals during high frequency reconstruction
AU2020233759B2 (en) * 2010-07-19 2021-09-16 Dolby International Ab Processing of Audio Signals during High Frequency Reconstruction
RU2758466C2 (en) * 2010-07-19 2021-10-28 Долби Интернешнл Аб System and method for generating a number of signals of high-frequency sub-bands
AU2021277643B2 (en) * 2010-07-19 2022-05-12 Dolby International Ab Processing of Audio Signals during High Frequency Reconstruction
US11568880B2 (en) 2010-07-19 2023-01-31 Dolby International Ab Processing of audio signals during high frequency reconstruction
EP4016527A1 (en) * 2010-07-19 2022-06-22 Dolby International AB Processing of audio signals during high frequency reconstruction
CN103155033A (en) * 2010-07-19 2013-06-12 杜比国际公司 Processing of audio signals during high frequency reconstruction
CN104575517A (en) * 2010-07-19 2015-04-29 杜比国际公司 Processing of audio signals during high frequency reconstruction
US12033645B2 (en) 2010-09-16 2024-07-09 Dolby International Ab Cross product enhanced subband block based harmonic transposition
RU2682340C1 (en) * 2010-09-16 2019-03-19 Долби Интернешнл Аб Cross product-enhanced, subband block-based harmonic transposition
US10446161B2 (en) 2010-09-16 2019-10-15 Dolby International Ab Cross product enhanced subband block based harmonic transposition
US10706863B2 (en) 2010-09-16 2020-07-07 Dolby International Ab Cross product enhanced subband block based harmonic transposition
US11817110B2 (en) 2010-09-16 2023-11-14 Dolby International Ab Cross product enhanced subband block based harmonic transposition
US11355133B2 (en) 2010-09-16 2022-06-07 Dolby International Ab Cross product enhanced subband block based harmonic transposition
CN104221081A (en) * 2011-11-02 2014-12-17 瑞典爱立信有限公司 Generation of a high band extension of a bandwidth extended audio signal
CN104221081B (en) * 2011-11-02 2017-03-15 瑞典爱立信有限公司 The generation of the high frequency band extension of bandwidth extended audio signal
US20130263038A1 (en) * 2011-11-10 2013-10-03 Research In Motion Limited Touchscreen keyboard predictive display and generation of a set of characters
RU2607262C2 (en) * 2012-08-27 2017-01-10 Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. Device and method for reproducing an audio signal, device and method for generating encoded audio signal, computer program and encoded audio signal
US10580415B2 (en) 2012-09-17 2020-03-03 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for generating a bandwidth extended signal from a bandwidth limited audio signal
US9997162B2 (en) 2012-09-17 2018-06-12 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for generating a bandwidth extended signal from a bandwidth limited audio signal
RU2651218C2 (en) * 2014-02-13 2018-04-18 Квэлкомм Инкорпорейтед Harmonic extension of audio signal bands
US20230386485A1 (en) * 2014-07-28 2023-11-30 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder and decoder using a frequency domain processor , a time domain processor, and a cross processing for continuous initialization
WO2016149085A3 (en) * 2015-03-13 2016-11-17 Psyx Research, Inc. System and method for dynamic recovery of audio data and compressed audio enhancement

Also Published As

Publication number Publication date
BRPI0910528B1 (en) 2020-09-24
MX2011000365A (en) 2011-02-25
PL2291842T3 (en) 2014-08-29
RU2512090C2 (en) 2014-04-10
EP2291842A1 (en) 2011-03-09
KR101239812B1 (en) 2013-03-06
CA2729474A1 (en) 2010-01-14
CO6541514A2 (en) 2012-10-16
ZA201009164B (en) 2011-10-26
KR20110033188A (en) 2011-03-30
MY163454A (en) 2017-09-15
CN102105931B (en) 2013-04-10
BRPI0910528A2 (en) 2018-05-22
ES2461141T3 (en) 2014-05-16
TWI415116B (en) 2013-11-11
RU2011100134A (en) 2012-07-20
JP5255699B2 (en) 2013-08-07
BR122017003818A2 (en) 2019-09-03
JP2011527452A (en) 2011-10-27
AU2009267460B2 (en) 2013-01-10
TW201007708A (en) 2010-02-16
AR072483A1 (en) 2010-09-01
BR122017003818B1 (en) 2024-03-05
HK1154112A1 (en) 2012-04-20
CN102105931A (en) 2011-06-22
AU2009267460A1 (en) 2010-01-14
CA2729474C (en) 2015-09-01
EP2291842B1 (en) 2014-03-12

Similar Documents

Publication Publication Date Title
CA2729474C (en) Apparatus and method for generating a bandwidth extended signal
US8880410B2 (en) Apparatus and method for generating a bandwidth extended signal
AU2009210303B2 (en) Device and method for a bandwidth extension of an audio signal
KR101369267B1 (en) Audio encoder and bandwidth extension decoder
US20230343355A1 (en) Apparatus and Method for Generating a Bandwidth Extended Signal
AU2019409071B2 (en) Audio processor and method for generating a frequency enhanced audio signal using pulse processing

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980127093.1

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09776840

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2009776840

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2729474

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2009267460

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 10164070

Country of ref document: CO

ENP Entry into the national phase

Ref document number: 20117000441

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 132/KOLNP/2011

Country of ref document: IN

Ref document number: 2011010059

Country of ref document: EG

Ref document number: MX/A/2011/000365

Country of ref document: MX

ENP Entry into the national phase

Ref document number: 2011516992

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2011100134

Country of ref document: RU

ENP Entry into the national phase

Ref document number: 2009267460

Country of ref document: AU

Date of ref document: 20090625

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01E

Ref document number: PI0910528

Country of ref document: BR

ENP Entry into the national phase

Ref document number: PI0910528

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20110107