METHOD AND SYSTEM FOR DETERMINING A HEADER-RELATED TRANSFER FUNCTION AND METHOD FOR DETERMINING A SE

专利摘要:
method and system for generating header-related transfer function by linear mixing of header-related transfer functions. The present invention relates to a method for performing linear mixing over header-related transfer functions (hrtfs) to determine an interpolated hrtf for any specified arrival direction in a swath (e.g., a swath spanning at least 60 degrees in a swath. plane, or a full 360 degree range in one plane), where the coupled hrtfs are predetermined to have properties such that linear mixing can be performed on them (to generate interpolated hrtfs) without introducing significant comb filtration distortion. in some embodiments, the method includes steps of: in response to a signal indicative of a specified arrival direction, linearly mixing data indicative of coupled hrtfs from a set of coupled hrtfs to determine an hrtf for the specified arrival direction; and perform hrtf filtering on an incoming audio signal using hrtf for the specified arrival direction.
公开号:BR112014022438B1
申请号:R112014022438-2
申请日:2013-03-21
公开日:2021-08-24
发明作者:David S. Mcgrath
申请人:Dolby Laboratories Licensing Corporation；
IPC主号:

专利说明:

CROSS REFERENCE TO RELATED ORDERS
[1] This application claims priority to US Provisional Patent Application No. 61/614,610, filed March 23, 2012, which is fully incorporated herein by reference. BACKGROUND OF THE INVENTION FIELD OF THE INVENTION
[2] The present invention relates to methods and systems for performing interpolation on header-related transfer functions (HRTFs) to generate interpolated HRTFs. More specifically, the invention relates to methods and systems for performing linear mixing on coupled HRTFs (i.e., the values that determine the coupled HRTFs) to determine the interpolated HRTFs, to perform filtration with the interpolated HRTFs, and to predetermine the coupled HRTFs to have properties so that interpolation can be performed on them in a specially desired mode (by linear mixing). BACKGROUND OF THE INVENTION
[3] Throughout this disclosure, including embodiments, the expression performing an operation "on" signals or data (eg, filtering, scaling, or transforming the signals or data) is used in a broad sense to mean performing the operation directly on the signals or data, or about processed versions of the signals or data (for example, in versions of the signals that have been preliminarily filtered before performing the operation on them).
[4] Throughout this disclosure, including the embodiments, the term "linear mixture" of values (e.g., coefficients that determine header-related transfer functions) means to determine a linear combination of values. In this document, performing "linear interpolation" on header-related transfer functions (HRTFs) to determine an interpolated HRTF means performing linear mixing of the values that determine the HRTFs (determining a linear combination of such values) to determine values that determine the interpolated HRTF.
[5] Throughout this disclosure, including the embodiments, the expression "system" is used in a broad sense to mean a device, system or subsystem. For example, a subsystem that implements mapping may be referred to as a mapping system (or a mapper), and a system including such a subsystem (for example, a system that performs various types of processing over audio input, where the subsystem determines a transfer function for use in one of the processing operations) may also be referred to as a mapping system (or a mapper).
[6] Throughout this disclosure, including embodiments, the term "render" means the process of converting an audio signal (eg, a multi-channel audio signal) into one or more speaker feeds (where each speaker feed is an audio signal to be applied directly to a speaker or to an amplifier and speaker in series), or the process of converting an audio signal into one or more speaker feeds and converting the feed(s)( tions) for speakers in sound using one or more speakers. In the latter case, rendering is sometimes referred to in this document as “by” speaker(s) rendering.
[7] Throughout this disclosure, including the embodiments, the terms “talker” and “speaker” are used synonymously to mean any sound emission transducer. This definition includes speakers implemented as multiple transducers (for example, “low frequency speaker” and “high-frequency speaker”).
[8] Throughout this disclosure, including in embodiments, overbo "includes" is used in a broad sense to mean "is or includes", and other forms of the verb "include" are used in the same broad sense. For example, the expression “a filter that includes a feedback filter” (or the expression “a filter including a feedback filter”), in this document, means both a filter that is a feedback filter. is, does not include a pre-feed filter), or filter that includes a feedback filter (and at least one other filter).
[9] Throughout this disclosure, including embodiments, the term "virtualizer" (or "virtualizer system") means a system coupled and configured to receive N input audio signals (sound indicative of a set of source locations) and to generate M output audio signals for reproduction by a set of M physical speakers (eg headphones or speakers) positioned at output locations other than source locations, where each of N and M is one number greater than one. N can be equal to or different from M. A virtualizer generates (or attempts to generate) the output audio signals so that when played back, the listener perceives the reproduced signals as being emitted from source locations rather than physical speaker output locations (source locations and output locations are relative to the listener). For example, in the case where M = 2 and N = 1, a virtualizer mixes the input signal to generate left and right output signals for stereo playback (or headphone playback). For another example, in the case where M = 2 and N > 3, a virtualizer mixes the N input signals for stereo reproduction. In another example where N = M = 2, the input signals are indicative of sound from two rear source locations (behind the listener's head), and a virtualizer generates two output audio signals for playback through stereo speakers positioned in front of the listener so that the listener perceives the reproduced signals as emitting from the source locations (behind the listener's head) rather than from the speaker locations (in front of the listener's head).
[10] Header-related transfer functions (“HRTFs”) are filter characteristics (represented as impulse responses or frequency responses) that represent the way in which free space sound propagates to both ears of a human individual. HRTFs vary from person to person, and also vary depending on the angle of arrival of the acoustic waves. Applying an HRTF filter to the right ear (ie, applying a filter having an HRTF impulse response to the right ear) to a sound signal, x(t), can produce an HRTF-filtered signal, XR( t), indicative of the sound signal as it may be perceived by a listener after propagation in a specific direction of arrival from a source to the listener's right ear. Applying a left ear HRTF filter (i.e. applying a filter having a left ear HRTF impulse response) to the sound signal, x(t), can produce an HRTF filtered signal, xL(t) ), indicative of the sound signal as it may be perceived by the listener after propagation in a specific direction of arrival from a source to the listener's left ear.
[11] Although HRTFs are often referred to in this document as “pulse responses”, each such HRTF may alternatively be referred to by other expressions, including “transfer function”, “frequency response and “filter response”. An HRTF can be represented as a time-domain impulse response or as a frequency-domain frequency response.
[12] Applicants can define the direction of arrival in terms of Azimuth and Elevation angles (Az, El), or in terms of a unit vector (x, y, z). For example, in Figure 1, the direction of sound arrival (to listener 1's ears) can be defined in terms and a unit vector (x, y, z), where the x and y axes are as shown, and the z axis is perpendicular to the plane of Figure 1, and the direction of arrival of the sound can also be defined in terms of the Azimuth angle Az shown (for example, with an Elevation angle, El, equal to zero).
[13] Figure 2 shows the direction of arrival of sound (emitted from source position S) at location L (eg, the location of a listener's ear), defined in terms of a unit vector (x, y, z) , where the x, y and z axes are as shown, and in terms of azimuth angle Az and elevation angle, El.
[14] It is common to take HRTF measurements for individuals emitting sound from different directions, and capturing the response of the listener's ears. Measurements can be made close to the listener's eardrum, or at the entrance to the blocked ear canal, or by other methods that are BM known in the art. The measured HRTF responses can be modified in a number of ways (also well known in the art) to compensate for the equalization of the speaker used in measurements, as well as to compensate for the equalization of the headphones that will be used later in presenting the material. binaural to the listener.
[15] A typical use of HRTFs is as filter responses for signal processing designed to create the illusion of 3D sound for a listener wearing headphones. Other typical uses for HRTFs include creating enhanced audio signal reproduction through speakers. For example, it is conventional to use HRTFs to implement a virtualizer that generates output audio signals (in response to input audio signals indicative of sound from a set of source locations) so that when the audio signals from output are played by talkers, they are perceived to be emitted from the source locations rather than the physical talker locations (where the source locations and the output locations are relative to the listener). Virtualizers can be implemented on a wide variety of multimedia devices that contain stereo speakers (televisions, PCs, iPod docks), or are intended for use with stereo speakers or headphones.
[16] Virtual surround sound can help create the perception that there are more sound sources than there are physical speakers (eg headphones or speakers). Typically, at least two speakers are required for a normal listener to perceive sound reproduced as if it were emitting from multiple sound sources. It is conventional for virtual surrounding systems to use HRTFs to generate audio signals which, when played back by physical speakers (eg a pair of physical speakers) positioned in front of a listener are perceived in the listener's eardrums as sound from speakers in any one of a wide variety of positions (including positions behind the listener).
[17] Most or all of the conventional uses of HRTFs can benefit from modalities of the invention. BRIEF DESCRIPTION OF THE INVENTION
[18] In a class of modalities, the invention is a method to perform linear mixing over coupled HRTFs (ie, over values that determine the coupled HRTFs) to determine an interpolated HRTF for any specified arrival direction in a swath (eg, a range spanning at least 60 degrees in a plane, or a full range of 360 degrees in a plane), where the coupled HRTFs have been predetermined to have properties such that linear blending can be performed on them (to generate interpolated HRTFs) without introducing significant comb filtration distortion (in the sense that each interpolated HRTF determined by such a linear mixture has a magnitude response that does not demonstrate significant comb filtration distortion).
[19] Typically, linear mixing is performed on values of a "set of coupled HRTFs", where the set of coupled HRTFs comprises values that determine a set of coupled HRTFs, each of the coupled HRTFs corresponding to one of a set of at least two directions of arrival. Typically, the set of coupled HRTFs includes a small number of coupled HRTFs, each for a different from a small number of arrival directions within a space (eg, a plane, or part of a plane), and linear interpolation performed over HRTFs coupled in the set determines an HRTF for any specified arrival direction in space. Typically, the set of mated HRTFs includes a pair of mated HRTFs (one left ear mated HRTF and one right ear mated HRTF) for each of a small number of arrival angles that span a space (e.g., a horizontal plane ) and are quantized to a particular angular resolution. For example, the set of coupled HRTFs can consist of a pair of coupled HRTFs for each of twelve arrival angles around a 360 degree circle (ie, angles of 0, 30, 60,..., 300, and 330 degrees).
[20] In some embodiments, the method of the invention uses (eg, includes steps to determine and use) a base set of HRTFs. For example, the base set of HRTFs can be determined (from the set of predetermined coupled HRTFs) by performing a least squares mean fit, or other fitting process, to determine coefficients from the base set of HRTFs such that the set of HRTF base determines the set of HRTFs bound to the proper (default) precision. The strain "determines" the set of coupled HRTFs in the sense that linear communication of values (eg, coefficients) from the base set of HRTFs (in response to a specified arrival direction) determines the same HRTF (to within the proper precision ) determined by the linear combination of coupled HRTFs in the set of coupled HRTFs in response to the same direction of arrival.
[21] Coupled HRTFs generated or employed in typical embodiments of the invention differ from normal HRTFs (eg, physically measured HRTFs) in that they have a significantly reduced interauditory group delay at high frequencies (above a coupling frequency), while still providing a well-matched interauditory phase response (compared to that provided by a pair of normal left and right ear HRTFs) at low frequencies (below the coupling frequency). The coupling frequency is greater than 700 Hz and typically less than 4 kHz. The coupled HRTFs of a set of coupled HRTFs generated (or employed) in typical embodiments of the invention are typically determined from normal HRTFs (for the same arrival directions) by intentionally changing the phase response of each normal HRTF above the coupling frequency (for produce a corresponding coupled HRTF). This is done so that the phase responses of all HRTF-coupled filters in the set are coupled above the coupling frequency (i.e., so that the difference between the phase of each left ear-coupled HRTF and each HRTF-coupled from right ear is at least substantially constant as a function of frequency, for all frequencies substantially above the coupling frequency, and preferably such that the phase response of each HRTF coupled in the set is at least substantially constant as a frequency function for all frequencies substantially above the coupling frequency).
[22] In typical embodiments, the method of the invention includes the steps of:
[23] (a) in response to a signal indicative of a specified direction of arrival (eg data indicative of the specified direction of arrival), perform linear mixing on data indicative of coupled HRTFs from a set of coupled HRTFs (where the set of Coupled HRTFs comprise values that determine a set of coupled HRTFs, each of the coupled HRTFs corresponding to one of a set of at least two arrival directions) to determine an HRTF for the specified arrival direction; and
[24] (b) perform HRTF filtering on an audio input signal (for example, frequency domain audio data indicative of one or more audio channels, or time domain audio data indicative of one or more channels audio), using the HRTF for the specified arrival direction. In some embodiments, step (a) includes the step of performing linear mixing over coefficients from a base set of HRTFs to determine the HRTF for the specified arrival direction, where the base set of HRTFs determines the set of coupled HRTFs.
[25] In some embodiments, the invention is an HRTF mapper (and a mapping method implemented by HRTF mapper TAM) (configured to perform linear interpolation on linear mixing of) coupled HRTFs from a set of coupled HRTFs, to determine an HRTF for any specified arrival direction in a swath (eg a swath spanning at least 60 degrees in a plane, or a full 360 degree swath in a plane, or even the full range of arrival angles in three dimensions). In some embodiments, the HRTF mapper is configured to linearly mix filter coefficients from a base set of HRTFs (which in turn determines a set of coupled HRTFs) to determine an HRTF for any specified arrival direction in a range (eg a range spanning at least 60 degrees in a plane, a full 360 degree range in a plane, or even the full range of arrival angles in three dimensions).
[26] In a class of embodiments, the invention is a method and system for performing HRTF filtering on an input audio signal (eg, frequency domain audio data indicative of one or more audio channels, or audio data. time domain audio indicative of one or more audio channels). The system includes an HRTF mapper (coupled to receive a signal, eg data, indicative of an arrival direction, and an HRTF filter subsystem (eg stage) coupled to receive the audio input signal and configured to filter the input audio signal using an HRTF determined by the HRTF mapper in response to the direction of arrival. For example, the mapper can store (or be configured to access) data by determining a base set of HRTFs (which in turn determines a set of coupled HRTFs), and can be configured to perform linear combination of coefficients from the base set of HRTFs in a mode determined by the direction of arrival (for example, an arrival direction, specified as an angle or a unit vector, corresponding to an audio data set secured to the HRTF filter subsystem) to determine a pair of HRTFs (that is, a left ear HRTF and a right ear HRTF) for c direction arrival. The HRTF filter subsystem can be configured to filter a set of incoming audio data secured in it, with a pair of HRTFs determined by the mapper for an inbound direction corresponding to the incoming audio data. In some embodiments, the HRTF filter subsystem implements a virtualizer, eg a virtualizer configured to process indicated data from a monophonic input audio signal to generate left and right audio output channels (eg for presentation over headphones in order to provide a listener with an impression of sound emitted from a source in the specified arrival direction). In some embodiments, the virtualizer is configured to generate output audio (in response to input audio indicative of sound from a fixed source) indicative of sound from a source that is panned smoothly between arrival angles in a space transposed by an array of coupled HRTFs (without introducing significant comb filtration distortion).
[27] By using a set of coupled HRTFs determined according to a class of modalities of the invention, the incoming audio can be processed so that it appears to arrive from any angle in a space spanned by the set of coupled HRTFs, including angles that do not match exactly to the coupled HRTFs included in the kit, without introducing significant comb filtration distortion.
[28] Typical embodiments of the invention determine (or determine and use) a set of coupled HRTFs that meet the following three criteria (sometimes referred to herein for convenience as the "Golden Rule"):
[29] 1. The interauditory phase response of each pair of HRTF filters (that is, each left ear HRTF and right ear HRTF created for a specified arrival direction) that are created from the set of coupled HRTFs (by a linear mixing process) equals the interauditory phase response of a corresponding pair of normal left ear and right ear HRTFs with less than 20% phase error (or more preferably, with less than 5% phase error ), for all frequencies below a coupling frequency. The coupling frequency is greater than 700 Hz and is typically less than 4 kHz. In other words, the absolute value of the difference between the left ear HRTF phase created from the ensemble and the corresponding right ear HRTF phase created from the set differs by less than 20% (or more preferably less than 5% of the absolute value of the difference between the corresponding left ear normal HRTF phase and the corresponding right ear normal HRTF phase at each frequency below the coupling frequency. At frequencies above the coupling frequency, the phase response of the HRTF filters that are created from the set (by the linear mixing process) deviates from the behavior of normal HRTFs, so the delay intra-auditory group (at such high frequencies) is significantly reduced compared to normal HRTFs;
[30] 2. The magnitude response of each HRTF filter created from the set (by a linear mixing process) for an incoming direction is within the expected range for normal HRTFs for the incoming direction (eg towards where it does not demonstrate significant comb filter distortion relative to the magnitude response of a typical normal HRTF filter to the inbound direction); and
[31] 3. The range of arrival angles that can be transposed by the blending process (to generate a pair of HRTFs for each arrival angle in the range by a linear blend-in-set coupled HRTFs process) is at least 60 degrees ( and preferably it is 360 degrees).
[32] One aspect of the invention is a system configured to carry out any embodiment of the method of the invention. In some embodiments, the system of the invention is or includes a general or special purpose processor (e.g., a digital audio signal processor) programmed with software (or firmware) and/or otherwise configured to perform an embodiment of the method. of the invention. In some embodiments, the system of the invention is implemented by properly configuring (e.g., programming) a configurable digital audio signal processor (DSP). The audio DSP can be a conventional audio DSP that is configurable (eg, programmable by the appropriate software or firmware, or otherwise configurable in response to control data) to perform any of a variety of audio operations. input, as well as to carry out an embodiment of the method of the invention. In operation, an audio DSP that has been configured to perform an embodiment of the method of the invention according to the invention is coupled to receive at least one input audio signal, and at least one signal indicative of an arrival direction, and the DSP typically performs a variety of operations on each said input signal, in addition to performing HRTF filtering thereof in accordance with the method embodiment of the invention.
[33] Other aspects of the invention are methods for generating a set of coupled HRTFs (eg, one that meets the Golden Rule described in this document), a computer-readable medium (eg, a disk) that stores (in tangible form ) code to program a processor or other system to perform any modality of the method of the invention, and a computer-readable medium (eg, a disk) that stores (in tangible form) data that determines a set of coupled HRTFs, where the set of coupled HRTFs was determined in accordance with an embodiment of the invention (for example, to satisfy the Golden Rule described herein). BRIEF DESCRIPTION OF THE DRAWINGS
[34] Figure 1 is a diagram showing the definition of a sound arrival direction (to listener 1's ears) in terms of a unit vector (x, y, z), where the z axis is perpendicular to the plane of figure 1 , and in terms of the Azimuth angle Az (with an Elevation angle El, equal to zero).
[35] Figure 2 is a diagram showing the definition of a direction of arrival of sound (emitted from source position S) at location L, in terms of a unit vector (x, y, z), and in terms of the angle of Azimuth Az and Elevation angle El.
[36] Figure 3 is a set of plotted (tempoversus magnitude) plots of conventionally determined HRTF impulse response pairs for 35 and 55 degrees Azimuth angles (labeled HRTFL (35.0) and HRTFR (35.0 ), and HRTFL (55.0) and HRTFR (55.0)), a pair of conventionally determined HRTF impulse responses (measured) for 45 degree Azimuth angle (labeled HRTFL (45.0) and HRTFR (45 ,0), and a pair of HRTF impulse responses synthesized to 45 degree Azimuth angle (labeled HRTFL (35.0) + HRTFL (55.0)/2 and (HRTFR (35.0) + HRTFR (55.0)/2) generated by linearly mixing conventional HRTF impulse responses for azimuth angles of 35 and 55 degrees.
[37] Figure 4 is a graph of the frequency response of the synthesized right ear HRTF ((HRTFR (35.0) + HRTFR (55.0))/2 of Figure 3, and the frequency response of the right ear HRTF true for Azimuth 45 degrees (HRTFR (45.0)) of Figure 3.
[38] Figure 5(a) is a plot and graph of the frequency responses (magnitude versus frequency) of the right ear HRTFsRs at 35, 45, and 55 degrees not synthesized from Figure 3.
[39] Figure 5(b) is a plot of the phase responses (phase versus frequency) of the HRTFsRs at 35, 45, and 55 degrees not synthesized from Figure 3.
[40] Figure 6(a) is a graphical plot of the phase responses of right ear coupled HRTFs (generated in accordance with an embodiment of the invention) for azimuth angles of 35 and 55 degrees.
[41] Figure 6(b) is a graphical plot of the phase responses of right ear coupled HRTFs (generated in accordance with another embodiment of the invention) for azimuth angles of 35 and 55 degrees.
[42] Figure 7 is a plot of the frequency response (magnitude versus frequency) of a conventionally determined right ear HRTF for 45 degree Azimuth angle (labeled HRTFR (45.0) and a plot of the response frequency of a right ear HRTF (labeled (HRTFZR (35.0) + HRTFZR (55.0)/2) determined in accordance with an embodiment of the invention by linearly mixing coupled HRTFs (also determined in accordance with the invention) for angles of Azimuth of 35 and 55 degrees.
[43] Figure 8 is a graph (plot of magnitude versus frequency, with frequency expressed in FFT compartment index k units) of a weighting function, W(k), used in some embodiments of the invention to determine coupled HRTFs .
[44] Figure 9 is a block diagram of an embodiment of the system of the invention.
[45] Figure 10 is a block diagram of an embodiment of the system of the invention, which includes the HRTF mapper 20, and is configured to process a monophonic audio signal, for presentation over headphones, in order to provide a listener with an impression of a sound located at a specified Azimuth angle, Az.
[46] Figure 11 is a block diagram of another embodiment of the system of the invention that includes the mixer 30 and the HRTF mapper 40.
[47] Figure 12 is a block diagram of another embodiment of the system of the invention.
[48] Figure 13 is a block diagram of another embodiment of the system of the invention. DETAILED DESCRIPTION OF THE PREFERRED MODALITIES
[49] Many embodiments of the present invention are technologically possible. It will be apparent to those skilled in the art from the present disclosure how to implement the same. The embodiments of the inventive system, means and method will be described with reference to Figures 3 to 13.
[50] In this document, a “set” of HRTFs means a collection of HRTFs that correspond to multiple directions of arrival. A lookup table can store a set of HRTFs, and can output (in response to input indicative of an inbound direction) a pair of left-ear and right-ear HRTFs (included in the set) that correspond to the inbound direction. Typically, a left ear HRTF and a right ear HRTF (corresponding to each direction of arrival) are included in a set.
[51] Left ear and right ear HRTFs implemented as finite length impulse responses (which is the way they are most commonly implemented) will sometimes be referred to in this document as: HRTFL (x, y, z, n) and HRTFR (x, y, z, n), respectively, where (x, y, z) identifies the unit vector that defines the corresponding arrival direction (alternatively, HRTFs are defined with reference to Azimuth and de Elevation, Az and El instead of position coordinates x, y and z, in some embodiments of the invention) and where 0 < n < N, where N is the order of the FIR filters, and n is the impulse response sample number. Sometimes, for simplicity, applicants will refer to such filters without reference to the impulse response samples comprising them (eg the filters will be referred to as HRTFL (x, y, z) or HRTFL (Az, El) , when no confusion arises from the omission of reference to the impulse response sample number, n.
[52] In this document, the term “normal HRTF) means a filter response that closely resembles the Header-Related Transfer Function of a normal human individual. A normal HRTF can be created by any of a variety of methods well known in the art. One aspect of the present invention is a new type of HRTF (referred to herein as a coupled HRTF) that differs from normal HRTFs in the specific ways to be described.
[53] In this document, the expression “base set of HRTFs” means a collection of filter responses (usually FIR filter coefficients) that can be linearly combined together to generate HRTFs (HRTF coefficients) for various directions of arrival. Many methods are known in the art to produce small-sized sets of filter coefficients, including the method that is commonly referred to as principal component analysis.
[54] In this document, the term “HRTF mapper” means a method or system that determines a pair of HRTF impulse responses (a left ear response and a right ear response) in response to a specified arrival direction (for example, a direction specified as an angle or as a unit vector). An HRTF mapper can operate using a set of HRTFs and can determine the pair of HRTFs for the specified direction by choosing the HRTF from the set whose corresponding arrival direction is closest to the specified arrival direction. Alternatively, an HRTF mapper can determine each HRTF for the requested direction by interpolating between HRTFs in the set, where the interpolation is between HRTFs in the set having corresponding arrival directions close to the requested direction. Both of these techniques (closest match, and interpolation) are well known in the art.
[55] For example, a set of HRTFs may contain a collection of impulse response coefficients that represent HRTFs for multiple directions of arrival, including a number of directions in the horizontal plane (El=0). If the set includes entries for (Az=35o, El=0o) and (Az=55o, El=0o), then the HRTF mapper can produce an HRTF response estimated for (Az=45o, El=0o) by some way of mixing:
[56] HRTFL (45.0) = mixture (HRTFL (35.0), HRTFL (55.0))
[57] HRTFR (45.0) = mixture (HRTFR (35.0), HRTFR (55.0)) (1.1)
[58] Alternatively, an HRTF mapper can produce the HRTF filters for a particular arrival angle by linearly mixing together the filter coefficients from a base set of HRTFs. A more detailed exposition of this example is given in the description below with respect to B-coupled HRTFs.
[59] It is being attempted to perform each equation mixing operation (1.1) by calculating the simple average of the impulse responses, for example, as follows:

[60] However, the simple linear interpolation approach to mixing (eg, as in equations (1.2)) of conventionally generated HRTFs leads to problems due to the existence of significant group lag differences between the responses that are mixed (eg, conventionally determined responses HRTFR (35.0) and HRTFR (55.0) in equations 1.2)).
[61] Figure 3 shows typical normal HRTF impulse responses for azimuth angles of 35 and 55 degrees (responses labeled HRTFL (35.0) and HRTFR (35.0), and responses labeled HRTFL (55.0) and HRTFR (55.0) in Figure 3), along with a pair of true 45-degree Azimuth Azimuth HRTFs (labeled HRTFL (45.0) and HRTFR (45.0) in Figure 3). Figure 3 also shows a pair of synthesized 45-degree HRTFs (labeled (HRTFL (35.0) + HRTFL (55.0))/2 and (HRTFR (35.0) + HRTFR (55.0))/2 in figure 3). Generated by averaging the responses of 35 and 55 degrees in the form shown in equations (1.2). Figure 4 shows the frequency response of (“(HRTFR (35.0) + HRTFR (55.0))/2”) averaged versus the right ear HRTF (HRTFR (45.0)”) for the true 45 degree azimuth angle.
[62] In Figure 5(a), the frequency responses (magnitude versus frequency) of the 35-, 45-, and 55-degree HRTF filters (from Figure 3) are plotted. In Figure 5(b), the phase responses (phase versus frequency) of the 35, 45, and 55 degree true HRTF filters (from Figure 3) are plotted.
[63] As is evident from Figure 3, the impulse responses of HRTFR (35.0) and HRTFR (55.0) show significantly different delays (as indicated by the sequence of near-zero coefficients at the beginning of each of these impulse responses) . These onset delays are caused by the time taken for the sound to propagate to the farthest ear (since the 35, 45, and 55 degree azimuth angles suggest that the sound reaches the first left ear, and therefore there will be a delay for the right ear, and this delay will increase as Azimuth increases from 35 to 55 degrees). It is also evident from Figure 3 that the HRTFR response (45.0) has an onset delay that is somewhere between the delays of the 35 and 55 degree responses (as might be expected). However, the response created by averaging the 35 and 55 degree impulse responses appears to be very different from the true 45 degree impulse response (HRTFR (45.0)). This difference, which is quite visible in the impulse response plots of Figure 3, is even more evident in the frequency response plots of Figure 4.
[64] For example, there is a deep notch apparent in figure 4 at about 3.5 kHz in the filter response that was created by averaging 35 and 55 degree HRTFs. The “corrected” 45-degree HRTF (labeled “HRTFR (45.0)” in Figure 4) does not have a notch at about 3.5 kHz. Thus, it is evident that the blending operation performed to generate the average response “(HRTFR (35.0) + HRTFR (55.0))/2” undesirably introduced the notch, which is an example of commonly artifact introduction referred to as “comb filtration”. Note that notches (comb filtration artifacts) also appear in Figure 4 in the synthesized filter response (created by averaging 35 and 55 degree HRTFs) at 10 kHz and 17 kHz.
[65] The cause of this comb filtration (combing) can be seen by examining the phase response of the HRTFR filters, as shown in Figure 5(b). It is evident from Figure 5(b) that at 3.5 kHz, the 35-degree HRTF for the right ear has a phase shift of -600 degrees, while the 55-degree HRTF for the right ear has a phase shift of -600 degrees. -780 degree phase. The 180 degree phase difference between the 35 and 55 degree filters means that any sum of these filters (as can happen when they are averaged) will result in partial cancellation of the response at 35 kHz (and therefore deep notch shown in figure 4).
[66] While it may be desirable to use linear interpolation techniques (such as the averaging method described above) to implement an HRTF mapper, comb filtration (notch formation) problems of the type described present a significant difficulty because the resulting notches will result in audible artifacts in the HRTFs produced such as an HRTF mapper. If the spatial resolution of the set of HRTFs is increased (eg using a larger set, with measurements made on a finer scale grid), notch formation problems will typically still be present (but notches in the interpolated response can appear at higher frequencies).
[67] In a modality class, the present invention is an HRTF mapper that can determine a pair of HRTFs (HRTFL and HRTFR) to an arbitrary arrival direction, forming a weighted sum of HRTFs from a small library (set) of HRTFs specially generated (for example, a set of less than 50 HRTFs). If the set contains L entries (d=l, ..., L), the mapper can compute:

[68] where the WL and WR values are sets of weighting coefficients (each for a specific arrival direction, determined by x, y, ez, and set index, d) and the IRd(n) coefficients are the responses of thrust as a whole.
[69] Specially generated HRTFs (referred to herein as "coupled HRTFs" or "coupled HRTF filters") in the inventive set of HRTFs (referred to herein as a "coupled HRTF set") are created artificially (for example , modifying “normal” HRTFs) so that the response in the set can be linearly mixed as per equation (1.3) to produce HRTFs for arbitrary arrival directions. The set of coupled HRTFs typically includes a pair of coupled HRTFs (a left ear HRTF and a right ear HRTF) for each of a number of arrival angles that span a given space (e.g., a horizontal plane) and are quantized to a particular angular resolution (for example, a set of coupled HRTFs represents arrival angles with an angular resolution of 30 degrees around a 360 degree circle: 0, 30, 60, ..., 300, and 330 degrees ). The HRTFs coupled in the set are determined so that they differ from “normal” HRTFs (true, for example, measured) for the arrival angles of the set. Specifically, they differ in that the phase response of each normal HRTF is intentionally altered above a specific coupling frequency (to produce a coupled HRTF). More specifically, the phase response of each normal HRTF is intentionally altered so that the phase responses of all HRTF filters coupled in the set are coupled above the coupling frequency (i.e., so that the inter-phase difference between the phase of each left ear coupled HRTF and each right ear coupled HRTF is at least substantially constant as a frequency function for all frequencies substantially above the coupling frequency, and preferably so that the phase response of each HRTF coupled in the array is at least substantially constant as a function of frequency for all frequencies above the coupling frequency).
[70] The creation of coupled sets of HRTFs makes use of the Duplex Theory of Sound Localization, proposed by Lord Rayleigh. Duplex Theory asserts that time delay differences in HRTFs provide important suggestions to human listeners at lower frequencies (up to a frequency in the range of about 1000 Hz to about 1500 Hz), and these amplitude differences provide important suggestions for listeners humans at higher frequencies. Duplex theory does not imply that the phase or delay properties of HRTFs at higher frequencies are totally insignificant, but simply says that they are of relatively lower importance, with amplitude differences being more important at higher frequencies.
[71] To determine a set of coupled HRTFs, one begins by selecting a "coupling frequency" (Fc), which is the frequency below which each pair of HRTFs coupled for an incoming direction (ie, ear-coupled HRTFs left and right for the inbound direction) have an interauditory phase response (the relative phase between the left and right ear filters, as a function of frequency) that roughly equals the interauditory phase response of left “normal” HRTFs and right corresponding to the same direction of arrival. In the preferred embodiments, the interauditory phase responses roughly equalize in the sense that the phase of each coupled HRTF is within 20% (or more preferably, within 5%) of the phase of the corresponding "normal" HRTF, for frequencies below of the coupling frequency.
[72] To appreciate the concept of “close matching” noted among interauditory phase responses, consider the phase responses of 35- and 55-degree coupled HRTFRs (HRTFZR(35, 0), HRTFZR (55.0), HRTFCR (55 ,0)), as shown in figures 6(a) and 6(b). The magnitude responses of these coupled HRTFs (not plotted in Figures 6(a) and 6(b) are equal to those of corresponding “normal” HRTFs (ie, HRTFR (35.0) and HRTFR (55.0 ) of Figures 5(a) and 5(b) from which they were determined (so that the magnitude responses are the same as those plotted in Figure 5(a)). Corresponding normal HRTF, only the phase response is changed (with respect to the corresponding normal HRTF), and only above the coupling frequency (which is Fc = 1000 Hz in the example). The result of this phase response modification is to allow that the coupled HRTFs be linearly mixed together without causing unwanted comb filter artifacts (in the sense that each interpolated HRTF determined by such linear mixing has a magnitude response that does not demonstrate significant comb filter distortion).
[73] Thus, the phase response of HRTFZR (35.0) of figure 6(a) closely equals that of normal HRTFR (35.0) of figure 5(b) below the coupling frequency (Fc=1,000 Hz) that of HRTFZR (55.0) of figure 5(b) below the coupling frequency (Fc = 1000 Hz), that of HRTFZ R (55.0) of figure 6(a) closely equals that of normal HRTFR (55, 0) of figure 5(b) below the coupling frequency (Fc = 1000 Hz), that of HRTFCR (35.0) of figure 6(b) closely equals that of normal HRTFR (35.0) of figure 5(b ) below the coupling frequency (Fc = 1000 Hz), and that of HRTFCR (55.0) of figure 6(b) closely equals that of normal HRTFR (35.0) of figure 5(b) below the coupling frequency (Fc = 1000 Hz). The phase responses of HRTFZR (35.0) and HRTFZR (55.0) of Fig. 6(a) differ substantially from those of normal HRTFR (35.0) and HRTFR (55.0) of Fig. 5(b) above. coupling frequency, and the phase responses of HRTFCR (55.0) of Figure 6(b) differ substantially from those of HRTFR (35.0) and normal HRTFR (55.0) of Figure 5(b) above the frequency of coupling.
[74] The phase responses of HRTFZR (35.0) and HRTFZR (55.0) of figure 6(a) are coupled to frequencies above the coupling frequency (so that the interauditory phase responses determined from the the same and the HRTFZL (35.0) and HRTFZL (55.0), may equal or approximately equal to frequencies substantially above the coupling frequency). Similarly, the HRTFCR (35.0) and HRTFCR (55.0) phase responses of Fig. 6(b) are coupled to frequencies above the coupling frequency (so that the interauditory phase responses determined therefrom and of the corresponding left ear HRTFCL (35.0) and HRTFCL (55.0) may equal or approximately equal to frequencies substantially above the coupling frequency). As shown in Figure 6(b), the plotted phase responses for HRTFCR (35.0) and HRTFCR (55.0) do not deviate from each other by more than about 90 degrees, and applicants consider this to be “equalizing” close to the phase responses, as this equality ensures that the coupled filters can be linearly mixed together without causing significant combing.
[75] Figure 7 is a conventionally determined (normal) right ear (normal) right ear (normal) HRTFR (45.0) frequency response (magnitude versus frequency) plot plot, and a conventionally determined HRTFR frequency response (magnitude versus frequency) plot. frequency of a right ear HRTF (labeled (HRTFZR (35.0) + HRTFZR (55.0)/2) determined according to an embodiment of the invention by linearly mixing HRTFZR (35.0) and HRTFZR (55.0) of the Figure 6(a) Linear mixing is performed by adding HRTFZR (35.0) and HRTFZR (55.0), and dividing the sum by 2. As is evident from Figure 7, the right ear HRTF of the invention (HRTFZR) is lacking (35.0) and HRTFZR (55.0)/2) comb filter artifacts.
[76] In Figure 6(a), the plots of the HRTFZR (35.0) and HRTFZR (55.0) show the “zero extended” phase response of these coupled HRTFs. Similarly, Figure 6(b) shows the phase of the HRTFCR (35.0) and HRTFCR (55.0) filters, with the phase (above the 1 kHz coupling frequency) being modified to smoothly cross attenuate to one phase. constant (at frequencies substantially above the coupling frequency).
[77] Coupled HRTFs can be created according to the invention by a variety of methods. A preferred method works by taking a pair of normal HRTFs, ie, left/right ear HRTFs measured from a fake header or a real object, or created from any conventional method to generate appropriate HRTFs), and modifying the response phase shift of normal HRTFs at high frequencies (above the coupling frequency).
[78] Applicants below describe exemplary methods for determining a pair of left ear and right ear mated HRTFs from a pair of normal left ear and right ear HRTFs in accordance with the invention.
[79] By implementing these exemplary methods, modification of the phase response of normal HRTFs can be accomplished using a frequency domain weighting function (sometimes referred to as a weight vector), W(k) where k is an index indicating frequency (for example, an FFT bin index), which operates on the phase response of each normal HRTF) original. The weighting function W(k) should be a smooth curve, for example, of the type shown in figure 8. In the typical case where normal HRTFs are operated using a Fast Fourier Transform (FFT) of length K, the index k of FFT slot corresponds to the frequency: f=kx FS/K, where FS is the sampling frequency of the digital signal. In the example in figure 8 of the weighting function, if the frequency compartment indices k1 and k2 correspond to the frequencies of 1 kHz and 2 kHz, the coupling frequency, Fc, is Fc = 1 kHz, and k1 = 1000xK/FS , and k2 = 2,000xK/FS.
[80] In a class of embodiments of the method of the invention to determine the coupled HRTFs (i.e., a pair of left and right ear coupled HRTFs for each arrival direction in a set of arrival directions) from a set of coupled HRTFs in response to normal HRTFs (that is, a pair of left ear and right ear normal HRTFs for each of the arrival directions in the set), the method includes the following steps:
[81] 1. Using a Fast Fourier Transform of length K, convert each pair of normal HRTFs, HRTFL (x, y, z, n) and HRTFS (x, y, z, n), into a pair of frequency responses , FRL (k) and FRS (k), where k is the integer number of frequency slots, centered on frequency
(where -N/2 < k < N/2, and where FS is the sampling rate);
[82] 2. Then determine the magnitude and phase components (M1, MR, PL, PR), so that FRL(k) = ML(k)ejPz(k) and FRR(k) = MR(k) ejPz(k), and where the phase components (PL, PR) do not unwind (so that any discontinuities of more than π are removed by adding integer multiples of 2π to the vector samples, for example, using the function “ do not curl” by Matlab.
[83] 3. If the pair of normal HRTFs corresponds to an incoming direction that is in the left hemisphere (such that y>0), then perform the following steps to compute FR’L and FR’S:
[84] (a) compute the modified phase vector: P’(k) = (PR(k) -PL(k)) x W(k), where W(k) is the weighting function defined above; and
[85] (b) then compute FR'L and FR'S as follows:

[86] 4. If the pair of normal HRTFs corresponds to an incoming direction that is in the right hemisphere (such that y>0), then perform the steps of:
[87] (a) compute the modified phase vector: P’(k) = (PL(k)-PS(k)x W(k); and
[88] (b) then compute FR'L and FR'S as follows:

[89] 5. If the pair of normal HRTFs corresponds to a direction of arrival that is in the midplane (such that y=0), then there is no need to change the phase of the remote ear response, so applicants simply compute:

[90] 6. Finally, use the inverse Fourier transform to compute the coupled HRTFs (and add an extra volume delay of g samples for both coupled HRTFs as follows:

[91] The modification that is made to the phase response in step 3 (or step 4) will often result in some time averaging of the final impulse responses, so an HRTF FIR filter that was originally causal can be turned into a causal FIR filter a. To protect against this time averaging, an added volume delay may be needed in both left and right ear coupled HRTF filters, as implemented in step 6. A typical value of g might be g=48.
[92] The process described above with reference to steps 1-6 must be repeated for each pair of normal HRTFL and HRTFR filters to produce each coupled HRTFZL filter and each coupled HRTFZR filter in the set of coupled HRTFs. Variations can be made to the described process.
[93] For example, step 3(b) above shows the original Left channel phase response that is preserved, while the Right channel response is generated using the Left phase plus the modified Right-Left phase difference. As an alternative, the equations in step 3(b) can be modified to read:

[94] In this case, the phase response of the original left ear HRTF is completely disregarded, and a new right ear HRTF is checked with the modified Right-Left phase difference.
[95] Yet another variation on the described method involves the phase shift of both the left and right ear HRTFs (with opposite phase shifts):

[96] Of course, if alternative equations (1.4 or 1.5) are substituted in step 3(b) above, then corresponding complementary equations must be applied in step 4(b) (to allow for the case where the direction of arrival of HRTF is in the right hemisphere ).
[97] The symmetry implied by equations (1.5) is employed in another class of embodiments of the inventive method to determine the coupled HRTFs (ie, a pair of coupled left ear and right ear HRTFs for each direction of arrival in a set of directions of a set of coupled HRTFs in response to normal HRTFs (that is, a pair of left-ear and right-ear HRTFs for each of the inward directions in the set). In these modalities, the method includes the following steps:
[98] 1. Using a K-length Fast Fourier Transform, convert each pair of normal HRTFs, HRTFL (x, y, z, n) and HRTFR (x, y, z, n), into a pair of responses of frequency, FRL(k) and FRR(k), where k is an integer index of the frequency bins, centered on the frequency
(where -N/2 <k<N/2, and where FS is the sampling rate);
[99] 2. Then determine the magnitude and phase components (ML. MR, PL, PR), so that FRL(k)=ML(k)ejPL(k) and FRR(k)=MR(k) ejPL(k), and where the phase components (PL, PR) are “unrolled” (so that any discontinuities of more than π are removed by adding integer multiples of 2π to the vector samples, for example, using a conventional Matlab “unwind” function);
[100] 3. Compute the modified phase vector: P’(k) = (PR(k)-PL(k))xW(k);
[101] 4. Then compute FR'L and FR'R as follows:

[102] 5. Finally, use the inverse Fourier transform to compute the coupled HRTFs (and add an extra volume delay of g samples for both coupled HRTFs);

[103] An alternative method (sometimes referred to in this document as a “constant phase extension method”) can be implemented with the following step (step 3a) performed instead of step 3 above;
[104] 3rd. compute the modified phase vector:

[105] The modified equation, described in surrogate step 3a, has the effect of forcing the phase (P’(k) at high frequencies to equal the phase coupling frequency, as shown in the example in Figure 6(b).
[106] Applicants below describe another class of embodiments of the invention in which a set of coupled HRTFs is determined by a base set of HRTFs,
[107] A typical HRTF set (feet a set of coupled HRTFs) consists of a collection of impulse response pairs (left and right ear HRTF), where each pair corresponds to a particular direction of arrival. In this case, the task of an HRTF mapper is to take a specified arrival direction (eg, determined by the arrival direction vector, (x, y, z)) and determine a matching pair of HRTFL and HRTFR filters to the specified arrival direction, finding HRTFs in a set of HRTFs (for example, a set of coupled HRTFs) that are close to the specified arrival direction, and performing some interpolation on HRTFs in the set.
[108] If the set of HRTFs was generated according to the invention to comprise coupled HRTFs (such coupled HRTFs are "coupled" at high frequencies as described above), then the interpolation may be linear interpolation. Since linear interpolation (linear mixing) is used, this implies that the set of coupled HRTFs can be determined by a base set of HRTFs. A preferred base set of HRTFs of interest is the spherical harmonic base (sometimes referred to as shape B).
[109] The well-known method of a least squares mean fit (or other fitting process) can be used to represent a set of coupled HRTFs in terms of a base set of HRTFs, based on spherical harmonics. By way of example, a first-degree spherical harmonic base set (Hw, Hx, Hy, and Hz) can be determined so that any left ear (or right ear) HRTF (for any specific arrival direction, x, y,z, or any specific arrival direction x,y,z, in a range spanning at least 60 degrees) can be generated as:
where the four sets of FIR filter coefficients (Hw, Hx, Hy, and Hz) from the base set of HRTFs are determined to provide a best least squares mean fit for a set of coupled HRTFs. From the complementation equations (1.6) the table of coefficients of four FIR filters (Hw, Hx, Hy, and Hz) is sufficient to determine a left ear (and right ear) HRTF for any specified arrival direction, and so the four FIR filters (Hw, Hx, Hy, and Hz) determine a set of coupled HRTFs.
[110] A higher degree spherical harmonic representation will provide added accuracy. For example, a second degree representation of an HRTF base (Hw, Hx, Hy, Hz, Hv2, Hy2, Hz2, Hxy, Hyz) can be set such that any left ear (or right ear) HRTF (for a specific arrival direction x, y, z, or any specific arrival direction x, y, z, in a range spanning at least 60 degrees) can be generated as:
where the nine sets of FIR filter coefficients (Hw, Hx, Hy, Hz, Hx2, Hy2, Hxz, Hyz, Hz2) from the base set of HRTFs are determined to provide a best least squares mean fit to a set of Coupled HRTFs. Implementing equations (1.7), a coefficient table of the nine FIR filters is sufficient to determine a left ear (and right ear) HRTF for any specified arrival direction, and thus the nine FIR filters determine a set of coupled HRTFs.
[111] Simplified equations will result if arrival angles are limited to the horizontal plane (as may commonly be desired). In this case, all z components of the spherical harmonic set can be discarded, so the second degree equations (equations 1.7) are simplified to be:

[112] Equations 1.8 can alternatively be written in terms of the Azimuth angle, Az, as follows:

[113] In a preferred embodiment, a third-order horizontal HRTF mapper operates using a third-degree representation of a defined base set such that any left ear (or right ear) HRTF for any specific arrival direction is generated like:
where the seven sets of FIR filter coefficients (Hw, Hx, Hy, Hx2, Hy2, Hx3 and Hy3) from the base set of HRTFs are determined to provide a best least squares mean fit to a set of coupled HRTFs. Thus, the seven FIR filters determine a set of coupled HRTFs. An HRTF mapper that employs a base set of HRTFs defined in this way is a preferred embodiment of the present invention, because it allows a base set of HRTFs consisting of only 7 filters (Hw(n), Hx(n), Hy (n), Hx2(n), Hy2(n), Hx3(n), and Hy3(n) is used to generate a left ear (and right ear) HRTF filter for any incoming direction in the horizontal plane, with a high degree of phase accuracy for frequencies up to the coupling frequency (eg up to 1000 Hz or more).
[114] Applicants describe the use of base sets of small HRTFs (each of which determines a set of coupled HRTFs) for signal mixing in accordance with embodiments of the present invention.
[115] It is possible to implement an HRTF mapper as a device that employs a small base set of HRTFs (eg, of the type defined with reference to equations 1.10) to determine a set of coupled HRTFs, and to perform signal mixing using a apparatus in accordance with embodiments of the present invention.
[116] The HRTF mapper 10 of Figure 10 is an example of such an HRTF mapper that employs the small base set of HRTFs defined with reference to equations 1.10 to determine a set of coupled HRTFs. The apparatus of Figure 10 also includes audio processor 20 (which is a virtualizer) configured to process a monophonic audio signal ("Sig"), to generate left and right audio output channels (Out L and Out R) for presentation over headphones by ear, in order to provide a listener with an impression of a sound located at a specified Azimuth angle, Az.
[117] In the system of Figure 10, a single audio input channel (Sig) is processed by two FIR filters 21 and 22 (each labeled with the convolution operator, ®), implemented by processor 20, to produce PS signals left and right earphones, OutL and OutR respectively (for presentation on headphones). The filter coefficients for the left ear FIR 21 filter are determined in mapper 10 from the base set of HRTFs (Hw, Hx, Hy, Hx2, Hy2, Hx3, Hy3 from equations 1.10) by weighting each of the coefficients in the set of base of HRTFs with a corresponding of the sine and cosine functions (shown in equations 1.10) of the Azimuth angle, Az (ie, Hw(n) is not weighted), Hx(n) is multiplied by cos(Az), Hy(n) is multiplied by sine (Az), and so on), and adding the seven weighted coefficients (including Hw(n), for each value of n, in the summation stage 13. Filter coefficients for FIR filter Right ear 22 are determined on the mapper 10 from the base set of HRTFs (Hw, Hx, Hy, Hx2, Hy2, Hx3, Hy 3 of equations 1.10) by weighting each of the base set coefficients of HRTFs with a corresponding of the sine and cosine functions (shown in equations 1.10) of the Azimuth angle, Az (that is, Hw(n) is not weighted, H2(n) is multiplic is multiplied by cos(Az), Hy(n) is multiplied by sine (Az), and so on, by multiplying each of the weighted versions of the coefficients Hy(n), Hy2(n), and Hy3(n) by a negative one. (in multiplication elements 11) and by adding the seven weighted coefficients resulting in summation stage 12.
[118] Thus, the system in Figure 10 breaks processing into two main components. First, the HRTF 10 mapper is used to compute the FIR, HRTFL (Az, n) and HRTFR (Az, n) filter coefficients, which are applied by filters 21 and 22. Second, FIR filters 21 and 22 ( of the processor 20) are configured with the FIR filter coefficients that were computed by the HRTF mapper, and the configured filters 21 and 22 then process the audio input to produce the headphone output signals.
[119] A mixing system can be configured in a very different mode (as shown in figure 11) to produce the same result (produced by the system in figure 10) in response to the same input audio signal and specified arrival direction (angle of Azimuth). The device in figure 11 (which implements a virtualizer) is configured to process a monophonic audio signal (“InSig”), to generate left and right (binaural) audio output channels (OutputL and OutputR) that can be presented over headphones in order to provide a listener with an impression of a sound located in a specified arrival direction (Azimuth angle, Az).
[120] In Figure 11, the panning stage (scanner) 30 generates a set of seven intermediate signals in response to the input signal (“InSig”), as per the following equations: W = InSigX = InSig x cos ( Az)Y = InSig x sine (Az)X2 = InSig x cos (2Az) (1.11) Y2 = InSig x sine (2Az)X3 = InSig x cos (3Az)Y3 = InSig x sine (3Az) where Az is the angle of specified azimuth.
[121] Each of the seven intermediate signals is then filtered at the HRTF filter stage 40, convoluting it (at stage 44) with the FIR filter coefficients of a corresponding FIR filter from a base set of HRTFs (ie, InSig is convoluted with coefficients Hw, InSig» cos (Az) is convoluted with coefficients Hx of equations 1.10, InSig» sine (Az) is convoluted with coefficients Hy of equations 1.10, InSig» cos (2Az) is convoluted with coefficients Hx2 of equations 1.10, InSig» sine (2Az) is convoluted with the Hy2 coefficients of equations 1.10, InSig» cos (3Az) is convoluted with the Hx3 coefficients of equations 1.10, and InSig»sine (3Az) is convoluted with the Hy3 coefficients of the equations 1.10). The outputs of convolution stage 44 are then added (in summation stage 41) to generate the left channel output signal, OutputL. Some of the outputs of convolution stage 44 are multiplied by a negative in the multiplication elements 42 (that is, each of sine (Az) convoluted with the coefficients HY, InSig»sine (2Az) convoluted with the coefficients Hy2, and InSig»sine (3Az) convoluted with the HY3 coefficients is multiplied by a negative in elements 42), and the outputs of multiplication elements 42 are added to the other outputs of the convolution stage (in summation stage 43) to generate the signal of right channel output,Rout. The filter coefficients applied in convolution stage 44 are those of the base set of HRTFs Hw, Hx, Hy, Hx2, Hy2, Hx3, Hy3 of equations 1.10.
[122] If a set of M input signals, InSigm, is to be processed for binaural reproduction, a single set of intermediate signals can be produced in finder 30, with all M input signals present:

[123] Once these intermediate signals have been generated, they are filtered at convolution stage 44 as follows:
and the left and right ear output signals are derived as follows:OutputL = Wfiltered+Xfiltered+Yfiltered+X2filtered+Y2filtered+X3filtered+Y3filteredOutputR = Wfiltered+Xfiltered+Yfiltered+X2filtered+Y2filtered+X3filtered+Y3filtered(1.14)
[124] Therefore, the combined operations shown in equations (1.12), (1.13) and (1.14) enable a set of output signals M, {InSigm: 1<m<M} (each with an Azimuth angle corresponding, Azm) to be rendered binaurally, using only 7 FIR filters. There may be a different Azimuth angle, Azm for each of the input signals. This means that the small number of FIR filter sets in the base set of HRTFs provides an effective method for binaurally rendering large numbers of input signals by applying the process implemented by the system of figure 11 for multiplying the input signals as shown in figure 12.
[125] In figure 12, each of the blocks 30 represents the finder30 of figure 11 during the processing of the i input signal (where the index i is in the range from 1 to M) and the summation stage 31 is coupled and set to add the outputs generated in blocks 30i-30M to generate the seven sets of intermediate signals described in equations 1.12.
[126] Another embodiment of the system and method of the invention for processing a set of M input signals, InSigm, will be described with reference to Figure 13. In this embodiment, the M input signals are processed for binaural reproduction, using the fact that the Intermediate signal formats can also be modified by mixing. In this context, "mixing" refers to a process by which a lower resolution intermediate signal (composed of a smaller number of channels) is processed to create a higher resolution intermediate signal (composed of a larger number of signals intermediaries). Many methods are known in the art for mixing such intermediate signals, for example, including those described in US Patent 8,103,006, to the present inventor (and assigned to the assignee of the present invention). The blending process allows a lower resolution intermediate signal to be used, with blending performed prior to HRTF filtration, as shown in figure 13.
[127] In Fig. 13, each of the blocks 130i represents the same searcher (to be referred to as the searcher of Fig. 13) during the processing of the “io” input signal. InSig (where index i is in the range of 1 to M), and the summing stage 131 is coupled and configured to sum the outputs generated in blocks 130i-130M to generate intermediate signals that are mixed in the mixing stage 132. The stage 40 (which is identical to stage 40 in figure 11) filters the output of stage 132.
[128] The finder of figure 13 passes through the current input signal (“InSig”) to stage 131. The finder of figure 13 includes stages 34 and 35 that generate the values cos(Azi) and sine (Azi), respectively, in response to the current Azi Azimuth angle. The finder in Figure 13 also includes multiplication stages 36 and 37, which generate InSigi»cos(Azi) and InSig»sine(Azi) values, respectively, in response to the actual input signal Insig and the outputs of stages 34and 35 .
[129] The summation stage 131 is coupled and configured to sum the outputs generated in blocks 130i-130M to generate three intermediate signals as follows: stage 131 sums the “InSig” of M outputs to generate an intermediate signal; stage 131 sums InSigi»cos (Azi) of M values to generate a second intermediate signal, and stage 131 sums InSigi*sine (Azi) to generate a third intermediate signal. Each of the three intermediate signals corresponds to a different channel. The mixing stage 132 mixes the three intermediate signals from stage 131 (eg in a conventional way) to generate seven intermediate mixed signals, each of which corresponds to a different one of the seven channels. Stage 40 filters these seven mixed signals in the same way as stage 40 of figure 11 filters the seven signals secured from it by stage 30 of figure 11.
[130] The particular shape of the intermediate signals described above (with reference to figures 11, 12 and 13) can be modified to form alternative base sets for base set decomposition of HRTFs, as will be appreciated by one of ordinary skill in the art In all these embodiments of the invention, the use of a base set of HRTFs to simplify audio processing (for example, as in the system of figure 12 or figure 13) is only possible if the base set of HRTFs has been built to allow HRTF filters to be created by linear mixing (for example, by elements 34, 35, 36, 37, 131 and 132 of figure 13 or by elements of stage 10 shown in figure 10). If the base set determines a set of the coupled HRTF filters of the invention, it will allow HRTF filters to be created by those that have been modified to be "coupled" to be more receptive to linear mixing.
[131] Typical embodiments of the present invention generate (or determine and use) a set of coupled HRTFs that meet the following three criteria (sometimes referred to herein for convenience as the "Golden Rule"):
[132] 1. The interauditory phase response of each pair of HRTF filters (that is, each left ear HRTF and right ear HRTF created for a specified arrival direction) that are created from the set of coupled HRTFs (by a linear mixing process) equate the interauditory phase response of a corresponding pair of normal left ear and right ear HRTFs with less than 20% phase error (or, more preferably, with less than 5% error phase) for all frequencies below the coupling frequency. In other words, the absolute value of the difference between the phase of the left ear HRTF created from the set and the phase of the corresponding right ear HRTF created from the set differs by less than 20% (or, more preferably, less than 5%) from the absolute value of the difference between the phase of the corresponding right ear normal HRTF, at each frequency below the coupling frequency. The coupling frequency is greater than 700 Hz and is typically less than 4 kHz. At frequencies above the coupling frequency, the phase response of the HRTF filters that are created from the set (by a linear mixing process) deviates from the behavior of normal HRTFs, so the interauditory group delay (at such high frequencies) is significantly reduced compared to normal HRTFs;
[133] 2. The magnitude response of each HRTF filter created from the set (by a linear mixing process) for an incoming direction is in the expected range for normal HRTFs for the incoming direction (eg in the direction in that does not demonstrate significant comb filter distortion relative to the magnitude response of a typical normal HRTF filter for the incoming direction; and
[134] 3. The range of arrival angles that can be transposed by the blending process (to generate a pair of HRTFs for each arrival angle in the range by a process of linear blending coupled HRTFs in the set) is at least 60 degrees ( and preferably it is 360 degrees).
[135] In embodiments where the method of the invention includes determining a base set of HRTFs which in turn determines a set of coupled HRTFs (for example, performing a least squares mean fit or other fitting process to determine the coefficients from the base set of HRTFs such that the base set of HRTFs determines the set of coupled HRTFs to within the proper precision), or uses such a base set of HRTFs to determine a pair of HRTFs in response to a direction of arrival, the set of coupled HRTFs preferably satisfies the Golden Rule.
[136] Typically, a set of coupled HRTFs that satisfies the Golden Rule comprises data values that determine a set of left ear coupled HRTFs and a set of right ear coupled HRTFs for arrival angles that span a range of angles from arrival, a determined left ear HRTF (by linear mixing in accordance with an embodiment of the invention) for any arrival angle in the range and a determined right ear HRTF (by linear mixing in accordance with an embodiment of the invention) for said angle of arrivals have an interauditory phase response that equals the interauditory phase response of a typical left ear normal HRTF for said arrival angle relative to a typical right ear normal HRTF for such arrival angle with less than 20% ( and preferably less than 5%) phase error for all frequencies below the coupling frequency (where the coupling frequency is more than 700 Hz and typically and less than 4 kHz), and
[137] the left ear HRTF (by linear mixing in accordance with the modality of the invention) for any angle of arrival in the range has a magnitude response that does not demonstrate significant comb filtration distortion relative to the magnitude response of the normal ear HRTF left for said arrival angle, and the right ear HRTF determined (by linear mixing in accordance with the embodiment of the invention) for any arrival angle in the range has a magnitude response that does not demonstrate significant comb filtration distortion relative to the response of magnitude of the typical left ear normal HRTF for said arrival angle,
[138] wherein said arrival angle range is at least 60 degrees (preferably, said arrival angle range is 360 degrees).
[139] It was proposed to simplify HRTF libraries through spherical harmonic base sets (eg as described in US Patent 6,021,206 to the current inventor), but all these previous attempts to simplify HRTFs by the use of a harmonic base have experienced significant combing problems of the type described in this document. Therefore, conventionally determined spherical harmonic harmonic HRTF libraries do not satisfy the second criterion of the Golden Rule described above.
[140] Also, some previous attempts to create binaural filters with analog circuit elements result in HRTF filters that satisfy the second Golden Rule criterion as an accidental side effect of the limitations of analog circuit techniques. For example, such an HRTF filter is described in the paper by Bauer entitled “Stereophonic Headphones and Biauricular Speakers” in Journal of the Audio Engineering Society, April 1961, volume 9, no 2. However, such HRTFs do not meet the first criteria of the Golden Rule.
[141] Typical modalities of the invention are methods of generating a set of coupled HRTFs that represent arrival angles that span a given space (eg, horizontal plane) and are quantized to a particular angular resolution (eg, a set of coupled HRTFs representing arrival angles with an angular resolution of 30 degrees around a 360 degree circle - 0, 30, 60, ..., 300 and 360 degrees). The set-coupled HRTFs are constructed such that they differ from true (ie, measured) HRTFs to the arrival angles in the set (except for 0 and 180 degrees Azimuth, as these HRTF angles typically have zero phase inter-auditory, and therefore do not require any special processing to make them comply with the Golden Rule). Specifically, they differ in that the phase response of the HRTFs is intentionally altered above a specific coupling frequency. More specifically, the phases are altered such that the phase responses of the HRTFs in the set are coupled (ie, are the same or nearly the same) above the coupling frequency. Typically, the coupling frequency above which the phase responses are coupled is chosen depending on the angular resolution of the HRTFs included in the set. Preferably, the cut-off frequency is chosen so that as the angular resolution of the array increases (i.e., more coupled HRTFs are added to the array), the coupling frequency also increases.
[142] In alternative modalities, each applied HRTF (or each of a subset of the HRTFs applied according to the invention is defined and applied in the frequency domain (for example, each signal to be transformed according to such HRTF undergoes transformation from frequency domain to time domain, the HRTF is then applied to the resulting frequency components, and the transformed components then undergo a time domain to frequency domain transformation).
[143] In some embodiments, the system of the invention is or includes a general purpose processor coupled to receive or generate input data indicative of at least one audio input channel, and programmed with software (or firmware) and/or otherwise configured (eg, in response to control data) to perform any of a variety of operations on the input data, including an embodiment of the method of the invention. Such a general purpose processor can typically be coupled to an input device (eg, a mouse and/or keyboard), a memory, and a monitor device. For example, the system of Figure 9, 10, 11, 12 or 13 may be implemented as a general purpose processor programmed and/or otherwise configured to perform any of a variety of operations on input audio data, including an embodiment of the method of the invention for generating audio output data. A conventional analog to digital converter (DAC) can operate on audio output data to generate analog versions of output audio signals for playback through physical speakers.
[144] Figure 9 is a block diagram of a system (which can be implemented as a programmable audio DSP that has been configured to perform an embodiment of the method of the invention. The system includes stage 9 HRTF filter, coupled to receiving an input audio signal (for example, frequency domain audio data indicative of sound, or time domain audio data indicative of sound), and the HRTF mapper 7. The HRTF mapper 7 includes memory 8 which stores data that determines a set of coupled HRTFs (for example, data that determines a base set of HRTFs which in turn determines a set of coupled HRTFs), and is coupled to receive data ("direction of arrival") indicative of an arrival direction (eg, specified as an angle or as a unit vector) corresponding to a set of input audio data secured for stage 9. In typical completion, the mapper 7 implements a configurable lookup table. Added to memory 8 recall, in response to Arrival Direction data, enough data to perform linear mixing to determine a pair of HRTFs (one left ear HRTF and one right ear HRTF) for the arrival direction.
[145] The mapper 7 is optionally coupled to an external computer-readable medium 8a that stores data that determines the set of coupled HRTFs (and optionally also encodes the programming of the mapper 7 and/or stage 9 to perform a modality of the method of invention) and the mapper 7 is configured to access (from the middle 8a) data indicative of the set of coupled HRTFs (eg data indicative of selected coupled HRTFs from the set). Mapper 7 optionally does not include memory 8 when mapper 7 is thus configured to access external medium 8a. The data that determines the set of coupled HRTFs (stored in memory 8 or accessed by the mapper 7 from an external medium) can be coefficients from a base set of HRTFs that determines the set of coupled HRTFs.
[146] Mapper 7 is configured to determine a pair of HRTF impulse responses (a left ear response and a right ear response) in response to a specified arrival direction (eg, an arrival direction, specified as a angle or as a unit vector, corresponding to a set of input audio data). Mapper 7 is configured to determine each HRTF for the specified direction by performing linear interpolation on HRTFs coupled in the set (performing linear mixing on values that determine the coupled HRTFs. Typically, the interpolation is between HRTFs coupled in the set having corresponding arrival directions close to the set specified direction Alternatively, Mapper 7 is configured to access coefficients from a set of coupled HRTFs (which determines the set of coupled HRTFs) and to linearly blend the coefficients to determine each HRTF for the specified direction.
[147] Stage 9 (which is a virtualizer) is configured to process data indicative of monophonic input audio (“Input Audio”), including applying the pair of HRTFs (determined by the mapper 7) to them to generate signals. left and right channel output audio (Out L and Out R). For example, output audio signals may be suitable for rendering over headphones so as to provide a listener with an impression of sound emitted from a source in the specified arrival direction. If data indicative of a sequence of arrival directions (for an incoming audio dataset) is secured to the system of figure 9, stage 9 can perform HRTF filtering (using a sequence of HRTF pairs determined by the mapper 7 in response to the incoming direction data) to generate a sequence of left and right channel output audio signals that can be rendered to provide a listener with an impression of sound emitted from a panning source through the sequence of directions of arrival.
[148] In operation, an audio DSP that has been configured to perform surround sound virtualization in accordance with the invention (for example, the virtualizer system of Figure 9, or the system of any one of Figures 10, 11, 12 or 13 ) is coupled to receive at least one input audio signal, and the DSP typically performs a variety of operations on the input audio in addition to (as well as) filtering by an HRTF. In accordance with various embodiments of the invention, an audio DSP is operable to perform an embodiment of the method of the invention after being configured (e.g., programmed) to employ a set of coupled HRTFs (e.g., a base set of HRTFs that determine a set of coupled HRTFs) for generating at least one output audio signal in response to each input audio signal by performing the method on the input audio signal(s).
[149] Other aspects of the invention are a computer-readable medium (eg, a disk) that stores (in tangible form) code to program a processor or other system to carry out any modality of the method of the invention, and computer-readable medium ( for example, a disk) which stores (in tangible form) data that determines a set of coupled HRTFs, where the set of coupled HRTFs has been determined in accordance with an embodiment of the invention (for example, to satisfy the Golden Rule described herein document). An example of such a medium is the computer readable medium 8a of Figure 9.
[150] Although specific embodiments of the present invention and applications of the invention have been described herein, it will be apparent to those skilled in the art that many variations in the embodiments and applications described herein are possible without departing from the scope of the invention described and claimed herein. document. It is to be understood that while certain forms of the invention have been shown and described, the invention is not to be limited to the specific embodiments described and shown or to the specific methods described.

权利要求:
Claims (15)
[0001]
1. Method for determining a header-related transfer function (HRTF) characterized by the fact that it comprises the steps of: (a) in response to a signal indicative of an arrival direction, performing linear mixing using data from a set of HRTFs coupled to determine an HRTF for the direction of arrival, wherein the set of coupled HRTFs comprises data values that determine a set of coupled HRTFs, the set of coupled HRTFs comprising a set of coupled left ear HRTFs and a set of coupled HRTFs right ear to arrival directions, where the coupled HRTFs are determined from normal HRTFs for the same arrival directions by changing the phase response of each normal HRTF above a coupling frequency so that the difference between the a left ear mated HRTF and a right ear mated HRTF for the same direction of arrival is at least substantially constant as an f frequency coupling for all frequencies substantially above the coupling frequency. determined in step (a) for the direction of arrival.
[0002]
2. Method according to claim 1, characterized in that it further comprises the step of: (b) performing HRTF filtering on an audio input signal (e.g., frequency domain audio data indicative of a or more audio channels, or time domain audio data indicative of one or more audio channels), using the HRTF determined in step (a) for the direction of arrival.
[0003]
3. Method according to claim 1, characterized in that the set of coupled HRTFs is a base set of HRTFs comprising coefficients that determine the set of coupled HRTFs, and step (a) includes the step of performing mixing linear using HRTF base set coefficients to determine the HRTFs for the direction of arrival.
[0004]
4. Method according to claim 1, characterized in that step (a) includes the step of performing linear mixing on data indicative of coupled HRTFs determined by the set of coupled HRTFs, and data indicative of the direction of arrival, and where the HRTF determined for the direction of arrival is an interpolated version of the coupled HRTFs having a magnitude response that does not demonstrate significant comb filtration distortion.
[0005]
5. Method according to claim 1, characterized in that step (a) includes the step of linearly mixing data from the set of coupled HRTFs to determine a left ear HRTF for the direction of arrival and an HRTF from the right ear to the arrival direction, and preferably wherein the set of coupled HRTFs comprises data values that determine a set of coupled left ear HRTFs and a set of coupled right ear HRTFs for arrival angles that span a range of arrival angles, the left ear HRTF determined in step (a) for any arrival angle in the range and the right ear HRTF determined in step (a) for arrival angle have an inter-auditory phase response that equals the response. of a normal left ear HRTF to target angle and a typical right ear normal HRTF to target angle with less than 20% phase error for all frequencies cies below a coupling frequency, where the coupling frequency is greater than 700 Hz, and the left ear HRTF determined in step (a) for any angle of arrival in the range has a magnitude response that does not demonstrate filtration distortion in comb significant with respect to the magnitude response of the typical left ear normal HRTF for arrival angle, and the right ear HRTF determined in step (a) for any arrival angle in the range has a magnitude response that does not demonstrate filtration distortion comb significant in relation to the magnitude response of the typical right ear normal HRTF to arrival angle, where arrival angle range is at least 60 degrees.
[0006]
6. System for determining a header-related transfer function (HRTF) characterized by the fact that it is coupled to receive a signal indicative of an arrival direction and configured to perform linear mixing of values that determine coupled HRTFs from a set of HRTFs coupled to generate data that determines an interpolated HRTF for arrival directions, wherein the set of coupled HRTFs comprises data values that determine a set of left ear coupled HRTFs and a set of right ear coupled HRTFs for arrival directions that span a range of arrival directions, and the arrival direction is any of the arrival directions in the range, where the coupled HRTFs are determined from normal HRTFs to the same arrival directions by changing the phase response of each normal HRTF above a coupling frequency so that the phase difference between a left ear coupled HRTF and a left ear coupled HRTF the right ear for the same arrival directions is at least substantially constant as a function of frequency, for all frequencies substantially above the coupling frequency.
[0007]
7. System according to claim 6, characterized in that it further includes an HRTF filter subsystem coupled to receive data indicative of the interpolated HRTF, wherein the HRTF filter subsystem is coupled to receive the input signal from audio and configured to filter the input audio signal in response to the interpolated HRTF indicative data, applying interpolated HRTF to the input audio signal, and preferably where the input audio signal is monophonic audio data, and the filter subsystem HRTF implements a virtualizer configured to generate left and right channel output audio signals in response to monaural audio data, including applying interpolated HRTF to monaural input audio signal.
[0008]
8. System according to claim 6, characterized in that the values are coefficients of a base set of HRTFs, and the base set of HRTFs determines the set of coupled HRTFs.
[0009]
9. System according to claim 6, characterized in that the interpolated HRTF has a magnitude response that does not demonstrate significant comb filtration distortion.
[0010]
10. System according to claim 6, characterized in that the lane arrival directions transpose at least 60 degrees in a plane, and preferably in which the lane arrival directions transpose a total lane of 360 degrees in a flat.
[0011]
11. System according to claim 6, characterized in that the system is configured to perform linear mixing of the values that determine the coupled HRTFs of a set of coupled HRTFs to generate data that determine a left ear HRTF for the direction of arrival and a right ear HRTF for the direction of arrival, and preferably wherein the set of coupled HRTFs comprises data values that determine a set of left ear coupled HRTFs and a set of right ear coupled HRTFs for angles that span a range of arrival angles, the mapper is configured to generate data that determines the left ear HRTF for any arrival angle in the range and data that determines the right ear HRTF for arrival angle, so that HRTF left ear and right ear HRTF to arrival angle have an inter-auditory phase response that equals the inter-auditory phase response of an HRTF left ear normal for arrival angle and a typical right ear normal HRTF for arrival angle with less than 20% phase error for all frequencies below a coupling frequency, where the coupling frequency is greater than 700 Hz, and the system is configured to generate the data that determines the left ear HRTF for any landing angle in the range and the data that determines the right ear HRTF for arrival angle, so that left ear HRTF for the landing angle arrival has a magnitude response that does not demonstrate significant comb filtration distortion for the typical left ear normal HRTF magnitude response for arrival angle, and so that HRTF for arrival angle has a magnitude response that does not demonstrate signifi- cant comb filtration distortion in relation to typical right ear normal HRTF magnitude response for arrival angle, where arrival angle range is by the minus 60 degrees.
[0012]
12. System according to claim 6, characterized in that the coupled HTRFs are determined from the normal HRTFs for the same arrival directions by changing the phase response of each normal HTRF above a frequency of coupling such that the phase difference of each coupled HRTF is substantially constant as a function of frequency for all frequencies substantially above the coupling frequency.
[0013]
13. Method for determining a set of coupled header-related transfer functions (HRTFs) for a set of arrival angles that span a range of arrival angles, characterized in that the coupled HRTFs include a left ear coupled HRTF and one right ear coupled HRTF for each of the arrival angles in the set, method including the step of: processing data indicative of a set of normal left ear HRTFs and a set of normal right ear HRTFs for each of the arrival angles in the set of arrival angles to generate coupled HRTF data, where the coupled HRTF data is indicative of a left ear coupled HRTF and a right ear coupled HRTF for each of the arrival angles in the set so that it mixes linear array of coupled HRTF data values, in response to data indicative of any angle of arrival in the range, determines an interpolated HRTF for any angle the arrival in range, interpolated HRTF having a magnitude response that does not demonstrate significant comb filtration distortion, where the processing includes changing the phase response of each normal HRTF above a coupling frequency so that the difference between the The phase of each left ear coupled HRTF and each HRTF and each right ear coupled HRTF is at least substantially constant as a function of frequency, for all frequencies substantially above the coupling frequency.
[0014]
14. Method according to claim 13, characterized in that the coupled HRTF data is generated such that linear mixing of values of the coupled HRTF data, in response to data indicative of any angle of arrival in the range , determines a left ear HRTF for arrival angle and a right ear HRTF for arrival angle, and where left ear HRTF and right ear HRTF for arrival angle have an inter-auditory phase response that matches the inter-auditory phase response of a typical left ear normal HRTF for arrival angle and a typical right ear normal HRTF for arrival angle with less than 20% phase error for all frequencies below a frequency of coupling, where the coupling frequency is greater than 700 Hz, and the left ear HRTF for arrival angle has a magnitude response that does not demonstrate significant comb filtration distortion relative to the d response. and typical left ear normal HRTF magnitude for arrival angle, and right ear HRTF for arrival angle has a magnitude response that does not demonstrate significant comb filtration distortion relative to the magnitude response of normal right ear HRTF typical for arrival angle, where arrival angle range is at least 60 degrees.
[0015]
15. Method according to claim 13, characterized in that it further includes the step of: processing coupled HRTF data to generate a base set of HRTFs, including performing an adjustment process to determine base set values of HRTFs, so the base set of HRTFs determines the set of bound HRTFs to a predetermined precision.

类似技术:

---

公开号 | 公开日 | 专利标题

---

BR112014022438B1|2021-08-24|METHOD AND SYSTEM FOR DETERMINING A HEADER-RELATED TRANSFER FUNCTION AND METHOD FOR DETERMINING A SET OF ATTACHED HEADER-RELATED TRANSFER FUNCTIONS

---

ES2837864T3|2021-07-01|Binaural audio generation in response to multichannel audio using at least one feedback delay network

---

CN102804814B|2015-09-23|Multichannel sound reproduction method and equipment

---

KR101370365B1|2014-03-05|A method of and a device for generating 3D sound

---

JP5449330B2|2014-03-19|Angle-dependent motion apparatus or method for obtaining a pseudo-stereoscopic audio signal

---

US9215544B2|2015-12-15|Optimization of binaural sound spatialization based on multichannel encoding

---

EP3096539B1|2020-03-11|Sound processing device and method, and program

---

KR102124939B1|2020-06-22|Generating binaural audio in response to multi-channel audio using at least one feedback delay network

---

Parodi et al.2010|Objective evaluation of the sweet spot size in spatial sound reproduction using elevated loudspeakers

---

Rabenstein et al.2008|Sound field reproduction

---

Filipanits1994|Design and implementation of an auralization system with a spectrum-based temporal processing optimization

---

KR20030002868A|2003-01-09|Method and system for implementing three-dimensional sound

---

Skarha2021|Performance Tradeoffs in HRTF Interpolation Algorithms for Object-Based Binaural Audio

---

US9025776B2|2015-05-05|Decorrelating audio signals for stereophonic and surround sound using coded and maximum-length-class sequences

---

Chiu et al.2013|EVALUATION OF THE FIDELITY OF FULL AND APPROXIMATED HRTFS FROM THE SONIC FIDELITY OF LOUDSPEAKERS

---

Kelly et al.2012|On Phase and Randomness in Head Related Impulse Responses

同族专利:

---

公开号 | 公开日

---

CA2866309C|2017-07-11|

---

WO2013142653A1|2013-09-26|

---

MX336855B|2016-02-03|

---

RU2591179C2|2016-07-10|

---

CN104205878A|2014-12-10|

---

EP2829082A1|2015-01-28|

---

HK1205396A1|2015-12-11|

---

US9622006B2|2017-04-11|

---

CN104205878B|2017-04-19|

---

EP2829082B8|2016-12-14|

---

KR20140132741A|2014-11-18|

---

JP5960851B2|2016-08-02|

---

KR101651419B1|2016-08-26|

---

MX2014011213A|2014-11-10|

---

US20160044430A1|2016-02-11|

---

AU2013235068B2|2015-11-12|

---

JP2015515185A|2015-05-21|

---

RU2014137116A|2016-04-10|

---

CA2866309A1|2013-09-26|

---

EP2829082B1|2016-10-05|

---

ES2606642T3|2017-03-24|

---

BR112014022438A2|2017-06-20|

---

AU2013235068A1|2014-08-28|

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

---

US5173944A|1992-01-29|1992-12-22|The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration|Head related transfer function pseudo-stereophony|

---

US5438623A|1993-10-04|1995-08-01|The United States Of America As Represented By The Administrator Of National Aeronautics And Space Administration|Multi-channel spatialization system for audio signals|

---

US6072877A|1994-09-09|2000-06-06|Aureal Semiconductor, Inc.|Three-dimensional virtual audio display employing reduced complexity imaging filters|

---

AU732016B2|1994-05-11|2001-04-12|Aureal Semiconductor Inc.|Three-dimensional virtual audio display employing reduced complexity imaging filters|

---

US5659619A|1994-05-11|1997-08-19|Aureal Semiconductor, Inc.|Three-dimensional virtual audio display employing reduced complexity imaging filters|

---

EP0760197B1|1994-05-11|2009-01-28|Aureal Semiconductor Inc.|Three-dimensional virtual audio display employing reduced complexity imaging filters|

---

US5995631A|1996-07-23|1999-11-30|Kabushiki Kaisha Kawai Gakki Seisakusho|Sound image localization apparatus, stereophonic sound image enhancement apparatus, and sound image control system|

---

US6021206A|1996-10-02|2000-02-01|Lake Dsp Pty Ltd|Methods and apparatus for processing spatialised audio|

---

US5751817A|1996-12-30|1998-05-12|Brungart; Douglas S.|Simplified analog virtual externalization for stereophonic audio|

---

GB2351213B|1999-05-29|2003-08-27|Central Research Lab Ltd|A method of modifying one or more original head related transfer functions|

---

US6175631B1|1999-07-09|2001-01-16|Stephen A. Davis|Method and apparatus for decorrelating audio signals|

---

JP4867121B2|2001-09-28|2012-02-01|ソニー株式会社|Audio signal processing method and audio reproduction system|

---

US7558393B2|2003-03-18|2009-07-07|Miller Iii Robert E|System and method for compatible 2D/3D surround sound reproduction|

---

US7949141B2|2003-11-12|2011-05-24|Dolby Laboratories Licensing Corporation|Processing audio signals with head related transfer function filters and a reverberator|

---

GB0419346D0|2004-09-01|2004-09-29|Smyth Stephen M F|Method and apparatus for improved headphone virtualisation|

---

JP2006203850A|2004-12-24|2006-08-03|Matsushita Electric Ind Co Ltd|Sound image locating device|

---

WO2007031905A1|2005-09-13|2007-03-22|Koninklijke Philips Electronics N.V.|Method of and device for generating and processing parameters representing hrtfs|

---

RU2427978C2|2006-02-21|2011-08-27|Конинклейке Филипс Электроникс Н.В.|Audio coding and decoding|

---

WO2007106553A1|2006-03-15|2007-09-20|Dolby Laboratories Licensing Corporation|Binaural rendering using subband filters|

---

WO2008039339A2|2006-09-25|2008-04-03|Dolby Laboratories Licensing Corporation|Improved spatial resolution of the sound field for multi-channel audio playback systems by deriving signals with high order angular terms|

---

JP5114981B2|2007-03-15|2013-01-09|沖電気工業株式会社|Sound image localization processing apparatus, method and program|

---

US20080273708A1|2007-05-03|2008-11-06|Telefonaktiebolaget L M Ericsson |Early Reflection Method for Enhanced Externalization|

---

AU2008309951B8|2007-10-09|2011-12-22|Dolby International Ab|Method and apparatus for generating a binaural audio signal|

---

EP2258120B1|2008-03-07|2019-08-07|Sennheiser Electronic GmbH & Co. KG|Methods and devices for reproducing surround audio signals via headphones|

---

KR101313516B1|2008-07-31|2013-10-01|프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베.|Signal generation for binaural signals|

---

TWI475896B|2008-09-25|2015-03-01|Dolby Lab Licensing Corp|Binaural filters for monophonic compatibility and loudspeaker compatibility|

---

EP2190221B1|2008-11-20|2018-09-12|Harman Becker Automotive Systems GmbH|Audio system|

---

US8705750B2|2009-06-25|2014-04-22|Berges Allmenndigitale Rådgivningstjeneste|Device and method for converting spatial audio signal|

---

JP5423265B2|2009-09-11|2014-02-19|ヤマハ株式会社|Sound processor|

---

KR101567461B1|2009-11-16|2015-11-09|삼성전자주식회사|Apparatus for generating multi-channel sound signal|

---

US8787584B2|2011-06-24|2014-07-22|Sony Corporation|Audio metrics for head-related transfer function selection or adaptation|WO2015147530A1|2014-03-24|2015-10-01|삼성전자 주식회사|Method and apparatus for rendering acoustic signal, and computer-readable recording medium|

---

US10820883B2|2014-04-16|2020-11-03|Bongiovi Acoustics Llc|Noise reduction assembly for auscultation of a body|

---

WO2015173423A1|2014-05-16|2015-11-19|Stormingswiss Sàrl|Upmixing of audio signals with exact time delays|

---

WO2016077514A1|2014-11-14|2016-05-19|Dolby Laboratories Licensing Corporation|Ear centered head related transfer function system and method|

---

US9551161B2|2014-11-30|2017-01-24|Dolby Laboratories Licensing Corporation|Theater entrance|

---

WO2016109103A1|2014-12-30|2016-07-07|Knowles Electronics, Llc|Directional audio capture|

---

JP6477096B2|2015-03-20|2019-03-06|ヤマハ株式会社|Input device and sound synthesizer|

---

WO2017119321A1|2016-01-08|2017-07-13|ソニー株式会社|Audio processing device and method, and program|

---

CN105910702B|2016-04-18|2019-01-25|北京大学|A kind of asynchronous head-position difficult labor measurement method based on phase compensation|

---

WO2017197156A1|2016-05-11|2017-11-16|Ossic Corporation|Systems and methods of calibrating earphones|

---

WO2018009194A1|2016-07-07|2018-01-11|Meyer Sound Laboratories, Incorporated|Magnitude and phase correction of a hearing device|

---

CN105959877B|2016-07-08|2020-09-01|北京时代拓灵科技有限公司|Method and device for processing sound field in virtual reality equipment|

---

CN106231528B|2016-08-04|2017-11-10|武汉大学|Personalized head related transfer function generation system and method based on segmented multiple linear regression|

---

CN106856094B|2017-03-01|2021-02-09|北京牡丹电子集团有限责任公司数字电视技术中心|Surrounding type live broadcast stereo method|

---

CN107480100B|2017-07-04|2020-02-28|中国科学院自动化研究所|Head-related transfer function modeling system based on deep neural network intermediate layer characteristics|

---

US10609504B2|2017-12-21|2020-03-31|Gaudi Audio Lab, Inc.|Audio signal processing method and apparatus for binaural rendering using phase response characteristics|

---

US10142760B1|2018-03-14|2018-11-27|Sony Corporation|Audio processing mechanism with personalized frequency response filter and personalized head-related transfer function |

---

DE102018207780B3|2018-05-17|2019-08-22|Sivantos Pte. Ltd.|Method for operating a hearing aid|

---

CN109005496A|2018-07-26|2018-12-14|西北工业大学|A kind of HRTF middle vertical plane orientation Enhancement Method|

---

CN110881157B|2018-09-06|2021-08-10|宏碁股份有限公司|Sound effect control method and sound effect output device for orthogonal base correction|

---

US20200128346A1|2018-10-18|2020-04-23|Dts, Inc.|Compensating for binaural loudspeaker directivity|

---

CN109618274B|2018-11-23|2021-02-19|华南理工大学|Virtual sound playback method based on angle mapping table, electronic device and medium|

---

US10798515B2|2019-01-30|2020-10-06|Facebook Technologies, Llc|Compensating for effects of headset on head related transfer functions|

---

CN113950845A|2019-05-31|2022-01-18|Dts公司|Concave audio rendering|

---

JP2021013063A|2019-07-04|2021-02-04|クラリオン株式会社|Audio signal processing device, audio signal processing method and audio signal processing program|

法律状态:
2019-12-10| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]|

---

2021-07-06| B09A| Decision: intention to grant [chapter 9.1 patent gazette]|

---

2021-08-24| B16A| Patent or certificate of addition of invention granted [chapter 16.1 patent gazette]|Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 21/03/2013, OBSERVADAS AS CONDICOES LEGAIS. |

优先权:

---

申请号 | 申请日 | 专利标题

---

US201261614610P| true| 2012-03-23|2012-03-23|

---

US61/614,610|2012-03-23|

---

PCT/US2013/033233|WO2013142653A1|2012-03-23|2013-03-21|Method and system for head-related transfer function generation by linear mixing of head-related transfer functions|

---