End-to-End Paired Ambisonic-Binaural Audio Rendering

Binaural rendering is of great interest to virtual reality and immersive media. Although humans can naturally use their two ears to perceive the spatial information contained in sounds, it is a challenging task for machines to achieve binaural rendering since the description of a sound field often requires multiple channels and even the metadata of the sound sources. In addition, the perceived sound varies from person to person even in the same sound field. Previous methods generally rely on individual-dependent head-related transferred function(HRTF)datasets and optimization algorithms that act on HRTFs. In practical applications, there are two major drawbacks to existing methods. The first is a high personalization cost, as traditional methods achieve personalized needs by measuring HRTFs. The second is insufficient accuracy because the optimization goal of traditional methods is to retain another part of information that is more important in perception at the cost of discarding a part of the information. Therefore, it is desirable to develop novel techniques to achieve personalization and accuracy at a low cost. To this end, we focus on the binaural rendering of ambisonic and propose 1) channel-shared encoder and channel-compared attention integrated into neural networks and 2) a loss function quantifying interaural level differences to deal with spatial information. To verify the proposed method, we collect and release the first paired ambisonic-binaural dataset and introduce three metrics to evaluate the content information and spatial information accuracy of the end-to-end methods. Extensive experimental results on the collected dataset demonstrate the superior performance of the proposed method and the shortcomings of previous methods.

Determining the effective elastic thickness through cross-correlation between isostatic disturbances

The elastic thickness parameter was estimated using the mobile correlation technique between the observed isostatic disturbance and the gravity disturbance calculated through direct gravimetric modeling. We computed the vertical flexure value of the crust for a specific elastic thickness using a given topographic dataset. The gravity disturbance due to the topography was determined after the calculation. A grid of values for the elastic thickness parameter was generated. Then, a moving correlation was performed between the observed gravity data(representing actual surface data) and the calculated data from the forward modeling. The optimum elastic thickness of the particular point corresponded to the highest correlation coefficient. The methodology was tested on synthetic data and showed that the synthetic depth closely matched the original depth, including the elastic thickness value. To validate the results, the described procedure was applied to a real dataset from the Barreirinhas Basin, situated in the northeastern region of Brazil. The results show that the obtained crustal depth is highly correlated with the depth from known models. Additionally, we noted that the elastic thickness behaves as expected, decreasing from the continent towards the ocean. Based on the results, this method has the potential to be employed as a direct estimate of crustal depth and elastic thickness for any region.

People Recognition by RGB and NIR Analysis from Digital Image Database Using Cross-Correlation and Wavelets

This document presents a framework for recognizing people by palm vein distribution analysis using cross-correlation based signatures to obtain descriptors. Haar wavelets are useful in reducing the number of features while maintaining high recognition rates. This experiment achieved 97.5% of individuals classified correctly with two levels of Haar wavelets. This study used twelve-version of RGB and NIR (near infrared) wavelength images per individual. One hundred people were studied;therefore 4,800 instances compose the complete database. A Multilayer Perceptron (MLP) was trained to improve the recognition rate in a k-fold cross-validation test with k = 10. Classification results using MLP neural network were obtained using Weka (open source machine learning software).

Cross-Correlation between Global Temperature and Atmospheric CO2 with a Temperature-Leading Time Lag

The temperature change and rate of CO2 change are correlated with a time lag, as reported in a previous paper. The correlation was investigated by calculating a correlation coefficient r of these changes for selected ENSO events in this study. Annual periodical increases and decreases in the CO2 concentration were considered, with a regular pattern of minimum values in August and maximum values in May each year. An increased deviation in CO2 and temperature was found in response to the occurrence of El Niño, but the increase in CO2 lagged behind the change in temperature by 5 months. This pattern was not observed for La Niña events. An increase in global CO2 emissions and a subsequent increase in global temperature proposed by IPCC were not observed, but an increase in global temperature, an increase in soil respiration, and a subsequent increase in global CO2 emissions were noticed. This natural process can be clearly detected during periods of increasing temperature specifically during El Niño events. The results cast strong doubts that anthropogenic CO2 is the cause of global warming.

Differential advantages of musical backgrounds on binaural integration and interaction skills in instrumentalists,vocalists,and non-musicians

Background:Musical perception requires a host of skills.Instrumental musicians place greater emphasis on motor coordination,whereas vocal musicians rehearse vocal sounds.The study explored the differential advantages of musical background on binaural integration and interaction in musicians(instrumentalists,vocalists)and compared them with age-matched non-musicians.Methods:Eight six participants aged 20e40 y with normal hearing sensitivity were subjected to binaural tests using a standard group comparison research design.The participants were segregated into three groups e Group 1 included instrumentalists(n?26,mean age:17.73±2.83 y),while Group 2 and Group 3 consisted of vocalists(n?30,mean age:19.30±2.47 y)and non-musicians(n?30,mean age:18.20±3.02 y)respectively.The binaural processes namely integration(Dichotic syllable test,DST;and virtual acoustic space identification-VASI)and interaction(Interaural difference thresholds for time and level:ITD&ILD),were administered on all the participants.Results:Statistical analyses showed the main effect of musicianship.Bonferroni pair-wise test revealed that the musicians(instrumentalists and vocalists)outperformed(p<0.05)non-musicians in all the tests.The differential advantage of the musical background was seen on the binaural integration test with instrumentalists performing better in the VASI test compared to vocalists,and vice-versa for DST.No difference was observed in interaction tasks(ITD&ILD)between vocalists and instrumentalists(p>0.05).Conclusion:Musical background-induced differential advantages can be reasonably noted in the binaural skills of instrumentalists and vocalists(compared to non-musicians).

Binaural masking level difference for pure tone signals

The binaural masking level difference(BMLD)is a psychoacoustic method to determine binaural interaction and central auditory processes.The BMLD is the difference in hearing thresholds in homophasic and antiphasic conditions.The duration,phase and frequency of the stimuli can affect the BMLD.The main aim of the study is to evaluate the BMLD for stimuli of different durations and frequencies which could also be used in future electrophysiological studies.To this end we developed a GUI to present different frequency signals of variable duration and determine the BMLD.Three different durations and five different frequencies are explored.The results of the study confirm that the hearing threshold for the antiphasic condition is lower than the hearing threshold for the homophasic condition and that differences are significant for signals of 18ms and 48ms duration.Future objective binaural processing studies will be based on 18ms and 48ms stimuli with the same frequencies as used in the current study.

Three-dimensional color particle image velocimetry based on a cross-correlation and optical flow method

Rainbow particle image velocimetry(PIV)can restore the three-dimensional velocity field of particles with a single camera;however,it requires a relatively long time to complete the reconstruction.This paper proposes a hybrid algorithm that combines the fast Fourier transform(FFT)based co-correlation algorithm and the Horn–Schunck(HS)optical flow pyramid iterative algorithm to increase the reconstruction speed.The Rankine vortex simulation experiment was performed,in which the particle velocity field was reconstructed using the proposed algorithm and the rainbow PIV method.The average endpoint error and average angular error of the proposed algorithm were roughly the same as those of the rainbow PIV algorithm;nevertheless,the reconstruction time was 20%shorter.Furthermore,the effect of velocity magnitude and particle density on the reconstruction results was analyzed.In the end,the performance of the proposed algorithm was verified using real experimental single-vortex and double-vortex datasets,from which a similar particle velocity field was obtained compared with the rainbow PIV algorithm.The results show that the reconstruction speed of the proposed hybrid algorithm is approximately 25%faster than that of the rainbow PIV algorithm.

Up-Sampled Cross-Correlation Based Object Tracking & Vibration Measurement in Agriculture Tractor System

This research introduces a challenge in integrating and cleaning the data,which is a crucial task in object matching.While the object is detected and then measured,the vibration at different light intensities may influence the durability and reliability of mechanical systems or structures and cause problems such as damage,abnormal stopping,and disaster.Recent research failed to improve the accuracy rate and the computation time in tracking an object and in the vibration measurement.To solve all these problems,this proposed research simplifies the scaling factor determination by assigning a known real-world dimension to a predetermined portion of the image.A novel white color sticker of the known dimensions marked with a color dot is pasted on the surface of an object for the best result in the template matching using the Improved Up-Sampled Cross-Correlation(UCC)algorithm.The vibration measurement is calculated using the Finite-Difference Algorithm(FDA),a machine vision systemfitted with a macro lens sensor that is capable of capturing the image at a closer range,which does not affect the quality of displacement measurement from the video frames.Thefield test was conducted on the TAFE(Tractors and Farm Equipment Limited)tractor parts,and the percentage of error was recorded between 30%and 50%at very low vibration values close to zero,whereas it was recorded between 5%and 10%error in most high-accelerations,the essential range for vibration analysis.Finally,the suggested system is more suitable for measuring the vibration of stationary machinery having low frequency ranges.The use of a macro lens enables to capture of image frames at very close-ups.A 30%to 50%error percentage has been reported when the vibration amplitude is very small.Therefore,this study is not suitable for Nano vibration analysis.

Temporal-spatial cross-correlation analysis of non-stationary near-surface wind speed time series

Temporal-spatial cross-correlation analysis of non-stationary wind speed time series plays a crucial role in wind field reconstruction as well as in wind pattern recognition.Firstly,the near-surface wind speed time series recorded at different locations are studied using the detrended fluctuation analysis(DFA),and the corresponding scaling exponents are larger than 1.This indicates that all these wind speed time series have non-stationary characteristics.Secondly,concerning this special feature( i.e.,non-stationarity)of wind signals,a cross-correlation analysis method,namely detrended cross-correlation analysis(DCCA) coefficient,is employed to evaluate the temporal-spatial cross-correlations between non-stationary time series of different anemometer pairs.Finally,experiments on ten wind speed data synchronously collected by the ten anemometers with equidistant arrangement illustrate that the method of DCCA cross-correlation coefficient can accurately analyze full-scale temporal-spatial cross-correlation between non-stationary time series and also can easily identify the seasonal component,while three traditional cross-correlation techniques(i.e.,Pearson coefficient,cross-correlation function,and DCCA method) cannot give us these information directly.

Reconstruction of sub cross-correlation cancellation technique for unambiguous acquisition of BOC(kn, n) signals

In order to solve the problem of ambiguous acquisition of BOC signals caused by its property of multiple peaks,an unambiguous acquisition algorithm named reconstruction of sub cross-correlation cancellation technique(RSCCT)for BOC(kn,n)signals is proposed.In this paper,the principle of signal decomposition is combined with the traditional acquisition algorithm structure,and then based on the method of reconstructing the correlation function.The method firstly gets the sub-pseudorandom noise(PRN)code by decomposing the local PRN code,then uses BOC(kn,n)and the sub-PRN code cross-correlation to get the sub cross-correlation function.Finally,the correlation peak with a single peak is obtained by reconstructing the sub cross-correlation function so that the ambiguities of BOC acquisition are removed.The simulation shows that RSCCT can completely eliminate the side peaks of BOC(kn,n)group signals while maintaining the narrow correlation of BOC,and its computational complexity is equivalent to sub carrier phase cancellation(SCPC)and autocorrelation side-peak cancellation technique(ASPeCT),and it reduces the computational complexity relative to BPSK-like.For BOC(n,n),the acquisition sensitivity of RSCCT is 3.25 dB,0.81 dB and 0.25 dB higher than binary phase shift keying(BPSK)-like,SCPC and ASPeCT at the acquisition probability of 90%,respectively.The peak to average power ratio is 1.91,3.0 and 3.7 times higher than ASPeCT,SCPC and BPSK-like at SNR=–20 dB,respectively.For BOC(2n,n),the acquisition sensitivity of RSCCT is 5.5 dB,1.25 dB and 2.69 dB higher than BPSK-like,SCPC and ASPeCT at the acquisition probability of 90%,respectively.The peak to average power ratio is 1.02,1.68 and 2.12 times higher than ASPeCT,SCPC and BPSK-like at SNR=–20 dB,respectively.

Binaural integration abilities in bilateral cochlear implant user

Bilateral Cochlear implants (CIs) improved speech intelligibility, speech perception in background noise, and sound localization in quiet and noisy situations. However, it is unclear whether these advantages essentially result in binaural integration of acoustic stimuli from each ear. In this study, we investigated the effectiveness of binaural integration by bilateral CIs placement using binaural hearing tests and subjective auditory perceptual assessment. A 61-year-old bilateral CIs subject underwent the following four tests:the Japanese Hearing in Noise Test (HINT-J), the dichotic listening test (DLT), the Rapidly Alternating Speech Perception (RASP) test, and subjective auditory perceptual assessment. The HINT-J score was significantly higher for bilateral CIs than for a unilateral CI. However, DLT and the RASP test revealed contradictory results. Subjective auditory perceptual assessment revealed active and bright impressions for bilateral hearing, which were also noisy and strong compared with those for unilateral hearing. The results of this study revealed that bilateral CIs improved speech perception in background noise and an improved auditory impression, although the bilateral integration abilities were not improved. This was probably because the patient was required to combine information from the two ears into a single perception in DLT and the RASP test. More longitudinal data should be collected and analyzed in future studies to evaluate the long-term effects of bilateral CIs. Copyright ? 2016, PLA General Hospital Department of Otolaryngology Head and Neck Surgery. Production and hosting by Elsevier (Singapore) Pte Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Estimation of Cloud Motion Using Cross-Correlation

This paper describes the estimation of cloud motion using lag cross-correlation. In order to compute the lag cross correlation, the Bayes Decision method is used first to identify cloud and surface of earth. Then cloud motion vectors are retrieved at a subset of points through multiple applications of a cross-correlation analysis. An objective analysis is used to define displacement at every satellite pixel throughout the domain and smooth the local inconsistencies. Cloud motions are then produced with a backward trajectory technique by using these displacement vectors.

Detrended cross-correlation analysis of electroencephalogram

In the paper we use detrended cross-correlation analysis （DCCA） to study the electroencephalograms of healthy young subjects and healthy old subjects. It is found that the cross-correlation between different leads of a healthy young subject is larger than that of a healthy old subject. It was shown that the cross-correlation relationship decreases with the aging process and the phenomenon can help to diagnose whether the subject＇s brain function is healthy or not.

RESEARCH ON THE ALGORITHM OF BINARY IMAGE CROSS-CORRELATION FOR UNSTEADY FLOW FIELD MEASUREMENT

The algorithm of Binary Image Cross-Correlation (BICC) was developed to measure the unsteady flow field. A vortex flow field was used to test the algorithm by numerical simulation. The results show that BICC is an effective algorithm for particle identification from consecutive images, the accurate velocity vector field can be obtained. The real velocity field in a valve chamber was measured by BICC in this study. From the full-field velocity information, the pressure and vorticity fields were also extracted by post-processing. (Edited author abstract) 6 Refs.

Model-data-driven P-wave impedance inversion using ResNets and the normalized zero-lag cross-correlation objective function

Model-driven and data-driven inversions are two prominent methods for obtaining P-wave impedance,which is significant in reservoir description and identification.Based on proper initial models,most model-driven methods primarily use the limited frequency bandwidth information of seismic data and can invert P-wave impedance with high accuracy,but not high resolution.Conventional data-driven methods mainly employ the information from well-log data and can provide high-accuracy and highresolution P-wave impedance owing to the superior nonlinear curve fitting capacity of neural networks.However,these methods require a significant number of training samples,which are frequently insufficient.To obtain P-wave impedance with both high accuracy and high resolution,we propose a model-data-driven inversion method using Res Nets and the normalized zero-lag cross-correlation objective function which is effective for avoiding local minima and suppressing random noise.By using initial models and training samples,the proposed model-data-driven method can invert P-wave impedance with satisfactory accuracy and resolution.Tests on synthetic and field data demonstrate the proposed method’s efficacy and practicability.

Public cloud computing for seismological research:Calculating large-scale noise cross-correlations using ALIYUN

The amount of seismological data is rapidly increasing with accumulating observational time and increasing number of stations, requiring modern technique to provide adequate computing power. In present study, we proposed a framework to calculate large-scale noise crosscorrelation functions(NCFs) using public cloud service from ALIYUN. The entire computation is factorized into small pieces which are performed parallelly on specified number of virtual servers provided by the cloud. Using data from most seismic stations in China, five NCF databases are built. The results show that, comparing to the time cost using a single server, the entire time can be reduced over two orders of magnitude depending number of evoked virtual servers. This could reduce computation time from months to less than 12 hours. Based on obtained massive NCFs, the global body waves are retrieved through array interferometry and agree well with those from earthquakes. This leads to a solution to process massive seismic dataset within an affordable time and is applicable to other large-scale computing in seismological researches.

DETECTING TECHNIQUE OF WEAK PERIODIC PULSE SIGNAL VIA SYNTHESIS OF CROSS-CORRELATION AND CHAOTIC SYSTEM

In this letter, with the synthesis of usual cross-correlation detecting method andchaotic detecting method, a new detecting system for the weak periodic pulse signal is constituted,in which the two methods can play respective preponderance. Theoretical analyses and simulationstudies have shown that the detecting system is very sensitive to the periodic pulse signal understrong noise background and has exceedingly powerful capability of suppressing complex noise.

Time dependence of entropy flux and entropy production for a dynamical system driven by noises with coloured cross-correlation

This paper shows the Fokker-Planck equation of a dynamical system driven by coloured cross-correlated white noises in the absence and presence of a small external force. Based on the Fokker-Planck equation and the definition of Shannon＇s information entropy, the time dependence of entropy flux and entropy production can be calculated. The present results can be used to explain the extremal behaviour of time dependence of entropy flux and entropy production in view of the dissipative parameter γ of the system, coloured cross-correlation time τ and coloured cross-correlation strength λ.

AN IMPROVED CROSS-CORRELATION METHOD FOR(DIGITAL)PARTICLE IMAGE VELOCIMETRY

An improved method that brings enhancement in accuracy for the interrogation of (digital) PIV images is described in this paper. This method is based on cross-correlation with discrete window offset, which makes use of a translation of the second interrogation window and rebuilds it considering rotation and shear. The displacement extracted from PIV images is predicted and corrected by means of an iterative procedure. In addition, the displacement vectors are validated at each intermediate of the iteration process. The present improved cross-correlation method is compared with the conventional one in accuracy by interrogation of synthetic and real (digital) PIV images and the interrogation results are discussed.

Time correction of the ocean bottom seismometers deployed at the southwest Indian ridge using ambient noise cross-correlation

Seismic monitoring using ocean bottom seismometers（OBS） is an efficient method for investigating earthquakes in mid-ocean ridge far away from land. Clock synchronization among the OBSs is difficult without direct communication because electromagnetic signals cannot propagate efficiently in water. Time correction can be estimated through global positioning system（GPS） synchronization if clock drift is linear before and after the deployment. However, some OBSs in the experiments at the southwest Indian ridge（SWIR） on the Chinese DY125-34 cruise had not been re-synchronized from GPS after recovery. So we attempted to estimate clock drift between each station pairs using time symmetry analysis（TSA） based on ambient noise cross-correlation. We tested the feasibility of the TSA method by analyzing daily noise cross-correlation functions（NCFs） that extract from the data of another OBS experiment on the Chinese DY125-40 cruise with known clock drift and the same deployment site. The results suggest that the NCFs＇ travel time of surface wave between any two stations are symmetrical and have an opposite growing direction with the date. The influence of different band-pass filters,different components and different normalized methods was discussed. The TSA method appeared to be optimal for the hydrophone data within the period band of 2–5 s in dozens of km-scale interstation distances. A significant clock drift of ~2 s was estimated between OBSs sets through linear regression during a 108-d deployment on the Chinese cruise DY125-34. Time correction of the OBS by the ambient noise cross-correlation was demonstrated as a practical approach with the appropriate parameters in case of no GPS re-synchronization.