Acoustic Image Overlay: Real time Image transfer
Image transfer: Noise source identification via acoustic holography seeks to determine the noise location from remote measurements of the acoustic field. Here we add the capacity to visually identify the source via automatic warping of the sound image. This implementation also has application to areas such as gunshot detection, meeting recording (identifying who’s talking), etc. An audio image was generated at a rate of 30 frames/s and video was acquired at a rate of 10 frames/s. In order to reduce the effects of incoherent reverberation and spurious peaks we incorporated a temporal filter of the audio image prior to transfer. Once the audio image is generated a second GPU kernel is assigned to generate the image transfer overlay which is then alpha blended with the video frame. The audio image transfer is also performed in parallel on the GPU and the corresponding values are then mapped to a texture and displayed over the video frame. Though the video frames are only acquired at 10 frames per second the over-laid audio image achieves the same frame rate as the audio camera (30fps).