how to retrieve video based on audio?

Hi, i'm doing video retrieval based on audio cues, i.e, i just have an audio clip as a query and i have to extract or retrieve tat part of video from the original video. Like the wicket falling sound, ball hitting sound or whistle sound etc. i've done work till getting MFCC coefficients, zero crossing rate and short time energy. now the task where i have got struck is how to analyse the video, i mean how to match those audio features to tat video containing tat audio? any techniques to perform that task? if so plz suggest me. Thanking you in advance.