Multiple Media Stream Data Analysis: Theory and Applications (Extended version)

Authors

Charles B. Owen, Dartmouth College
Fillia Makedon, Dartmouth College

Document Type

Technical Report

Publication Date

7-10-1997

Technical Report Number

PCS-TR97-321

Abstract

This paper presents a new model for multiple media stream data analysis as well as descriptions of some applications of this model in development at Dartmouth College. This model formalizes the exploitation of correlations between multiple, potentially heterogeneous, media streams in support of numerous application areas. The goal of the technique is to determine temporal and spatial alignments which optimize a correlation function and indicate commonality and synchronization between media streams. It also provides a framework for comparison of media in unrelated domains. Applications such as text-to-speech alignment, functional magnetic resonance imaging, speaker localization, and degraded media realignment are described.

Comments

A shorter version of this paper appears in the Proceedings of Gesellschaft fur Klassifikation e.V., University of Potsdam, Potsdam, Germany, March 12-14, 1997

Dartmouth Digital Commons Citation

Owen, Charles B. and Makedon, Fillia, "Multiple Media Stream Data Analysis: Theory and Applications (Extended version)" (1997). Computer Science Technical Report PCS-TR97-321. https://digitalcommons.dartmouth.edu/cs_tr/155