Paper: Multimodal Detection of Human Interaction Events in a Nursing Home Environment Chen, D., Yang, J., Malkin, R., Sixth International Conference on Multimodal Interfaces (ICMI'04), Penn State University, State College, PA, October 14-15, 2004 Abstract:   In this paper, we propose a multimodal system for detecting human activity and interaction patterns in a nursing home. Activities of group people are firstly treated as interaction patterns between any pair of the two partners and are then further broken into individual activities and behavior events using a multi-level context hierarchy graph. The graph is implemented using a dynamic Bayesian network to statistically model the multi-level concepts. We have developed a coarse-to-fine prototype system to illustrate the proposed concept. Experiment results have demonstrated feasibility of the proposed approaches. The objective of this research is to automatically create concise and comprehensive reports of activities and behaviors of patients to support physicians and caregivers in a nursing facility. Close