A service-oriented framework for context-aware semantic media applications

As we move closer to the vision of ubiquitous, invisible computing, we feel the need for a framework that supports the integration of visual and auditory inputs with context sourced from various ambient 'sense organs' such as temperature and pressure sensors etc, as well as other factual information about Persons, Locations, Activity Schedules and Events that are of significance to human beings. In this paper we describe our framework for integrating visual inputs at the human-semantics level, so that these inputs can be used for reasoning and inference. We borrow techniques from Media and Knowledge Representation as well as work in Pervasive Context-Aware Computing to build a unifying service-oriented framework that can support applications with differing needs.