Human behavior digitization and intent recognition using data modeling

Abstract

Autonomous and network centric smart cameras for use in homeland security and other human activities monitoring applications require a multi-layer approach for real time image processing. We propose a novel method to achieve behavior digitization and preemptive course of action (COA) analysis by converting temporal and spatial pixel subframes into a form that can be encoded into equation based Data Models. Output from these Data Models is fused with evidence and sensor data in the COA decision cascade, which recommends COAs that yield evidence. Evidence from the decision cascade continues to be amassed until the hypothesized threat forms a strong enough conviction to initiate alert responses and external intercepting events. This paper outlines our proposed methodology and approach.