Monitoring Human Behavior in an Office Environment

In this paper, we describe a system which makes context-based decisions about the actions of people in a room. These actions include entering, using a computer terminal, opening a cabinet, picking up a phone, etc. Our system is able to make these decisions by using prior knowledge about the layout of the room. The low-level Computer Vision techniques of tracking, skin detection, and scene change detection are used in our system to help perform action recognition. All three of these techniques use color images. The output of this system is both a textual and a key frame description of the recognized actions.

Associated publications:
Monitoring Human Behavior from Video Taken in an Office Environment
Image and Vision Computing

Power Point presentation is here:

Result Videos:
Video1
Video2
Video3
Video4
Video5
Video6