Simple Object (People) Detector and Tracker

The Object Detector and Tracker is a tool for detecting and tracking people and objects and give some interpretation about interactions between these detected objects. The each detected object history information is keep in the global object list and the list is used in the tracker phase. It runs on 166Mhz Pentium pc's with 3-5Hz speed.

The idea is that we do not need to do intense segment analysis for each frame in people surveillance type of problem. We need to detect the object and track it until some "Interesting Event" occurs. When it occurs then we do high level segment analysis to understand the actions. Therefore We keep the history of the object and when interesting event occurs, we can go back and process them and come up conclusion.

The brief information about detection and tracking phase are given following sections.

  • Object Detection

  • Object Tracker

  • Parts Finder (Head, feet, torso,..)

    • Examples:

    Walk and take an Object (mpeg movie) : A Person walks to a bag and take it from ground. At the end, tracker can realize that Object 2 is a missing object and it has a parent which is object 1.
    Result: "object 1 took object 2 "
    Walk and leave an object (mpeg movie) : A Person with a briefcase walks and leave the briefcase on the ground. Atthe end tracker can realize that Object 2 is a new object and it has a parent which is object 10.
    Result: Object 2 was introduced to the scene by Object 8"
    Parking a Car (mpeg movie) : A Car is parked to Lot and driver get off the car. Tracker can realize that Object 1 is a new Object in Parking Lot and Object 3 has a parent of Object 1, means Object 3 is brought to scene by Object 1
    Two People exchanging an object (mpeg movie) Two People walk to each other and one gives a briefcase to other
    Result : Object 4 and Object 5 did some actions in these frames ...."
    Three People in the scene (some sample images) or (mpeg movie)