This paper presents distributed, automated, scene surveillance architecture. Object detection and tracking is performed by a set of Region and Object Agent. The Area under surveillance is divided in several sub-areas. One camera is assigned to each sub-area. A Region Agent is responsible for monitoring a given sub-area. First a background subtraction is performed to the scene taken by the camera. Based on the foreground mask, Region Agent segments the incoming frame and creates Object Agents dedicated to tracking detected objects. Tracking information and segments are sent to a Scene Processing Unit that analyzed this information and determined if a threat pattern is present at the scene and performed appropriate action.