This paper presents a method for efficiently detecting high-level activities from interleaved data streams using temporal stochastic automaton-based models. It introduces a temporal multiactivity graph for storing concurrent activities and a corresponding TMagic index for linking observations, along with algorithms for insertion and retrieval. Experiments indicate that this approach achieves linear time and space complexity relative to input size, facilitating effective monitoring of activities.