A hierarchical non-adaptive system-level diagnosis approach is introduced categorized into three types of interconnection systems; array-, hypercube-, and tree-typed systems which consist of a large number of identical units (This type of interconnection system does appear to be more common in modern hardware such as Red Storm Supercomputer or Blue Gene/L system in parallel computers). This diagnostic approach employs a simple voting scheme where the votes are counted locally by a monitor unit in each set and in each hierarchical cluster, and the monitor calculates an answer based on the threshold. The main contribution of this paper is to show the effectiveness of this test architecture under realistic circumstances.