In this paper, we discuss wearable interfaces for a computational memory-aid useful in everyday life. The aim of this study is to develop a Video Diary system with vision interfaces to aid in memory retrieval. The Video Diary system provides users with "Memory Retrieval, Exchange, and Transportation" through four types of indexes: 1) through the user?s location, 2) through real world object(s), 3) through keyword(s) and 4) through the use of a summary or "the story of the day." The authors have developed the following two systems to achieve the above indexes: 1) a Residual Memory system, 2) a Ubiquitous Memories system. Residual Memory can index a user?s location automatically by analyzing a video recorded from a wearable camera for "Memory Retrieval." Ubiquitous Memories provides users with the ability to associate augmented memories with real world objects for "Memory Exchange." We have integrated the above two systems for "Memory Transportation." We believe that the above interfaces can be integrated into the Video Diary system.