In the background modeling, moving objects would often enter the scene. “Ghost” emerges as the pixels of interfering objects damage the background model. This paper presents a “ghost” suppression algorithm based on two - frame difference method and topology (TFDT). First in TFDT algorithm is to obtain the change mask with two-frame-difference method detecting the difference between two adjacent frames. Then according to the change mask, the complete object region and its bounding box are estimated with topo-logical structure. Finally, the pixels in the bounding box are eliminated, and the remaining pixels are added to the background model. TFDT is a universal algorithm for background modeling and can be adapted in foreground detection algorithms such as Codebook and ViBe. It can effectively remove object’s pixels and build a background model for foreground detection algorithms. In this work, TFDT is used to improve Codebook and ViBe, and the “ghost” is absent from the result, which has been verfied in the CDnet database.