Indonesia has many cultures on each island including language, games, food, and another thing. One of the popular game is puppet performance until now still available, especially in the sacred event. The performance still using traditional method which person can play just expert and must be brought many puppets for performance. The puppet game using hand gesture tracking and recognition for playing. Firstly, in-game need two hands to generate or move puppet so need clustering method for cluster right hand and left hand. The clustering method using DBSCAN (Density-based spatial clustering of applications with noise) clustering, which can cluster automatically and efficiently than another method. The right and left hand will search about each median. There is three distance for use in threshold testing of DBSCAN method. From the result, the threshold value by 25 is the best result because can be clustered left and right hand correctly. The last step is gesture recognition using template matching method consist of three templates including down, right, left direction. In the results, we get accuracy above 90% for hand gesture recognition testing both median1 and median2.