Due to the rise of the Internet of Things, more devices can connect with the Internet. A large amount of data is collected from devices that could be used for different applications. The development of hardware equipment for the Internet of Things not only use for industrial but also for smart homes. The smart home covers broad topics, including remote control of home applications, sensing of humans, temperature-controlling air conditions, and security monitors. When we carry out these topics, the human-machine interface is essential for system applications. A gesture recognition system is applied to many real applications. The reason is that the accuracy rate and real factors are complicated. They commonly use of gesture control service in the market is the sensor board of gesture control. The principle is using the electric field to change and determine the gestures. The limitation requires the close operation, and there is a problem of critical point sensitivity. In this paper, we use the gesture control board to combine with gesture image recognition methods to perform the double authentication gesture recognition. Raspberry Pi is the control center to integrate the intelligent light bulb. HUE makes a gesture recognition system. The results explain that the accuracy rate of the gesture recognition proposed is 90%. Meanwhile, it is higher than the SVM method.