A patented device for multi-modal input such as tactile and voice is developed for experimental beakers, which realizes virtual-real fusion, man-machine fusion and multi-modal fusion. First of all, introduce the smart beaker. The smart beaker is made using 3D printing technology. The smart beaker is equipped with a variety of sensors to sense user operations in real time. This beaker has the common requirements of chemical experiment beakers and can complete different chemical experiments. Moreover, for the first time, a game-rich virtual-real fusion experiment mode is proposed. While clearly explaining the experimental knowledge points, the fun of the game is integrated into the chemical experiment of virtual-real fusion, so that students have a strong interest in the experiment and better grasp the experimental knowledge. In addition, this work integrates a variety of invention patent technologies from the underlying hardware to the core model algorithm, and compared with the existing simulation or VR-based experimental methods, the main breakthrough of this project is to enhance the user's hands-on experience ability, highlighting the advantages of natural interaction and human-computer synergy.