This system is based on virtual reality and augmented reality virtual model of multi-interactive system. The system is divided into two modules: virtual model display module and augmented reality interior design module. The display module is the overall roaming display of the model room. At the same time, a variety of interactive functions are added, such as switching the TV, changing the closet material, changing the sofa, wallpaper, voice switch lights, automatic door sensing, and any mobile furniture model. The augmented reality interior design module can design furniture models according to user needs, change materials, 360-degree rotating display, screenshots, etc. Also added a functional expansion, augmented reality mode to show the operation of the planet, so that the dynamic planet is displayed in front of the user for the user to enjoy. In the augmented reality module, dynamic gesture recognition is also added to improve the human-computer interaction between the user and the system and increase the interest.