Detailed description of the research topic
Research topics
Detailed description of the joint project “Research and Application Demonstration on Key Technologies of AR Information Service in Museum Based on 4G/5G”
01.
Architecture of AR Museum Visualization Platform System
The visualization platform of AR museum based on 4G/5G mainly includes four subsystems:
- Positioning subsystem
- Data input and collection subsystem
- Recognition and fusion subsystem
- Human-computer interaction subsystem
For different cultural relics exhibits, firstly, the camera captures the real world image and recognizes the target in the image using complex scene understanding technology; secondly, the matching information of the target is acquired and identified from the database; finally, the virtual digital content of cultural relics is accurately superimposed on the physical world image to realize the virtual living restoration of cultural relics exhibits and provide intelligent services.
The platform will fuse and superimpose the historical stories behind the cultural relics exhibits and the images of the actual exhibits, and construct the information transmission mode combining the special terminal and digital content, so as to achieve the intelligent fusion between the cultural relics, historical events, audiences, historical scenes and other elements in the collection.
02.
The production of digital content
Focusing on the background stories of cultural relics exhibits, the platform produces visual images by precise overlay, perfectly integrating the relationship between real cultural relics and virtual overlays.
We will select several representative cultural relics from many cultural relics for digital interpretation.
In addition to the production of integrated artistic expression forms such as pictures, text, audio-visual images, etc., Unity technology will be used for digital packaging to achieve virtual living restoration of cultural relics exhibits, making them more visual impact. At the same time, through the visual effects such as particle effects to enhance the experience, enrich the sensory experience of the exhibitors, so that the exhibitors will not be boring.
03.
Design and Development of Mobile Terminal Equipment
The terminal equipment are equipped with:
- Customized operating system
- Built-in wireless communication module
- Wireless positioning module
- "Universal recognition" image recognition module
which can detect cultural relics and characters in complex scenes, realize the global or local scanning and recognition of exhibits by mobile terminal equipment, capture real-world images through cameras, identify targets in images using image recognition technology, and then the matching information of object is acquired and recognized in the database. Finally, the seamless fusion and superposition of entity scene and virtual image are realized on the mobile terminal.
The device does not depend on special hardware to meet the real-time 6-DOF attitude tracking based on monocular camera, to ensure the fluency of identifying ejecta, to quickly re-locate and scan when confronted with interference or other unstable factors, to ensure the stability of identifying objects under interference, to improve the loading speed of resources, and to recognize the real-time tracking of ejected visual images. Functional requirements such as locating scanned objects and tracking multiple targets can be recognized. The device captures images from natural objects using augmented reality technology and presents three-dimensional dynamic images. By using depth optimization algorithm based on machine learning and classification recognition algorithm based on machine learning, the technical parameters such as exposure compensation, white balance and sensitivity of image are dynamically adjusted in ISP to improve image recognition rate and ensure the fusion of augmented reality overlay display and real scene. Use additional features to show the most attractive AR content.
04.
Wireless Broadband 4G/5G Environment
With the combination of wireless location and wireless communication system, users can understand the story behind the cultural relics through the integration of virtual and real visual effects at any time during the visit process.
At the same time, it uses 4G or 5G communication technology with low power delay, high speed and interconnection to realize the functions of remote information exchange, real-time content updating and user experience uploading, and intelligently optimizes the system platform.
According to the characteristics of the museum in Croatia, we select a museum as an application demonstration site, a wireless broadband 4G/5G experience environment is built, a visual explanation platform is deployed, and virtual digital content is loaded into it. The application demonstration is carried out among museum audiences through professional terminal equipment.
