The SignGuide project was a groundbreaking initiative aimed at enhancing the museum experience for deaf visitors through advanced technological integration. Implemented within the framework of the RESEARCH – CREATE – INNOVATE Action, and co-financed by the European Union and national resources via EPANEK, this project represented a significant leap in making cultural experiences more inclusive. With the project code T2EDK-00982, SignGuide aimed to enhance accessibility, thereby improving social integration and satisfaction for deaf museum visitors.

The Project’s Objectives and Vision

The primary goal of SignGuide was to develop a standard interactive tour system using mobile devices that can answer visitors’ questions in sign language (SL) about museum exhibits. Leveraging techniques from computer vision, machine learning, and graphics, the system was designed to provide additional content through avatars or videos, ensuring a seamless and informative experience for deaf visitors. The ultimate aim was to increase visitor satisfaction and foster better social integration by improving the dissemination of cultural content. This aligns with European legislation mandating equal access to services for vulnerable social groups.

The Development Phases

Initial Version and User Feedback

The first version of SignGuide focused on developing a user-friendly interface and initial functionalities. Feedback from participants in the project led to significant observations and improvements in the application’s user interface (UI). This feedback loop was crucial in refining the application to better meet the needs of its intended users—deaf museum visitors.

Enhanced Exhibit Recognition

In its initial iteration, SignGuide used QR codes for exhibit recognition. Visitors would scan a QR code to access information about an exhibit. However, the second version introduced an augmented reality (AR) system to enhance this process. Users can now simply point their camera at an exhibit, and the system, using AR, recognizes the exhibit’s features and directs the user to the corresponding content page. This advancement not only simplifies the interaction but also enriches the overall user experience.

Augmented Reality Integration

AR technology plays a critical role in the latest version of SignGuide. By leveraging the mobile device’s hardware, AR provides an interactive experience that merges the real world with digital content. This technology allows the system to recognize museum environments and exhibits, facilitating easier navigation and interaction for users. It enhances accessibility for both visually impaired and deaf visitors by providing intuitive guidance and relevant information seamlessly.

Key Functionalities and Innovations

Video Question Recording

A significant feature of the updated SignGuide is the ability for users to record their questions about exhibits in sign language using their device’s camera. This video is then processed via an API to match the user’s query with a list of potential questions, ensuring that users receive accurate and relevant responses. This interactive approach not only caters to individual queries but also improves the system’s responsiveness and user satisfaction.

Unity Integration for Avatar Responses

To cater to different preferences, SignGuide integrates Unity to present answers via avatars in sign language. Users can choose to receive responses through avatars instead of videos. This feature is activated through the settings, allowing users to see an animated avatar signing the answer, enhancing the visual appeal and engagement of the experience.

Robust Backend Services with Google Firebase

The backend infrastructure of SignGuide is powered by Google Firebase, offering a suite of tools that enhance the application’s performance and reliability. Firebase Realtime Database provides secure, real-time data access, ensuring that the application remains responsive even offline. Firebase Hosting facilitates seamless updates and previews, while Firebase Crashlytics and Google Analytics for Firebase offer critical insights into app performance and user interactions, helping developers continuously improve the application.

Conclusion: A Leap Towards Inclusive Cultural Experiences

The SignGuide project stands as a testament to the power of technology in bridging accessibility gaps. By addressing the unique needs of deaf visitors, it not only enhances their museum experience but also promotes broader social integration. As SignGuide continues to evolve, it promises to set a new standard for inclusivity in cultural institutions, aligning with European accessibility mandates and paving the way for similar innovations globally. This journey from research to reality underscores the importance of inclusive design and the transformative potential of technology in enriching cultural engagement for all.

Comments are closed.