Sea, Senses and Melody: Encouraging Emotional Expression and Connection to the Campus Environment through Interacting with a Site-Specific Agent

Sea, Senses and Melody: Encouraging Emotional Expression and Connection to the Campus Environment through Interacting with a Site-Specific Agent
This project proposes an interactive audio-visual art installation at HKUST that fosters emotional well-being and environmental awareness. By leveraging real-time data from the campus's natural surroundings (e.g., sea, sky, humidity), the installation creates a virtual ecosystem where users can express emotions anonymously through text, receiving abstract musical and visual feedback.
What is the problem this project is trying to address?
-
Emotional Well-being: Students often lack safe, anonymous spaces to express emotions, as seen in popular but insecure "Tree Hole" platforms.
-
Environmental Disconnection: Campus inhabitants may overlook the natural environment despite its proximity (e.g., the sea), missing opportunities for ecological engagement.
-
Art-Tech Integration: Limited creative platforms bridge environmental data with human emotions in a tangible, interactive manner.
How does this project support our sustainable smart campus as a living lab vision?
-
Smart: Uses IoT sensors, AI (LLM), and real-time data processing to create dynamic, interactive art, showcasing cutting-edge technology.
-
Sustainable: Encourages mindfulness and nature appreciation, fostering long-term ecological awareness.
-
Living Lab: Pilots a scalable framework for site-specific, data-driven art that can expand to other campus or urban locations.
What's next?
The project team is building the first full experience is currently underway and finalizing the physical installation on the atrium balcony, crafting the AI-powered sea spirit, and designing the immersive visuals and sound are the key focuses at this stage. Soon, passersby on campus will be able to scan a QR code and engage in a poetic, musical exchange with the sea. The initial version will be launched later this year be followed by hosting interactive workshops, staging exhibitions, and inviting the community to participate as co-creators. This marks just the beginning of transforming emotional expression into a shared, living artwork.