Research

My research spans human-computer interaction, creative coding, and interactive installations. Exploring the intersection of technology and art to create meaningful and inspiring experiences.

Cover image for Interactive Music Visualization: A Multimodal Approach to Sound Art
Music VisualizationCreative CodingHuman-Computer Interaction

Interactive Music Visualization: A Multimodal Approach to Sound Art

Zhang Shumeng, Wei Chen, Lin Hua

ACM CHI Conference on Human Factors in Computing Systems

2024Best Paper Honorable Mention

This paper presents a novel approach to interactive music visualization that combines audio analysis with real-time graphics rendering. We introduce a framework that enables artists to create dynamic visual representations of music without extensive programming knowledge.

Cover image for Embodied Interaction in Immersive Art Installations
Immersive ArtEmbodied CognitionInstallation Art

Embodied Interaction in Immersive Art Installations

Zhang Shumeng, Maria Garcia

Leonardo - The Journal of the International Society for Arts, Sciences and Technology

2024

We explore how embodied interaction design principles can enhance viewer engagement in immersive art installations. Through case studies and user research, we identify key factors that contribute to meaningful embodied experiences.

Cover image for Generative Art Systems: Balancing Control and Autonomy
Generative ArtCreative AIComputational Creativity

Generative Art Systems: Balancing Control and Autonomy

Zhang Shumeng

International Conference on Computational Creativity

2023

This research examines the relationship between artist control and system autonomy in generative art creation. We propose a framework for designing generative systems that maintain artist intent while allowing for emergent outcomes.

Cover image for Tangible Interfaces for Musical Expression: Design Guidelines
Tangible InteractionMusical InstrumentsPhysical Computing

Tangible Interfaces for Musical Expression: Design Guidelines

Zhang Shumeng, Jun Li, Sarah Kim

ACM Transactions on Computer-Human Interaction

2023

We present a set of design guidelines for creating tangible interfaces that support natural musical expression. Based on a systematic review of existing systems and expert interviews, our guidelines address physical form, interaction modalities, and feedback mechanisms.

Cover image for Data-Driven Storytelling in Interactive Exhibits
Data VisualizationMuseumsNarrative Design

Data-Driven Storytelling in Interactive Exhibits

Zhang Shumeng, Chen Wei

Museums and the Web Conference

2022

This paper investigates how data visualization techniques can enhance storytelling in museum exhibits. We present case studies from three major science museums and discuss the challenges and opportunities of data-driven narrative design.

Cover image for Accessibility in Digital Art: A Framework for Inclusive Design
AccessibilityInclusive DesignDigital Art

Accessibility in Digital Art: A Framework for Inclusive Design

Zhang Shumeng

ACM SIGACCESS Computing and Accessibility

2022

We propose a comprehensive framework for making digital art accessible to people with diverse abilities. Our framework addresses sensory, cognitive, and physical accessibility while maintaining artistic integrity.

Cover image for The Role of Sound in Augmented Reality Experiences
Augmented RealitySpatial AudioImmersive Experience

The Role of Sound in Augmented Reality Experiences

Zhang Shumeng, Liu Yang, Emily Brown

IEEE Symposium on Mixed and Augmented Reality

2021

This research investigates the role of spatial audio in creating compelling augmented reality experiences. Through user studies, we demonstrate how carefully designed soundscapes can significantly enhance presence and engagement.

Cover image for Prototyping Tools for Physical Computing: A Comparative Study
Physical ComputingPrototypingTools for Design

Prototyping Tools for Physical Computing: A Comparative Study

Zhang Shumeng, David Lee

ACM DIS Conference on Designing Interactive Systems

2021

We conduct a comparative study of popular prototyping tools for physical computing projects. Our analysis covers tool capabilities, learning curves, and suitability for different project types and user skill levels.


8 publications