Session: CIE–31: Graduate Student Poster Symposium

Paper Number: 148487

148487 - Harmonizing Ai and Humans in Manufacturing: Exploring the Potential of Music as a Medium for Communication 

Overview

Motivation

This work addresses the challenge of enhancing human-agent cooperation in AI-driven manufacturing environments. It explores how musical nudges can influence human behavior and performance, an important issue as industries explore to integrate more AI tools. The need for this research stems from ongoing challenges in achieving seamless human-AI collaboration, which remains limited by issues in communication and trust.

State of the Art

In the smart manufacturing field, integrating AI effectively remains a challenge due to limitations in human-AI communication. Recent studies in human-AI interaction have primarily focused on visual and textual communication methods, with auditory signals, particularly music, remaining underexplored despite their potential. Research in workplace environments demonstrates that music significantly affects mood and cognitive performance, influencing productivity and error rates [1]. Additionally, the field of digital nudging has seen extensive use of non-auditory methods; however, the application of music as a nudge in industrial settings is still in its infancy.  Current efforts in similar domains typically utilize visual or textual cues to guide human interactions with AI [2]. These methods, while useful, do not engage the affective dimensions of human cognition which can significantly enhance interaction dynamics.

Intellectual Merit

The research focuses on how auditory cues, specifically music, can enhance cognitive and emotional responses to AI interactions. It raises questions about the specific elements of musical nudges that most effectively improve manufacturing performance and emotional well-being in industrial settings.

Broader Impact

Upon completion, this research could revolutionize approaches to AI integration in workplaces by demonstrating the utility of sound-based nudges. It could influence a broad spectrum of industries, making AI tools more effective and improving workplace satisfaction and productivity.

Research Plan

The project employs a mixed-methods approach, combining experimental psychology with industrial engineering to investigate the effects of music on human-AI interaction. Expected architecture involves IoT-enabled manufacturing settings equipped with AI systems that deliver musical nudges.

How will you validate your research?

Validation will occur through controlled experiments measuring task performance and emotional responses, comparing the efficacy of different nudge types.

What is the timeline that you anticipate?

The research is planned to span 24 months, starting with a pilot study and followed by iterative testing and refinement phases.

Conclusions

Anticipated results include validated strategies for effective human-AI cooperation using musical nudges, with significant implications for smart manufacturing practices.

References

[1]          K. Landay and P. Harms, "Whistle while you work? A review of the effects of music in the workplace," Human Resource Management Review, vol. 29, no. 3, pp. 371-385, 2019.

[2]          X. Yang, A. Lim, A. Nicolaides, and B. Morkos, "Towards the Understanding of Nudging Strategies in Cyber-Physical-Social System In Manufacturing Environments," in International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 2022, vol. 86236: American Society of Mechanical Engineers, p. V03BT03A011.

 

Presenting Author: Fatemeh Mozaffar University of Georgia

Presenting Author Biography: Fatemeh Mozaffar is a Ph.D. candidate in Mechanical Engineering at the University of Georgia and works as a researcher at the MODEL Group Lab under the supervision of Dr. Morkos. She completed her undergraduate degree in Mechanical Engineering from Sharif University of Technology in 2022. She also worked on designing the exoskeleton glove for the pianist’s hand as her undergraduate thesis, and for her Ph.D. research, she focuses on the impact of music in manufacturing and how it can improve human-AI collaboration. Her doctoral studies involve exploring the potential of music to enhance collaboration between human workers and AI systems in manufacturing environments. Fatemeh won the NSF/ASME student design essay competition for two consecutive years, 2022-2023. Moreover, besides her professional life, she enjoys playing guitar, writing, and doing calligraphy.

Authors:

Fatemeh Mozaffar University of Georgia