An  AI Chatbot for Personalized Music Recommendations Based on User Emotions

Rula M Ali Farkash; Tengku Zatul Hidayah Tengku Petra

doi:10.24191/jcrinn.v9i1.427

An AI Chatbot for Personalized Music Recommendations Based on User Emotions

Authors

Rula M Ali Farkash IT Department, SWIFT Support Services Malaysia Sdn. Bhd., Bangsar South City, Kuala Lumpur, Malaysia
Tengku Zatul Hidayah Tengku Petra School of Computing, College of Computing, Informatics and Mathematics, Universiti Teknologi MARA, Shah Alam, Malaysia

DOI:

https://doi.org/10.24191/jcrinn.v9i1.427

Keywords:

AI Chatbot, Deep Learning, IBM Watson, Natural Language Processing

Abstract

Most music recommendation systems use data from users' preferences to suggest songs. Popular songs, which have more data, are usually recommended more often, possibly leaving out newer or less popular music. Thus, this study aims to apply machine learning algorithms, such as Deep Learning and Natural Language Processing, to train an AI Chatbot to recommend personalized songs based on user emotions. Firstly, deep learning is employed to predict the mood of individual songs. Subsequently, a new dataset is created based on the predicted mood of each song, which can later be fed into the chatbot to enhance its ability to make song recommendations. Next, the chatbot's intents are defined and integrated into a feed-forward neural network. User messages are analyzed using IBM Watson's natural language analysis function, which returns a sentiment score indicating either a positive, negative, or neutral sentiment. Finally, the chatbot generates a song recommendation from the dataset based on the user's sentiment score and favorite music genre. In this study, two neural network models are developed: one for predicting song moods and the other for training the chatbot. The accuracy results demonstrate that both models achieve high accuracy, scoring 80.4% for predicting song moods and 90% for training the chatbot. These results show that the models are learning effectively and can successfully recommend music based on user emotions.

Downloads

Download data is not yet available.

References

Arjmand, H. A., Hohagen, J., Paton, B., & Rickard, N. S. (2017). Emotional responses to music: Shifts in frontal brain asymmetry mark periods of musical change. Frontiers in psychology, 8, 2044.

Aslam, N., Rustam, F., Lee, E., Washington, P. B., & Ashraf, I. (2022). Sentiment analysis and emotion detection on cryptocurrency related tweets using ensemble LSTM-GRU model. IEEE Access, 10, 39313-39324.

Bhagwat, V. A. (2018). Deep learning for chatbots [Master’s Project, San Jose State University]. https://doi.org/10.31979/etd.9hrt-u93z

Bhashkar, K., (2018). Conversational AI chatbot using Rasa NLU & Rasa Core: How Dialogue Handling with Rasa Core can use LSTM by using Supervised and Reinforcement Learning Algorithm. Medium. Retrieved from, https://bhashkarkunal.medium.com/conversational-ai-chatbot-using-rasa-nlu-rasa-core-how-dialogue-handling-with-rasa-core-can-use-331e7024f733

Bhatnagar, P., Sachan, A., & Pal, N., (2023). Impact of listening to classical instrumental music on cholesterol levels in Indian medical students. Int J Acad Med Pharm, 5(1), 357-359.

Blood, A. J., Zatorre, R. J., Bermudez, P., & Evans, A. C. (1999). Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nature Neuroscience, 2(4), 382-387.

Bocklisch, T., Faulkner, J., Pawlowski, N., & Nichol, A. (2017). Rasa: Open Source Language Understanding and Dialogue Management. ArXiv. abs/1712.05181.

Davidson, R. J. (1992). Anterior cerebral asymmetry and the nature of emotion. Brain and Cognition, 20(1), 125-151.

Davidson, R. J. (1998). Affective style and affective disorders: Perspectives from affective neuroscience. Cognition & Emotion, 12(3), 307-330.

Dieleman, S. (2014). Recommending music on Spotify with deep learning. Published Aug, 5.

Diener, E., Sandvik, E., Pavot, W., Strack, F., Argyle, M., & Schwarz, N. (1991). Subjective well-being: An interdisciplinary perspective. International Series in Experimental Social Psychology, 21, 119-139.

Grant, B. J., (2018). How current mood state influences song selection behaviors [Doctoral Dissertation, University of Alabama]. University of Alabama Libraries.

Greenberg, D. M., Kosinski, M., Stillwell, D. J., Monteiro, B. L., Levitin, D. J., & Rentfrow, P. J. (2016). The song is you: Preferences for musical attribute dimensions reflect personality. Social Psychological & Personality Science, 7, 597– 605.

Greenberg, D. M., & Rentfrow, P. J. (2017). Music and big data: A new frontier. Current Opinion in Behavioral Sciences, 18, 50 –56.

Greenberg, D., Matz, S., Schwartz, H. and Fricke, K., (2021). The self-congruity effect of music. Journal of Personality and Social Psychology, 121(1), 137-150.

Haryadi, D., & Kusuma, G. P. (2019). Emotion detection in text using nested long short-term memory. International Journal of Advanced Computer Science and Applications, 10(6), 351-357.

Kosinski, M., Matz, S. C., Gosling, S. D., Popov, V., & Stillwell, D. (2015). Facebook as a research tool for the social sciences: Opportunities, challenges, ethical considerations, and practical guidelines. American Psychologist, 70, 543–556.

Park, G., Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Kosinski, M., Stillwell, D. J., Seligman, M. E. P. (2015). Automatic personality assessment through social media language. Journal of Personality and Social Psychology, 108, 934 –952.

Porcaro, L., Gómez, E., & Castillo, C. (2022). Perceptions of diversity in electronic music: The impact of listener, artist, and track characteristics. In Proceedings of the ACM on Human-Computer Interaction, 6(CSCW1) (pp. 1-26). ACM Digital Library. https://doi.org/10.1145/3512956

Sánchez-Moreno, D., González, A. B. G., Vicente, M. D. M., Batista, V. F. L., & García, M. N. M. (2016). A collaborative filtering method for music recommendation using playing coefficients for artists and users. Expert Systems with Applications, 66, 234-244.

Sheng, Q. Z., Zhang, W. E., Hamad, S. A., Khoa, N. L. D., & Tran, N. H. (2022). Deep Conversational Recommender Systems: Challenges and Opportunities. Computer, 55(4), 30-39.