Team

This is the audio, music, affective computing and AI team (AMAAI). For my team at SUTD Game Lab, please see here.

Principal Investigator

Prof. Dorien Herremans

large_507px-Placeholder_male_superhero_c.png
Dorien Herremans is an Assistant Professor at Singapore University of Technology and Design, and has a joint-appointment at the Insitute of High Performance Computing, A*STAR. She also works as a certified instructor for the NVIDIA Deep Learning Institute and is director of SUTD Game Lab. Before going to SUTD, she was a Marie Sklodowska-Curie Postdoctoral Fellow at the Centre for Digital Music at Queen Mary University of London. She received her Ph.D. in Applied Economics on the topic of Computer Generation and Classification of Music through Operations Research Methods. She graduated as a commercial engineer in management information systems at the University of Antwerp in 2005. After that, she worked as a Drupal consultant and was an IT lecturer at the Les Roches University in Bluche, Switzerland. She also worked as a mandaatassistent at the University of Antwerp, in the domain of operations management, supply chain management and operations research. Dr. Herremans' research interests include machine learning and music for automatic music generation, data mining for music classification (hit prediction) and novel applications in the intersections of machine learning/optimization and music.

Postdoctoral fellows

Dr. Balamurali BT

large_507px-Placeholder_male_superhero_c.png
Balu received his PhD at the University of Auckland, New Zealand. He has been using machine learning techniques to solve a variety of problems such as automatic speech/speaker recognition, spoofed-speech detection, blacklisted speaker identification, blind source separation, music classification, bio-signal processing, detection and classification, fluid flow classification, fruit ripeness detection etc.

Dr. Hossein Mousavi

large_507px-Placeholder_male_superhero_c.png
Hossein is postdoctoral research fellow research at the Singapore University of Technology and Design under the Supervision of Dr. Dorien Herremans and Dr. Gemma Roig. His research lies at the intersection of machine learning, computer vision, and music/audio processing with an emphasis on learning Deep Neural Networks with minimal supervision and multi-modal data. Before that, he was a postdoctoral research fellow in the computer engineering department at the Polytechnique Montreal, on the project of wing deformation measurement during flight with the 3D motion model with Bombardier Company and received a Ph.D. in Computer Science at the Italian Institute of Technology where He was advised by Professor Alessandro Perina and Professor Vittorio Murino. His work is primarily focused on the fields of Computer Vision and Deep learning for the task of human behaviour understanding in videos and Image segmentation.

PhD students

Yin-Jyun Luo

large_507px-Placeholder_male_superhero_c.png Yin-Jyun Luo is a Ph.D student at Singapore University of Technology and Design, under the supervision of Professor Dorien Herremans and Dr. Kat Agres. He was a research assistant in the Music and Culture Technology Lab lead by Dr. Li Su in Institute of Information Science, Academia Sinica, Taiwan. He received an Master of Science in Music Technology, National Chiao Tung University, Taiwan. Yin-Jyun’s is currently working on representation learning of music and audio using deep learning.

Cheuk Kin Wai (Raven)

Pineapple
Kin Wai Cheuk is a Ph.D candidate at Singapore University of Technology and Design, under the supervision of Professor Dorien Herremans and Dr. Kat Agres. He received both his Bachler of Science in Physics (Minor in Music) and Master of Philosophy in Mechanical Engineering in The University of Hong Kong. His research interest is neural network based music composition. -- Website

Yanzhao Zou

PineappleYanzhao is a Ph.D candidate in Singapore university of technology and design (SUTD), under the supervision of Professor Dorien Herremans and Professor Gemma Roig. He graduated from SUTD in 2015 and received his B. Eng in Engineering Systems and Design. Currently he is exploring affective computing topics.

En Yan Koh

Pineapple
Koh En Yan is currently a Ph.D. student in Singapore University of Technology and Design (SUTD), under the supervision of Assistant Professor Dorien Herremans. She received her Bachelor of Engineering in SUTD, under the Information Systems Technology and Design (ISTD) pillar in 2016. Her research interests lie in audio, or more specifically, in speech and music. Currently she is exploring the topic of lyrics to audio alignment.

Abigail Leon

large_507px-Placeholder_male_superhero_c.png
Abigail Lee-Leon is currently a PhD student in Singapore University of Technology and Design (SUTD), under the supervision of Associate Professor Yuen Chau and Assistant Professor Dorien Herremans. She received his Bachelor of Engineering in SUTD, majoring in Engineering Product Development (EPD) in 2016. Her research interest lies in the area of machine learning and how machine learning can be applied to solve problems in the field of underwater communications.

Jacob Chen

large_507px-Placeholder_male_superhero_c.png
Jacob Chen is a Ph.D candidate in Singapore university of technology and design (SUTD), under the supervision of Professor Dorien Herremans and Professor Chen Jer-Ming. He received his B. Eng in Information Systems Technology and Design from SUTD. He is currently working on machine learning and acoustic reproduction, and is passionate in incorporating mixed reality technology into his research.

Yeo Sue-Mae

large_507px-Placeholder_male_superhero_c.png
Sue-Mae is currently a PhD student in Singapore University of Technology and Design (SUTD), under the supervision of Associate Professor Ngai-Man Cheung and Assistant Professor Dorien Herremans. She received BSc in Information Systems Management in 2009 and MS of Information Technology in Business – Analytics in 2015 from Singapore Management University. Her research interest lies in the area of cognitive computing to improve healthcare such as dementia care.

MSc students

Fajilatun Nahar

large_507px-Placeholder_male_superhero_c.png
Fajilatun is currently a Master’s Student in Singapore University of Technology and Design (SUTD), under the supervision of Assistant Professor Dorien Herremans. She received her BSc in Computer Science and Engineering from North South University, Bangladesh. She had 3 plus years of software application development experience in the industry before pursuing her Master’s studies. Currently, she is exploring Music Information Retrieval and Machine Learning topics. She is also interested to combine her software development skills into her research.

Research Assistants

Hao Hao Tan

large_507px-Placeholder_male_superhero_c.png
Hao Hao is a research assistant at Singapore University of Technology of Design, supervised by Professor Gemma Roig, Professor Dorien Herremans, and Dr. Kat Agres. He received a Bachelor of Engineering in Computer Science from Nanyang Technological University, Singapore. Hao Hao is currently working on music generation based on video content and perceived emotion. Website.

Jiahui Huang

large_507px-Placeholder_male_superhero_c.png
Jiahui is a research assistant at Singapore University of Technology of Design, from where he received a Bachelor of Engineering in Computer Science. Supervised by Professor Gemma Roig, Professor Dorien Herremans, Jiahui is currently working on projects related to Convolutional Neural Network (CNN) architecture design and image reanimation using GANs.

Monica Kumaran

large_507px-Placeholder_male_superhero_c.png
Monica is a research assistant at Singapore University of Technology of Design, under the supervision of Professor Gemma Roig, Professor Dorien Herremans, and Dr. Kat Agres. She received a Bachelor of Science in Electrical Engineering and Computer Sciences from the University of California at Berkeley. Currently she is curious about ways to codify emotion evoked by music and video and is exploring user interface design and machine learning. Website.

Interns / visiting PhD students

Peilun Dai

Pineapple
Peilun is a Ph.D. student in computer science at Boston University, supervised by Prof Peter Chin. He obtained his bachelor's degree in electrical and electronic engineering from Nanyang Technological University, Singapore, working with Prof WANG Gang (now at Alibaba) for his final year project, and master's degree in brain and cognitive sciences from MIT, supervised by Prof Ed Boyden. He is interested in time-series signal processing, machine learning, deep learning and their applications to affective computing. During his time at SUTD, he has been working on emotion recognition for music using deep learning models. Website.

Lizzie Wilson

Pineapple
Lizzie Wilson is a visiting PhD student as part of the Centre for Digital Music and Media & Arts Technology programme at Queen Mary University of London. Her research looks at interactive systems for human-machine collaboration with a particular focus on affective computing strategies and the role of affective response in music generation and computational creativity algorithms. Github link.

Lena Heng

Pineapple
Lena is currently an interdisciplinary PhD student in the Music Perception and Cognition Lab at McGill University, under the supervision of Prof. Stephen McAdams. Their research interests are in the area of timbre perception, music hermeneutics, cognitive representation, and emotion perception in music. As a professional performer in a contemporary Chinese chamber music ensemble (Ding Yi Music Company), and a part-time lecturer in the Nanyang Academy of Fine Arts, they are particularly keen on integrating their research interests with performance. Their work on this aspect has earned them the Research Alive award from McGill Schulich School of Music in 2018/19.
Conference presentations: SMPC 2019; ICTM 2015.

Book chapters: 'Singaporean Performance’ in Singapore’s Chinese orchestral practice: What is it? Where is it? (in print); Negotiating a Sound: Ding Yi Music Company and Contemporary Chinese Chamber Ensembles (in print).

Rui Guo

Pineapple
Rui Guo is a music PhD student from university of Sussex, UK. His research focuses on music generation using deep learning. During his visit to the AMAAI lab he is developing a generation model with tension. He likes to play piano in free time.
Website.

Graduated PhD student

Natalie Angus

Pineapple
Natalie is a PhD candidate in Singapore University of Technology and Design (SUTD). She graduated from SUTD in 2015 and received her B. Eng in Information Systems (Robotics). Her research interest includes psyhoacoustics, audio information retrieval, and room acoustic simulations. She also enjoys teaching undergraduate courses involving machine learning algorithms and audio signal processing. Her current work is focused on developing new and fast geometrical acoustic algorithms for binaural room simulations. In particular, methods that minimise computational cost while maintaining perceptual plausibility. Suitable areas for application include music and film production, virtual reality, and gaming.

Former members

Dr. David Grunberg

large_507px-Placeholder_male_superhero_c.png
David Grunberg is currently a postdoctoral research fellow at the Singapore University of Technology and Design (SUTD). He received his PhD from Drexel University in the United States of America, majoring in Electrical Engineering, and with his dissertation focused on the subject of identifying musical beats in noisy audio. His research interests are on the topic of Music-Information Retrieval, and he is especially interested in how algorithms and systems from that field can be used to obtain practical outcomes in real-world situations.

SUTD UROP student collaborators

  • Andre Hadianto Lesmana
  • Kenny Soh Chi Tong
  • Tan Li Yang
  • Zhou Enna
  • Zhou Xuexuan
  • Ler Yi Xiang Wesley
  • Nicholas Chan Zhi Wei
  • Sharan Sunil Pillai
  • Wu Xiaomeng
  • Lam Yao Sheng Isaac Marcus