About the project
This project explores how computer vision and audio analysis can work in synergy to create new technologies. In particular, it focuses on audio-visual artificial intelligence (AVAI), which can be implemented in ultra-low power devices, including wearables, hearing aids and sensors. AVAI is crucial in a range of applications, from advanced hearing aid design to understanding scenes in urban and natural environments.
Hearing assistive devices, such as hearing aids, have traditionally been developed for populations of deaf and hard of hearing communities. The ubiquitous use of in-ear technology and recent advances in edge computing are reformulating what drives research and development in this domain. One of the challenges for AVAI relates to the synchronization of different modalities. Multimodal hearing technologies offer an opportunity to overcome the primary issue of traditional wearables, which cannot localize or focus sound enhancement capabilities based on the user's immediate needs in their environment.
In this PhD project, you will explore various angles of AVAI ranging from algorithmic development, explainability, socio-technical issues like privacy, and user testing and interaction. You will also benefit from working in Electronics and Computer Science and the Institute for Sound and Vibration Research and engaging directly with an industry supervisor (based at Bose Corporation, in Boston USA). With that comes additional opportunities for industry internships that can help you gain professional experience.
This project is funded through the UKRI MINDS Centre for Doctoral Training. This is one of 16 PhD training centres in the UK with a unique focus on advancing AI techniques in the context of real-world engineered systems. Its remit spans novel hardware for AI, AI and machine learning, pervasive systems and Internet of Things, and human-AI collaboration. We provide enhanced cross-disciplinary training in electronics and AI, entrepreneurship, responsible research and innovation, communication strategies, outreach and impact development as part of an integrated 4-year iPhD programme.
