About the project
This project explores the development of a Multimodal Large Language Model that empowers robots to understand and respond to humans through vision, language, and other sensory data. By enabling natural, adaptive, and context-aware communication, the research advances the next generation of intelligent, human-centered robotic systems.
Robots are increasingly being integrated into various aspects of daily life, including education, healthcare, workplaces, and personal settings. These practical applications require that robots collaborate effectively with humans in shared environments to enhance human capabilities, prioritize human needs, and seamlessly fit into everyday contexts This project aims to develop a
Multimodal Large Language Model framework that enables robots to interpret interaction contexts from multiple modalities, such as vision, language, audio, and other sensory data, and to engage users through diverse communication channels, including actions, speech, and visual outputs. The framework will allow robots to perceive multimodal signals collected from both the environment and human users during everyday interactions, build a deep contextual understanding, and respond appropriately across different modalities to achieve natural, adaptive, and human-centered interaction.
You will have the opportunity to collaborate with other researchers in the following areas:
You'll contribute to high-impact journals and conferences. You will have access to high-performance computers and a range of robot platforms to support your research.
The School of Electronics & Computer Science is committed to promoting equality, diversity inclusivity as demonstrated by our Athena SWAN award. We welcome all applicants regardless of their gender, ethnicity, disability, sexual orientation or age, and will give full consideration to applicants seeking flexible working patterns and those who have taken a career break. The University has a generous maternity policy, onsite childcare facilities, and offers a range of benefits to help ensure employees’ well-being and work-life balance. The University of Southampton is committed to sustainability and has been awarded the Platinum EcoAward.
