HKUST (Guangzhou)
MPhil · Data Science and Analytics (expected)
MPhil student · HKUST (Guangzhou)
Jiangshan He何姜杉
I work on multimodal retrieval, generative models, and the evaluation of language models. Currently, I am exploring video-to-music generation.
Data Science and Analytics · Expected graduation: August 2027
Education & Experience
HKUST (Guangzhou)
Research Assistant · LLM and multimodal evaluation
The Hong Kong Polytechnic University
Research Assistant · PolySmart Group
Projects
All projects ↗Video-to-music generation
Exploring how video content can guide music generation, with an interest in extending the approach to longer videos.
Ongoing research
Project details ↗
TRECVID 2023 · Ad-hoc Video Search
Combining vision-language models, diffusion-generated image queries, and relevance feedback for ad-hoc video search.
1st · Both AVS tracks
Project details ↗
QIVISE · Interactive Video Search
An interactive video search engine that brings multimodal embeddings and quantum-inspired relevance feedback into a working system.
VBS 2023 · Best Newcomer
Project details ↗
Selected Publications
All publications ↗First- and co-first-author work
Other selected conference papers
Awards
1st Place · TRECVID 2023
Automatic & interactive AVS tracks · Team award
Best Newcomer · Video Browser Showdown
QIVISE · Team award
Meritorious Winner · Mathematical Contest in Modeling
Mathematical Contest in Modeling (MCM)