Hi! I am a second-year PhD student in the Natural Language Processing (NLP) group at the University of Washington (UW), advised by Prof. Mari Ostendorf and Noah A. Smith. My primary interestes are Natural Language Processing and Multimodal Machine Learning (e.g. text, speech, image, code).

Previously, I graduated from the University of Chicago with B.S. in Mathematics, Computer Science, and Economics in 2021, where I was fortunate to be advised by Prof. Karen Livescu at Toyota Technological Institute at Chicago (TTIC), working on self-supervised learning of speech.

Before focusing on NLP and ML, I also helped applying computational methods in physics. I worked with Dr. Saidur Bakaul at Argonne National Laboratory and Prof. Chuangang Ning at Tsinghua University.

Publications

Most recent publications on Google Scholar
* indicates equal contribution

PromptCap: Prompt-Guided Task-Aware Image Captioning
Yushi Hu*, Hang Hua*, Zhengyuan Yang, Weijia Shi, Noah A Smith, Jiebo Luo
preprint 2022
[paper]

Binding Language Models in Symbolic Languages
Zhoujun Cheng*, Tianbao Xie*, Peng Shi, Chengzu Li, Rahul Nadkarni, Yushi Hu, Caiming Xiong, Dragomir Radev, Mari Ostendorf, Luke Zettlemoyer, Noah A Smith, Tao Yu
preprint 2022
[paper][demo]

Unsupervised Learning of Hierarchical Conversation Structure
Bo-Ru Lu, Yushi Hu, Hao Cheng, Noah A. Smith, Mari Ostendorf
Findings of EMNLP 2022
[paper]

In-Context Learning for Few-Shot Dialogue State Tracking
Yushi Hu, Chia-Hsuan Lee, Tianbao Xie, Tao Yu, Noah A. Smith, Mari Ostendorf
Findings of EMNLP 2022
[paper] [code] [bibtex]

Acoustic Span Embeddings for Multilingual Query-by-Example Search
Yushi Hu, Shane Settle, Karen Livescu
IEEE Spoken Language Technology Workshop (SLT 2021)
[paper] [code] [bibtex] [slides]

Multilingual Jointly Trained Acoustic and Written Word Embeddings
Yushi Hu, Shane Settle, Karen Livescu
InterSpeech 2020
[paper] [code] [bibtex] [slides] [video] [demo]

Freestanding Ferroelectric Bubble Domains
Saidur R Bakaul, Sergei Prokhorenko, Qi Zhang, Yousra Nahas, Yushi Hu, Amanda Petford-Long, Laurent Bellaiche, Nagarajan Valanoor
Advanced Materials, 2021
[paper]

Work Experience


  • Research Intern, Tencent AI Lab (Seattle), Bellevue, WA, summer 2022
  • Research Assistant, Toyota Technological Institute at Chicago, Chicago, IL, 2019 - 2021
  • Machine Learning Engineer Intern, Learnable.ai, Boston, MA, summer 2019
  • Research Intern, Argonne National Laboratory, Lemont, IL, summer 2018