2023年1月20日 · By evaluating on a number of benchmark test sets, we find that ChatGPT performs competitively with commercial translation products (e.g., Google Translate) on high-resource European languages but lags behind significantly on low-resource or distant languages.

2023年4月5日 · View a PDF of the paper titled ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedback, by Wenxiang Jiao and 7 other authors

2025年3月17日 · Therefore, we propose ParroT, a framework to enhance and regulate the translation abilities during chat based on open-source LLMs (e.g., LLaMA), human-written translation and feedback data.

Evaluating LLMs’ Emotional Alignments with Humans. Wenxuan Wang, Wenxiang Jiao, Yongchang Hao, Xing Wang, Shuming Shi, Zhaopeng ... J Huang, EJ Li, MH Lam, T Liang, W Wang, Y Yuan, W Jiao**, X...

I am a Postdoc in the Center for Language and Speech Processing (CLSP) at Johns Hopkins University (JHU), working with Prof. Mark Dredze. My research interest lies in evaluating single LLMs as individuals and multiple LLMs as a collective (multi …

End-to-end sign language translation (SLT) aims to convert sign language videos into spoken language texts directly without intermediate representations. It has been a challenging task due to the...

Measuring the Social Bias in Image Generation Models. T Liang, Z He, J Huang, W Wang, W Jiao, R Wang, Y Yang, Z Tu, S Shi, ...

By evaluating on a number of benchmark test sets, we find that ChatGPT performs competitively with commercial translation products (e.g., Google Translate) on high-resource European languages but lags behind significantly on low-resource or distant languages.

translation (Jiao et al.,2023). Consequently, they represent a significant stride toward the realization of artificial general intelligence (AGI). Machine translation, a quintessential NLP task, faces both challenges and opportunities presented by the emergence of LLMs. Traditional machine translation encompasses several sub-tasks (Farhad

6 天之前 · Our study aims to determine the reliability of applying personality assessments to LLMs, explicitly investigating whether LLMs demonstrate consistent personality traits.