Home | Yining Hong

About Me

I am currently a fourth-year PhD student in computer science at UCLA. I'm co-advised by Prof. Chuang Gan from MIT-IBM Watson AI Lab, Prof. Song-Chun Zhu and Prof. Ying Nian Wu from UCLA. Previously, I was an undergraduate in the Department of Electrical Engineering in Shanghai Jiao Tong University, advised by Prof. Xinbing Wang and Prof. Weinan Zhang.

My main focus lies in 3D reasoning, especially about the perspectives that go beyond pattern recognition in 2D images and need to be reasoned in the 3D space, including physics, functionality etc. I'm also interested in concept learning and structure learning, which are crucial aspects of visual reasoning in the 3D space.

Publications

Yining Hong; Haoyu Zhen; Peihao Chen; Shuhong Zheng, Yilun Du, Zhenfang Chen, Chuang Gan, "3D-LLM: Injecting the 3D World into Large Language Models", NeurIPS2023 (Spotlight)

Yining Hong; Chunru Lin; Yilun Du; Zhenfang Chen; Joshua B. Tenenbaum; Chuang Gan, "3D Concept Learning and Reasoning from Multi-View Images", CVPR2023

Zhenfang Chen, Qinhong Zhou, Yikang Shen, Yining Hongstrong, Hao Zhang, Chuang Gan, See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning, arxiv 2023

Qing Li; Siyuan Huang; Yining Hong; Yixin Zhu; Ying Nian Wu; Song-Chun Zhu, "A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and Semantics", ICLR2023

Yining Hong; Yilun Du; Chunru Lin; Joshua Tenenbaum; Chuang Gan, "3D Concept Grounding on Neural Fields", NeurIPS2022

Yining Hong; Kaichun Mo; Li Yi; Leonidas Guibas; Antonio Torralba; Joshua Tenenbaum; Chuang Gan, "Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction", CVPR2022

Yining Hong; Li Yi; Joshua B. Tenenbaum; Antonio Torralba; Chuang Gan, "PTR: A Benchmark for Part-based Conceptual, Relational, and Physical Reasoning", NeurIPS2021

Yining Hong; Qing Li; Song-Chun Zhu; Siyuan Huang, "VLGrammar: Grounded Grammar Induction of Vision and Language", ICCV2021

Yining Hong; Qing Li; Daniel Ciao; Siyuan Huang; Song-Chun Zhu, "Learning by Fixing: Solving Math Word Problems with Weak Supervision", AAAI2021

Yining Hong; Qing Li; Ran Gong; Daniel Ciao; Siyuan Huang; Song-Chun Zhu, "SMART: A Situation Model for Algebra Story Problems via Attributed Grammar", AAAI2021

Qing Li; Siyuan Huang; Yining Hong; Yixin Zhu; Ying Nian Wu; Song-Chun Zhu, "A HINT from Arithmetic: On Systematic Generalization of Perception, Syntax, and Semantics", ICLR 2021 The Role of Mathematical Reasoning in General Artificial Intelligence Workshop

Jinghui Qin; Xiaodan Liang; Yining Hong; Jianheng Tang; Liang Lin, "Neural-Symbolic Solver for Math Word Problems with Auxiliary Tasks", ACL2021

Qing Li; Siyuan Huang; Yining Hong; Song-Chun Zhu, "A Competence-aware Curriculum for Visual Concepts Learning via Question Answering", ECCV2020

Qing Li; Siyuan Huang; Yining Hong; Yixin Chen; Yingnian Wu; Song-Chun Zhu, "Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning", ICML2020

Yining Hong; Jialu Wang; Yuting Jia; Weinan Zhang; Xinbing Wang, "Academic Reader: An Interactive Question Answering System on Academic Literatures", AAAI2019 (Demo)

Awards

Baidu Scholarship (10 recipients worldwide), 2022.

Snap Fellowship Honorable Mention, 2022.

China National Scholarship (Top 0.2%), 2018.

Research Experience

Research Intern. MIT-IBM Watson AI Lab. Supervisor: Chuang Gan. 2021.3 - present

Research Assistant. VCLA, UCLA. Supervisor: Song-Chun Zhu. 2019.9 - present

Research Intern. Tencent AI Lab. Supervisor: Piji Li. 2019.3-2019.7

Research Assitant. IIoT, SJTU. Supervisors: Xinbing Wang, Weinan Zhang. 2016-2019

Misc.

I dedicate almost all my spare time to music. I play the piano, pipa (a Chinese instrument), organ, and harpsichord in an orchestra; the keyboard and guitar in a rock band. I also occasionally play the saxophone for some jazz bands. (Favorite music genres: metal, rock, jazz, classic. Favorite book.)

I've been playing the piano since I was five, and I was the president of the piano association in Shanghai Jiao Tong University. I really enjoy playing double-piano works with others (In fact I held a double-piano concert when I was an undergraduate!).