Research Interests

• Information Retrieval
• Natural Language Processing
• Computer Vision
• Internet of Things

Education

• Ph.D., Graduate School of System Informatics, Kobe University, March 2014
• M.S., Graduate School of Engineering, Kobe University, March 2011
• B.S., Department of Computer Science and Systems Engineering, Kobe University, March 2009

Employment

• Senior Researcher in Advanced Telecomunications and Research Institute International. April 2021 - Present
• Researcher in Advanced Telecomunications and Research Institute International. April 2014 - 2020
• Research Intern in Microsoft Research Asia. August - December 2012
• Research Assistant in Graduate School of System Informatics at Kobe University. April 2011 - March 2012
• Teaching Assistant in Graduate School of Engineering at Kobe University. April 2009 - March 2011

Publications

Thesis

• Taiki Miyanishi. Time-Aware Information Retrieval in Social Networks, Ph.D. Dissertation, Kobe University, Hyogo, Japan, March 2014.

Journal Articles

• Thilina Dissanayake, Takuya Maekawa, Takahiro Hara, Taiki Miyanishi, and Motoaki Kawanabe. IndoLabel: Predicting Indoor Location Class by Discovering Location-specific Sensor Data Motifs, IEEE Sensors Journal, 2021.
• Taiki Miyanishi, Takuya Maekawa, and Motoaki Kawanabe. Sim2RealQA: Using Life Simulation to Solve Question Answering Real-World Events. In IEEE Access, Vol.9, pp.75003-75020, 14 May 2021. [link]
• Yujie Li, A. Kanemura, Hideki Asoh, Taiki Miyanishi, and Motoaki Kawanabe. Multi-sensor integration for key-frame extraction from first-person videos. In IEEE Access, Vol.8, pp.122281–122291, 9 July 2020. [link]
• Quan Kong, Takuya Maekawa, Taiki Miyanishi, and Takayuki Suyama. Contextual Information Based Home Appliances Selection with Smart Glass. IPSJ Journal, Vol.58, No.10, pp.1712-1723, 2017. (in Japanese)
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Concept Tracking for Microblog Search. IPSJ Transactions on Databases, Vol.7, No.2, pp.1-10, June 2014. (in Japanese)
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Improving Pseudo-Relevance Feedback by Relevance Feedback using Micro-Document Selection. IPSJ Journal, Vol.55, No.5, pp.1585-1594, May 2014. (in Japanese)
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Synthesizing Temporal and Atemporal Query Expansion for Microblog Search. IPSJ Journal. Vol.54, No.4, pp.1655-1666, April 2013. (in Japanese)
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Object Ranking in Evolutional Networks via Link Prediction. Transactions of the Japanese Society for Artificial Intelligence. Vol.27, No.3, pp.223-234. March 2012. (in Japanese)
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Hypothesis Ranking Based on Semantic Event Similarities. IPSJ Transactions on Bioinformatics. Vol.4, pp.9-20, May 2011.

Conference Papers

• Taiki Miyanishi, Daichi Azuma, Shuhei Kurita, and Motoki Kawanabe. Cross3DVG: Cross-Dataset 3D Visual Grounding on Different RGB-D Scans. In Proceedings of the 11th International Conference on 3D Vision 2024 (3DV 2024). [arXiv][code]
• Koki Maeda, Shuhei Kurita, Taiki Miyanishi, and Naoaki Okazaki. Query-based Image Captioning from Multi-context 360° Images. In Findings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023). [link]
• Taiki Miyanishi*, Fumiya Kitamori*, Shuhei Kurita, Jungdae Lee, Motoaki Kawanabe, and Nakamasa Inoue. CityRefer: Geography-aware 3D Visual Grounding Dataset on City-scale Point Cloud Data. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks (NeurIPS D&B 2023). [arXiv][code]
(*denotes equally contributed)
• Daichi Azuma*, Taiki Miyanishi*, Shuhei Kurita*, and Motoki Kawanabe. ScanQA: 3D Question Answering for Spatial Scene Understanding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2022 (CVPR 2022). [arXiv][code]
(*denotes equally contributed)
• Taiki Miyanishi and Motoaki Kawanabe. Watch, Listen, and Answer: Open-ended VideoQA with Modulated Multi-stream 3D ConvNets. In Proceedings of the 29th European Signal Processing Conference 2021 (EUSIPCO 2021). [PDF]
• Taiki Miyanishi, Takuya Maekawa, and Motoaki Kawanabe. Two-Stream Spatiotemporal Compositional Attention Network for VideoQA. In Proceedings of the 31st British Machine Vision Conference 2020 (BMVC 2020). September 2020. [PDF]
• Yujie Li, A. Kanemura, Hideki Asoh, Taiki Miyanishi, and Motoaki Kawanabe. Supervised saliency maps for first-person videos based on sparse coding. Proceedings of the 10th Asia-Pasific Signal and Information Processing Association Annual Summit and Conference (APSIPA 2018), November 2018. [link]
• Taiki Miyanishi, Jun-ichiro Hirayama, Atsunori Kanemura, and Motoaki Kawanabe. Answering Mixed Type Questions about Daily Living Episodes. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI 2018). pp.4265-4271, July 2018. [PDF]
• Yujie Li, A. Kanemura, Hideki Asoh, Taiki Miyanishi, and Motoaki Kawanabe. A sparse coding framework for gaze prediction in egocentric video. Proceedings of the 43rd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2018), pp.1313-1317, April 2018. [link]
• Taiki Miyanishi, Jun-ichiro Hirayama, Takuya Maekawa, and Motoaki Kawanabe. Generating an Event Timeline about Daily Activities from a Semantic Concept Stream. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI 2018), pp.142-150, February 2018. PDF]
• Yujie Li, A. Kanemura, Hideki Asoh, Taiki Miyanishi, and Motoaki Kawanabe. Extracting key frames from first-person videos in the common space of multiple sensors. IEEE International Conference on Image Processing (ICIP 2017), pp.3993-3997, September 2017. [link]
• Yujie Li, Atsunori Kanemura, Hideki Asoh, Taiki Miyanishi, and Motoaki Kawanabe. Key frame extraction from first-person video with multi-sensor integration, In Proceedings of the 2017 IEEE International Conference on Multimedia and Expo (ICME 2017), pp.1303-1308, July 2017. [link]
• Quan Kong, Takuya Maekawa, Taiki Miyanishi, and Suyama Takayuki. Selecting Home Appliances with Smart Glass Based on Contextual Information, In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Ubicomp 2016). pp.97-108, September 2017. [link]
• Taiki Miyanishi, Jun-ichiro Hirayama, Takuya Maekawa, Quan Kong, Hiroki Moriya, and Takayuki Suyama. Egocentric Video Search via Physical Interactions. In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI 2016). pp.330-336, Febrary 2016. [PDF]
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Time-Aware Latent Concept Expansion for Microblog Search. In Proceedings of the 8th International AAAI Conference on Weblogs and Social Media (ICWSM 2014). pp.366-375, June 2014. [PDF]
• Taiki Miyanishi, Sayaka Kitaguchi, Kazuhiro Seki, and Kuniaki Uehara. TREC 2013 Microblog Track Experiments at Kobe University. In Proceedings of the 22nd Text Retrieval Conference (TREC 2013), November 2013. [PDF]
• Sayaka Kitaguchi, Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Interactive Disaster Information Search System for Microblog by Minimal User Feedback. In Proceedings of the 9th Asia Information Retrieval Societies Conference (AIRS 2013). pp.476-487, December 2013. [PDF]
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Improving Pseudo-Relevance Feedback via Tweet Selection. In Proceedings of the 22nd ACM International Conference on Information and Knowledge Management (CIKM 2013). pp.439-448, October 2013. [PDF]
• Taiki Miyanishi and Tetsuya Sakai. Time-aware Structured Query Suggestion. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2013). pp.809-812, July 2013. (short paper) [PDF]
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Combining Recency and Topic-Dependent Temporal Variation for Microblog Search. In Proceedings of the 35th European Conference on Information Retrieval (ECIR 2013). pp.331-343, March 2013. [PDF]
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. TREC 2012 Microblog Track Experiments at Kobe University. In Proceedings of the 21st Text Retrieval Conference (TREC 2012), November 2012. [PDF]
• Taiki Miyanishi, Naoto Okamura, Xiaoxi Liu, Kazuhiro Seki, and Kuniaki Uehara. TREC 2011 Microblog Track Experiments at Kobe University. In Proceedings of the 20th Text Retrieval Conference (TREC 2011), November 2011. [PDF]
• Taiki Miyanishi, Kazuhiro Seki, and Kuniaki Uehara. Hypothesis Generation and Ranking Based on Event Similarities. In Proceedings of the 25th Annual ACM Symposium On Applied Computing (SAC 2010), pp.1552-1558, March 2010. [PDF]

Grants Received

• Japan Science and Technology Agency (JST) ACT-I, October 2018 – March 2020
• Japan Science and Technology Agency (JST) KAKEN Wakate B, April 2016 – March 2018
• The Telecommunications Advancement Foundation Grants for Researchers Attending International Conferences, November 2013
• Japan Society for the Promotion of Science (JSPS) Grant-in-Aid for JSPS Fellows, April 2012 - March 2014
• Support Center for Advanced Telecommunications Technology Research, April 2011 - March 2012
• NEC C&C Foundation Grants for Researchers Attending International Conferences, November 2011

Survey

• in Japanese