About

NEWS: Starting July 2021, I'll be joining the Department of Information and Communication Engineering at DGIST as an assistant professor. If you are interested in joining my lab DIAG, please send your CV and transcript to diag.dgist@gmail.com. Thanks!

Currently, I am a research assistant professor in the School of Computing at KAIST. I work with Prof. Juho Kim in KIXLAB and Prof. Insik Shin in CPS Lab.

My research interests are focused on eliciting and leveraging diverse annotations from people to convert raw data to meaningful information, which can harness artificial intelligence systems and provide valuable insight to end users.

Keywords: #Human Computation; #Crowdsourcing; #Human-Computer Interaction; #Artificial Intelligence

Publications

Conference and Journal Papers

Posters, Demos, and Workshop Papers

Thesis

Projects

Robust 4D Simulation of Rare Events enabled by Human-Augmented Computer Vision

Research in robotics and autonomous vehicles suffers from a lack of realistic training data and environments in which to test new approaches. Rare and unusual events such as traffic accidents occur several orders of magnitude less frequently than is needed to collect large enough training and testing sets, presenting a fundamental bottleneck in the research and deployment of such systems. Thus, we propose to use a crowdsourced human-­in-­the-­loop approach to guide computer vision algorithms to extract measurement information from large video corpora, allowing us to create simulations of scene dynamics for training and testing.


Crowdsourcing Emotion, Intention, and Context Annotations from Dialog Videos

Dialog videos contain rich contextual, emotional, and intentional cues of the characters and their surroundings. In this project, we aim to build a crowdsourcing platform that collects these information from a large dialog video dataset. The collection and aggregation process can be challenging because the temporal dimension of the dataset has to be considered, and the labels can be highly subjective. We combat these challenges by exploring crowdsourcing techniques to design workflows and answer aggregation methods that efficiently collects multi-dimensional labels and overcome the subjective nature of the collected annotations.


Improving Aggregate Crowd Performance on Crowd-Assisted Image Segmentation

In designing crowdsourcing tasks, we want to achieve as high accuracy as possible from the given resources. In this work, we introduced an approach of leveraging tool diversity as a means of improving aggregate crowd performance. We define tool diversity as a property of a system (or a task), that enables to use different tools for a same task. In semantic image segmentation tasks, we show that our approach improves the aggregate accuracy significantly, compared to using a single best tool alone.