Talk
Boulder NLP Seminar: Jannatun Naim
When
· 11:15 AM MDT
Shown in the venue’s time zone (America/Denver), not yours.
Where
Boulder, CO
Tickets
No on-sale date recorded
This event came from a public calendar feed. Calendar feeds publish when a show happens, not when its tickets go on sale — so this is genuinely unknown rather than zero, and rather than “already on sale”.
What the source said
Title: Beyond Speech: Modeling Whiteboard Interaction for Multimodal Understanding of Instruction Abstract: Imagine a teacher asking, “What does this point tell us?” while pointing to the intersection of two lines on a classroom blackboard, or a tutor saying, “multiply it by that” while drawing arrows on a shared online whiteboard. In moments like these, the transcript alone does not contain the full meaning. Mathematical problem solving often unfolds through coordinated speech, written representations, gestures, and visual artifacts, yet many computational approaches to classroom discourse still treat language as the primary source of evidence. This area exam talk reviews prior work on visual content extraction, visual–linguistic alignment, multimodal fusion, and gesture recognition in instructional videos, with a focus on how these research areas have approached the relationship between spoken discourse and visual activity. Across this literature, a common limitation emerges: existing methods rarely model how spoken language, evolving whiteboard content, and interaction with that content work together to shape pedagogical meaning. Using small-group mathematics tutoring as a motivating setting, I will conclude by briefly outlining how these gaps point toward discourse-grounded whiteboard understanding as a promising direction for future research.