Expanding the Capabilities of Voice User Interface for Math Formula Editor through Interactive Commands

Abstract:

In this paper we present the concept and implementation of the voice-controlled editing tool of complex mathematical notation. In our previous works we introduced the basic system, which enables both dictation and reading of mathematical expressions in nearly natural language. This work describes an enhancement of the basic solution, that allows for editing existing formulas by means of voice commands. The main challenge in this task is to navigate properly across the expression to get the desired accuracy on corrections, insertions and deletions of particular symbols. We address this problem by extending the basic command set with commands referring to the graphical visualization of the edited expression and combining them with the programmed internal structure of particular expression components.