Here's a neat demo from Yihui Xie: you can talk to this R graph and customize it with voice commands.
You'll need to click through the link to start the demo in a new window, and you'll need to be using Chrome and allow access to your microphone. (If you can't get it to work on your system, here's a video demo of Yihui using the app.) But with that done, you can use voice commands like "color green" to change the point color, the title, or even add a regression line.
Behind the scenes, this is a simple Shiny app, implemented in the R language. (You can find the R code for the app here.) The voice recognition is handled by the annyang Javascript library, which in turn triggers events captured in R with the Shiny.onInputChange function. It's not perfect (try as I might I couldn't get it to put "customized" instead of "customize" in the title), but it's a very promising prototype of voice-controlled apps in R.
Yihui Xie: A Shiny app based on annyang that responds to voice input
Comments