Adding a Voice Interface to a Web Application (Video)
April 5, 2016

Adding a Voice Interface to a Web Application (Video)

Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Brittany Walla
COO & Co-founder
Matt Buck
CTO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Brittany Walla
COO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Brittany Walla
COO & Co-founder
Matt Buck
CTO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Brittany Walla
COO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Matt Buck
CTO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Matt Buck
CTO & Co-founder
Matt Buck
CTO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Matt Buck
CTO & Co-founder
Matt Buck
CTO & Co-founder
Matt Buck
CTO & Co-founder
Renee Jonard
Marketing & Sales
Lauren Golembiewski
CEO & Co-founder
Lauren Golembiewski
CEO & Co-founder
Brittany Walla
COO & Co-founder

At a recent Austin on Rails meeting, we gave a short talk on the benefits of adding an interactive voice interface to a web application. Over the course of the afternoon we spent preparing for the presentation, we were able to add voice interaction to the Spree Open Source ecommerce platform.

Why voice?

When someone uses a piece of software, the software's first job is to divine the user's intent. What does this series of points, clicks, keyboard presses, swipes, and/or gestures mean? What is it that the user wishes to do? This process of expressing intent by navigating a visual (or physical) user interface is the primary means by which we have used technology to date. No matter what series of points, clicks, and keystrokes we require the user to enter, it all began in the user's mind with that intent:

     
  • I want to check my savings account balance.
  •  
  • I want to publish my latest blog post draft.
  •  
  • I want to see the shipping address for the latest order to my store.

That intent is formulated as a series of words in the user's mind. Rather than expressing that intent via pointing and clicking, we can instead allow users to express that intent in the most natural way possible: by speaking it:

     
  • “Show me my savings account balance.”
  •  
  • “Publish the latest draft blog post.”
  •  
  • “Show me the shipping address for the latest order.”

This kind of organic, natural communication with software will eventually become the primary way we interact with technology. But it's already possible to make these kinds of interactions a reality today.

How we did it

The code for the demo in the above presentation can be found on GitHub. We made use of Google Chrome's support for voice recognition via the Web Speech API, and leveraged the Api.ai Natural Language Understanding platform for parsing user input into machine-readable intents.

Let's talk!

If you want to learn more about Voxable can help you give voice to your product, please get in touch!

Design better voice and chat apps.

Conversation Design with Voxable: Notes

Lauren Golembiewski
CEO & Co-founder
Voxable’s note feature gives users an easy way to annotate designs with details about decisions, development direction, and ongoing project management.
Read more

AI-Assisted Conversational Prototypes with Voxable

Matt Buck
CTO & Co-founder
Check out the future of AI-assisted conversational prototypes with Voxable.
Read more

Conversation Design with Voxable: Voice Selection with Amazon Polly

Lauren Golembiewski
CEO & Co-founder
Voxable’s voice selection feature allows users to design with all 31 languages and dialects supported by Amazon Polly.
Read more
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.