Voice-based interface design - presentation

Voice-based interface design - presentation

Dr Andras Rung • Mar 16, 2017

Rung András's presentation at the NLP meetup on 22th February 2017.
Find below the excerpt of the presentation.
You can download the presentation hereFrom whom is this relevant?
  • 16% illiterate
  • 14% younger than the age of 6 years
  • 2% visually impaired
  • 10% dyslexic
When?
  • Occupied hands
  • Cheap gesture
  • Passive
  • Group-based
Why is it interesting?
  • Alexa and Google home will shake things up
  • Still before the starting line in Hungary
  • Moving past IVR
  • The death of VUI or GUI?
Chatting or taking care of business - From butler to friend
  • Situation-dependent adaptation (task, intent)
  • Co-reference and context management
  • A mix of visual and voice-based solutions
  • Expectation management
Sample conversations - Creating the interface’s backbone
  • On-site work and interviews
  • Creating successful conversation paths using diagram drawers
  • Nuance Mix, Api,.ai, Wit.ai
  • Creating visual screens
Constructive grammar - VUI and modern language theory?
  • Wildcards and logical inputs
  • Fillmore, Goldberg
  • Complex opportunity management
Confirmation
  • Three-level feedback
  • Clearly: The weather in San Francisco is…
  • Not a linguistic signal
  • Generic: I’m sorry to hear that
  • Visual
Troubleshooting, assistance
  • No speech
  • No interpreted speech
  • Processed but not managed speech
  • Poorly recognised
  • Beginners and proficient user management
  • Assistance and correction opportunities
Clarification, versions
  • Too much information: I have a headache and nausea…
  • Input variation management: fridge, refrigerator, chiller, cooler, ice-box
  • What is the temperature in Velence? /Call John.
  • Asking back or guessing
Intentions, complex data entry
  • Show me my calendar / add an event / delete event, etc.
  • Emotion detection based on voice and keywords
  • Nonlinear completion of complex forms

About the authors

Dr Andras Rung thumbnail
Dr Andras Rung
CEO, Funder

A real veteran of UX by having 18 years of experience. Strong focus on business needs and innovation. András Rung has worked for various institutions and companies since 2002. He is the co-author of the first Hungarian usability book and author of the usability blog Ergomania.

Related posts

AR, MR, VR, XR – 4 abbreviations that we must be familiar with in the world of modern UX-UI
Apr 20, 2022

AR, MR, VR, XR – 4 abbreviations that we must be familiar with in the world of modern UX-UI

AR, MR, VR, XR: these are abbreviations without which the second half of the 2020s cannot be imagined. Today, technological advances add newer and newer abbreviations and technical terms to our langua...

Fintech scene in Switzerland - Is there a Brand Swiss?
May 5, 2022

Fintech scene in Switzerland - Is there a Brand Swiss?

In the 1949 classic movie, The Third Man, the central character famously says, “In Switzerland, they had brotherly love, they had five hundred years of democracy and peace. And what did that produce? ...

More Popular Than Expected: The Secret of The Best Voice-user Interfaces
Dec 21, 2021

More Popular Than Expected: The Secret of The Best Voice-user Interfaces

Personal assistants communicating with the VUI, or voice-user interface, have become much more popular than the largest industry players expected them to be. Amazon, Microsoft, Google, or Apple all ha...

Related case studies