Voice-based interface design – presentation

Rung András’s presentation at the NLP meetup on 22th February 2017.

Find below the excerpt of the presentation.

You can download the presentation here

From whom is this relevant?

  • 16% illiterate
  • 14% younger than the age of 6 years
  • 2% visually impaired
  • 10% dyslexic

When?

  • Occupied hands
  • Cheap gesture
  • Passive
  • Group-based

Why is it interesting?

  • Alexa and Google home will shake things up
  • Still before the starting line in Hungary
  • Moving past IVR
  • The death of VUI or GUI?

Chatting or taking care of business – From butler to friend

  • Situation-dependent adaptation (task, intent)
  • Co-reference and context management
  • A mix of visual and voice-based solutions
  • Expectation management

Sample conversations – Creating the interface’s backbone

  • On-site work and interviews
  • Creating successful conversation paths using diagram drawers
  • Nuance Mix, Api,.ai, Wit.ai
  • Creating visual screens

Constructive grammar – VUI and modern language theory?

  • Wildcards and logical inputs
  • Fillmore, Goldberg
  • Complex opportunity management

Confirmation

  • Three-level feedback
  • Clearly: The weather in San Francisco is…
  • Not a linguistic signal
  • Generic: I’m sorry to hear that
  • Visual

Troubleshooting, assistance

  • No speech
  • No interpreted speech
  • Processed but not managed speech
  • Poorly recognised
  • Beginners and proficient user management
  • Assistance and correction opportunities

Clarification, versions

  • Too much information: I have a headache and nausea…
  • Input variation management: fridge, refrigerator, chiller, cooler, ice-box
  • What is the temperature in Velence? /Call John.
  • Asking back or guessing

Intentions, complex data entry

  • Show me my calendar / add an event / delete event, etc.
  • Emotion detection based on voice and keywords
  • Nonlinear completion of complex forms

0 comments

Share your opinion with us

Please type your message

Please type your email!

Please type your message

Send comment

We create exceptional websites, mobile applications and software to help you.

Dear ergo,

My name is . My email address is . And I have the following message for you:

recommended
articles

Find out more about the topic

Face and mobile screen recording tools

July 9, 2018 | 5 mins read | 0 comment

What was the task we had to complete? We had a remote UX researcher and an assistant on one side and a tester on the other side. So we had to be able to stream the tester’s face and screen in real-time and additionally, due to post production purposes we also needed to be able to record the session, in order to cut and edit the material. Read more

What we get and could get from the Internet of Things?

June 5, 2018 | 13 mins read | 0 comment

Still invisible to most of us, a huge revolution is unfolding: the Internet of Things, or IoT is exploding, with an increasing number of devices connecting to it, supplying data that is later assessed based on various aspects. According to Gartner’s estimate, by the end of this decade the presence of these devices will be higher by one order of magnitude than the presence of humans. Read more

We like you,
get in touch

Let's make memorable things together

Dear ergo,

My name is . My email address is .
And I have the following message for you:

We reply within 24 hours

Váci Utca Center, 8th floor 1056 Budapest Váci utca. 81.

Visitor info