Voice-based interface design – presentation

Rung András’s presentation at the NLP meetup on 22th February 2017.

Find below the excerpt of the presentation.

You can download the presentation here

From whom is this relevant?

  • 16% illiterate
  • 14% younger than the age of 6 years
  • 2% visually impaired
  • 10% dyslexic


  • Occupied hands
  • Cheap gesture
  • Passive
  • Group-based

Why is it interesting?

  • Alexa and Google home will shake things up
  • Still before the starting line in Hungary
  • Moving past IVR
  • The death of VUI or GUI?

Chatting or taking care of business – From butler to friend

  • Situation-dependent adaptation (task, intent)
  • Co-reference and context management
  • A mix of visual and voice-based solutions
  • Expectation management

Sample conversations – Creating the interface’s backbone

  • On-site work and interviews
  • Creating successful conversation paths using diagram drawers
  • Nuance Mix, Api,.ai, Wit.ai
  • Creating visual screens

Constructive grammar – VUI and modern language theory?

  • Wildcards and logical inputs
  • Fillmore, Goldberg
  • Complex opportunity management


  • Three-level feedback
  • Clearly: The weather in San Francisco is…
  • Not a linguistic signal
  • Generic: I’m sorry to hear that
  • Visual

Troubleshooting, assistance

  • No speech
  • No interpreted speech
  • Processed but not managed speech
  • Poorly recognised
  • Beginners and proficient user management
  • Assistance and correction opportunities

Clarification, versions

  • Too much information: I have a headache and nausea…
  • Input variation management: fridge, refrigerator, chiller, cooler, ice-box
  • What is the temperature in Velence? /Call John.
  • Asking back or guessing

Intentions, complex data entry

  • Show me my calendar / add an event / delete event, etc.
  • Emotion detection based on voice and keywords
  • Nonlinear completion of complex forms

Share your opinion with us

    Please type your message

    Please type your email!

    Please type your message

    Send comment

    We create exceptional websites, mobile applications and software to help you realise your business goals.

    Dear Ergo,

    My name is
    . My email is
    . And I have the following message for you:


    Find out more about the topic

    A more conscious and careful choice of feature prioritization methods is needed!

    May 18, 2020 | 9 min read

    Dr. András Rung, CEO of Ergomania, gave a presentation in English titled “Choose your features with care” at the eFinance & Fintech Festival 2020 in Budapest. In the introduction, he talked about ...

    Design systems, from ring binders to modular design

    November 20, 2019 | 8 min read

    The term design system is one of the buzzwords lately, but do we know exactly what it means and would it really be the solution to anything and everything? Millenáris Startup Campus has hosted the second...