What ultimately matters is subjective quality of experience

  • Does the application meet user needs?
  • Does the application allow users to communicate effectively?
  • Does the application provide compelling entertainment?

QoE is not a one-dimensional metric

  • What aspect of user experience are you evaluating?
    • e.g., “Does it sound good” is not the same as “Can you understand it?”
  • How does your metric relate to the task being performed?
  • Some aspects of user experience can be estimated from technical metrics
    • e.g., the ITU-T E-model for speech quality evaluation based on latency and packet loss
  • Some aspects are subjective and task dependent – need user trials