Steve Krug: You’re NOT Doing Usability Testing? Are You Nuts?

The University of Toronto iSchool was lucky enough to get Steve Krug of Don’t Make Me Think fame. If you haven’t read it and you’re at all interested in usability, I would definitely recommend it. Anyway, here are my notes from today’s talk.

Goal

Convince you that usability testing is the most valuable thing you can do to ensure that what you’re building works.

12 Years Ago – The Debate

Realized seeing the same story over and over again. He first started by turning it into a comic. Basically the same debates happened over and over, frequently without decisions being made. It’s difficult to find a middle ground, because each person comes with their own perspective. Partly, there’s no hard and fast answer, because it depends on the context.

Usability testing eliminated most debates. Seeing users use what they designed changed their perspective and start talking from the user perspective rather than personal biases.

Keeping It Simple

Traditionally, usability is done in a lab with the minimum 8 users in a day by an outsider, ending in an expensive report which may not be convincing to the team.

Rocket Surgery Made Easy written more for people intending to actually do usability testing.

Just do it with:

  • 3 users per round
  • set up a monitor in another room to watch
  • record screencast
  • no stats, no faux validity, but produces meaningful insight
  • no big report, just debrief over lunch, report in 1-2 page email

Live Demo

Use script, which can be downloaded from Krug’s website. Instead of a website, he did a live demo on the Clear mobile app. Interestingly, the participant could not complete the task, which was interesting since the app is highly praised.

RSME: The 22-minute version

6 Maxims

  • A morning a month is all we ask.
  • Start earlier than you think makes sense. – Can start before you start by testing a competitor’s or old version, or even a sketch on a napkin.
  • Recruit loosely and grade on a curve. – Take just about anyone, and judge whether everyone would have that problem or if it’s just because not from target audience.
  • Make it a spectator sport.
  • Focus ruthlessly on the few, most serious problems. – Right away write down the top 3 problems to take into debrief.
  • When fixing problems, always do the least you can do. – The smallest change might do to solve or help mitigate the problem. Tweak, don’t redesign.

Q&A

  • James Chudley CX Partners wrote on the approach to doing mobile app testing that needs context.
  • Tools for Remote Testing – Goto Meeting, WebEx and need high quality audio
  • Analytics good to help know what to test
  • Do usability more frequently rather than testing a lot of people, because you quickly hit diminishing returns
  • Task specification – allow user to have the choices of content

Access 2012 Day 3: Session Notes

Out with the Desk: Re-Shaping Service Delivery in Libraries

Marc Pillon

Challenges facing public libraries:

  • perceived as inconvenient/impractical in today’s digital world
  • budgets are shrinking
  • patrons expect a different service

Idea:

  • bring the library to them e.g. Tim Horton’s, Loblaws, Shoppers

Vision for Public Libraries in the 21st Century

  • convenience! = ‘cutting the cord’ to service
  • being able to deliver them anytime, anywhere
  • less traditional bricks-and-mortar
  • more locations for drop off, pick up, access to technology
  • partner with existing retail outlets

Library in a Box

Gave access to ILS with small computer.

Pros

  • access to ILS anywhere
  • small enough to carry anywhere
  • limited only by wireless signal

Cons

  • not easy to transport, bulky/heavy
  • complicated setup requiring IT support

Introducing CanGURU

Using Apple iPhone and Bluetooth barcode scanner. iPad and wifi receiver

  • highly portable, light weight, easy to use
  • made inexpensive by using consumer products that are readily available
  • can be easily replicated by other libraries
  • used externally and internally (getting rid of information desk)
  • highlights important of librarian (return to reader’s advisory, roving to enhance customer service)
  • collaboration with social services, parks and recreation, and other non-profit organizations

Technology

  • 3G or wifi for connectivity
  • VPN (Cisco AnyConnect) for authenticated access to internal network
  • RDP protocol for access to ILS software
  • client device suh as iPad or notebook
  • bluetooth barcode scanner
  • custom iOS software (uses protocol to talk to ILS)

Future Improvements

  • faster wifi
  • streamline connectivity process
  • self-check version for iPad
  • patron version for self-check
  • implement SIP3 options
  • integrate with RFID
  • porting to android and/or Windows 8 tablet

Where should Libraries Locate?

  • big box stores/large retail centres
  • coffee shops
  • train stations/airports
  • hospitals
  • parks
  • university/college campus

One Example: Fraser Valley Regional

Encapsulated technology in a car with public computers, books, check in/out, etc.

Another Example: University of Alberta has an embedded Edmonton Public Library branch.

Shaping the User Experience

Sonya Betz and Robert Zylstra

Problem

A lot of different web interfaces:

  • library website
  • libguides
  • ILL
  • OPAC
  • etc.

Can get 3-4 different interfaces just doing a simple look up and placing a hold on book. Users find it too difficult to find things and so much time is spent trying to train users to use them all, but it’s a losing battle.

Had no mobile interface either.

Solution

Virtual Services Integration Project

  • simplify access to library resources
  • provide access via all devices
  • provide common experience between platforms

First was mobile version (iOS App) and full-scale web (responsive design).

Key Concepts

  • one access point replacing multiple access points
  • mobile and desktop interfaces
  • user aware
  • fast and intuitive access
  • consistent and intuitive experience

Project Motto

Think Big, Start Small, Move Fast

Using Web Servies APIs

Integrating Services (e-Reserve, room booking) and Resources (Physical, electronic, etc.). Also has EDS.

My Account: Authentication to App using LDAP, which send tokens to everything in the App to simulate single sign-on.

Search: uses EDS API, which allows limiters. Can then share through mail, print, copy, dropbox, etc. Holdings details from ILS.

Library info: from website.

Featured Lists: new materials using ILS

At Present

Consolidated 3 separate spaces of library info, search, and account.

Next

  • MusicBrainz
  • citations
  • Alexander Street Press (streaming audio and video)
  • Favourites
  • shared folders
  • library maps
  • barcode scan
  • NFC/RFID

Mobile App is a pilot for the CMS. App infrastructure will serve as basis for CMS. CMS and App will share user preference and content.

Marketing

  • public press release
  • website
  • posters
  • instructional sessions (provided premade screen)
  • etc.

Worked with communications department.

More notes on Access 2012 Live Blog.

Making Announcements: On-Site vs. News Blog

We’ve recently had to put up a couple of announcements due to some patches and upgrades on our library website server. Right now, I’m doing it the way I’ve seen it done on most library websites and that’s to simply put up an announcement on the front page.

Ryerson Home page with Announcement

However, there are numerous downsides to this method.

First, the way I’ve done it, it only shows on the home page, and no other page.

Second, you have to visit the website beforehand while the announcement is up in order to know that the site will be down later.

Using the Blog

One way to get around the second problem at least, is to use the blog. Posting on the blog automatically pushes the downtime announcements to the homepage feed, meaning that anything following the feed will see the notice even without visiting the site. On our blog, we can also automatically push to Twitter and Facebook if we choose to do so.

On the other hand, it’s very much time sensitive, and if the person doesn’t visit the site during the early hours of the morning, they wouldn’t even notice. Is it something people really need to be notified off-site? If someone visits often enough, they’ll see it.

Notification Bar

To fix the first problem though, I have been pondering the use of a notification bar. Much like the ones you see when your JavaScript or Cookies are disabled (see the stackoverflow example below).

Example of Notification Bar with Stack Overflow's site

Of course, best practices seem to be to only use notification bars for browser related issues.

Pop Up

What might work better is to have a in-page popup on first visit (once the announcement is set), with the option to dismiss it. Using cookies, you could then locally store a simple variable to see whether the person has dismissed that particular announcement already.

Ideally, we could do it in such a way that it will work across the entire domain rather than just the one site.

Injecting Personality into a Library Website

While moving our website into WordPress, I came across a blog post about adding some personality into a website (I’ve unfortunately lost the link to it). So, I thought I’d find some small ways to do that with our site too.

I was recently reading as well about how successful GVSU Library has been with their construction updates using a twitter account by giving the building a persona.

404 Page

One of the most common ways that a site will show some personality is with its 404 page. One of my favourites is the Github 404. I thought maybe we could do something a little more amusing than the standard 404, so with the help of my partner, we came up with this:

404 Page with Dewey joke

Unfortunately, I got various complaints that the 404 page was confusing and didn’t make any sense (from staff, it was changed before the site went public). I knew from the beginning that it wouldn’t fly with making it public for our users because they wouldn’t get it, but I thought at least one staff member would get the joke.

I may have another stab at it with a simpler one, perhaps with just a headline, but that won’t be in at least a couple of months.

Custom Avatar

One of my thoughts for the blog was to have a custom default avatar that would be a picture of our university mascot or just a version of our library’s logo. Unfortunately, I couldn’t find a plugin that worked on multisite that would allow me to set a custom avatar only for the main site (and not all the subsites).

Placeholder Text

I actually mentioned this in a previous post that I decided to have a little fun with placeholder text, but here it is again.

WP Comments Form Edited version 2

Eggy the Ram is the name of our university mascot. No one has actually noticed this since our blog hasn’t been moved. Thankfully, unlike the 404, the placeholder text here should have no chance of confusing people.

Badges

Another idea I recently thought of that might be fun is for students to get badges during orientation or even throughout their time in school for completing workshops or similar things. Instead of an in-house system, it could be done using something like Open Badges.

I’d be interested to see if other more formal institutions have done any of these or other things to add some ‘personality’ to their sites.