Research to Action

The Global Guide to Research Impact

Navigation

  • Home

  • How To ▾

    This list of how to’s provides an essential guide for a number of key communication and engagement activities that will help make your research travel.

    • Building Capacity
    • Policy Briefs
    • Research Impact
    • Theory of Change
    • Uptake Strategy
  • Topics ▾

    • Knowing your audience ▸
      • Building a strategy
      • Engaging policy audiences ▸
        • EBPDN
        • Targeting policy actors
        • Targeting practitioners
      • Stakeholder mapping
      • Strategic communication ▸
        • Building a brand
        • Engaging the public
      • Working with the media
    • Making your research accessible ▸
      • Framing challenges
      • Knowledge translation
      • Learning in context
      • Open access
      • Presenting your research
      • Using digital tools ▸
        • Using multi media
        • Using online tools/ICTs
        • Using social media
      • Using intermediaries
    • Monitoring and evaluation ▸
      • Applying M&E methods
      • Evidence into policy
      • Measuring success
  • Dialogue Spaces ▾

    • GDN: Doing Research
    • Manchester Policy Week 2015
    • TTI Exchange 2015
    • Strengthening Institutions to Improve Public Expenditure Accountability (GDN PEM Project)
    • DFID/AusAid Research Communication and Uptake Workshop
    • 3ie Policy Influence and Monitoring (PIM) project
    • Policy Engagement and Communications (PEC) Programme
  • Reading Lists

  • Opportunities

Social Media

  • Facebook
  • Twitter
  • Instagram
  • LinkedIn
  • Vimeo
  • RSS

Featured

Improving the flow of your information: Website usability testing

By Betty Paton 18/10/2011

Share this post:

When developing online research resource portals, databases and community groups it is often difficult to assess how people will be using a platform as it grows. As online resources for research in international development are often put together without a commercial business framework in mind, there is a potential that the functioning fluidity of the site may not be addressed at a basic level before it is launched.

Audiences for development research websites are often very diverse, with users seeking information from academic, aid worker, policy-maker, NGO and non-professional backgrounds. This rich range of users can be problematic when defining the way a site functions and communicates the information it has available.

Usability evaluations, when carried out at the very beginning of the site development process, can determine if those who will be using the platform can do so quickly and easily to accomplish their own tasks. Usability testing applies to every aspect of the website with which a person interacts, such as hardware, software, menus, icons, messages, community pages, documentation, search functions and help. It generally involves measuring how well test subjects respond in four key areas:

  • Performance – How much time and how many steps are required for people to complete basic tasks? (For example, create a user profile, access and download a document, search for a key term.)

 

  • Accuracy – How many mistakes did people make? (Were they fatal or recoverable with the right information?)
  • Recall – How much does the person remember afterwards or after periods of non-use? (Is the site user intuitive?)
  • Emotional response – How does the person feel about the tasks completed? (Is the person confident, stressed? Would the user recommend this system to a friend?)

Evaluations are designed to solicit feedback from participants, focusing on areas of concern within the site’s functionality. An evaluation typically involves several participants, each of whom represents a typical user from a different background.

The Usability Process

Results from usability testing process can easily become inaccurate if users are approached incorrectly. The following checklist has been put together as a series of step-by-step actions for the test administrator to go through with the participant as they carry out the usability test. The checklist should be carried out under the presumption that the test will be conducted in one place (i.e. not remotely), on one computer with screen-video capturing software.  Ideally, this should be a quiet area, away from external distractions, where a camera can be set up to record the participants as they navigate the site. Participants should be asked to adopt a “think aloud” attitude to the process, talking through each of their navigational decisions so as to get a good impression of the way they would naturally find their way around the site. [1]

Activities to be completed with user participants:

Process overview, system under test overview and setting information

Test session checklist (completed by the test administrator)

  1. Greet user and introduce any observers, data loggers and others present in the room.
  2. Explain the test area and outline the screen-video capture software and video camera set-up, until the user is comfortable with the equipment.
  3. Reassure that there are no right or wrong answers and we are not testing them but the site.
  4. Seat user and sit close by to explain the test session.
  5. Have user complete a respondent profile questionnaire (ask for basic information relating to their job role and current website familiarity).
  6. Have user sign a video/audio tape and disclosure agreement.
  7. Ask the user if they have any questions.
  8. Review and demonstrate the “thinking aloud” process and complete practice exercise until the user is comfortable.
  9. Ask the user if they have any questions.
  10. Verify logging is ready to begin and start video-tape.

Activities to be completed with user participants:

Step-by-Step System Testing

Test session checklist (completed by the test administrator)

Journey One:

  1. Ask the participant to search the site with a key phrase or word in mind.
  2. Ask them to say aloud how and why they are searching for information (noting down the systems they are using).
  3. Enquire with short phrases why the participant is doing certain things (i.e. “You are using the archives search function – why?”)
  4. Ask what results they have found:
  • Was it successful?
  • Did they find what they wanted?
  • Were there any frustrating elements to the search?
  • What could have been different?

Journey Two:

5.   Ask them to start again, searching for something different – repeat the same process asking if they found what they wanted.Journey Three:

6.   Ask the participant to spend 10-15 minutes or so searching the site independently (leave the room during this time to allow them to search in an uninhibited way).

7.   Re-enter the room and ask the participant if they noticed anything in particular about the functionality of the site i.e:

  • Were there things that didn’t make sense?
  • Could the navigation of the site be made easier?
  • What are their overall thoughts on the layout and style (including colours, design, etc)?

Results and feedback are accumulated for each participant through the interviews and on screen navigation captures. The analysis is not a mandate for change; it provides a base of information from which decisions can be made to solve problem issues or to indicate areas in which the design has been successful.


[1] This checklist is based on document by Wendy W. Naughton, Usability & Technical Documentation Group, Xerox Corporation

For more information on usability testing visit:

Usability.gov

Usability Testing: How to plan, design and conduct effective tests

8 Guidelines for Usability Testing

This blogpost was originally published on CommsConsult’s Website.


Share this post:

Related posts

EBPDN: Refreshing recommended resources - 31/10/2019
Building momentum to advance citizen evidence in policymaking - 03/09/2019
Bringing researchers and knowledge brokers together for greater impact - 29/05/2019

Get 'New Post' e-alerts and follow R2A

> > > > >
Share this post:

Contribute to R2A:
We welcome blogposts, news about jobs, events or funding, and recommendations for great resources about development communications and research uptake.


Share this post:

Topics: development, Practical communication guides, public engagement, research communication, text

Betty Paton

Betty Paton

Betty Paton is Research to Action's Communication Coordinator. She firmly believes that social media is a powerful tool in the communication of development research and is committed to embracing and understanding new, emerging and appropriate techniques for communicating development. She has a degree in Film Studies from the Combined Universities of Cornwall and an MA in Film and Cultural Management from Southampton University. She is also the Strategic Communication Manager at CommsConsult Ltd.

One Response to Improving the flow of your information: Website usability testing

  1. Avatar Anonymous says:
    18/10/2011 at 10:01 pm

    One other alternative is to try a service like http://www.usertesting.com where your can set demographics for the type of user you want from their huge panel of everyday people. These custom selected people will record their thoughts for you to listen to as you watch them navigate your site. I was shocked and amazed at the things I learned.

Subscribe E-alerts and RSS feeds

Contribute Write a blog post, post a job or event, recommend a resource

Partner with Us Are you an institution looking to increase your impact?

Tweets by @Research2Action

Most Recent Posts

  • Grants acquisition and fundraising strategies: Some basic rules
  • Head of Africa Engagement: Girls Not Brides, Nairobi – Deadline 31 March
  • Dashboard: Communicating complex data clearly
  • Research Director, GiveDirectly – Deadline: 14 February, 2021
  • Strategies to integrate research evidence into policy and system decision-making

This Week's Most Read

  • What do we mean by ‘impact’?
  • Policymaker, policy maker, or policy-maker?
  • How to write actionable policy recommendations
  • Gap analysis for literature reviews and advancing useful knowledge
  • Outcome Mapping: A Basic Introduction
  • Stakeholder Analysis: A basic introduction
  • Three ways that knowledge brokers can strengthen the impact of scientific research
  • Top tips: Writing newspaper opinion pieces
  • How does policy change happen?
  • Synthetic literature reviews: An introduction

About Us

Research to Action (R2A) is a website catering for the strategic and practical needs of people trying to improve the uptake of development research, in particular those funded by DFID.

We have structured the site and populated it with material that we think will be immediately useful to this audience, but also to development researchers in general who would like to be more strategic and effective in their communications.

R2A is produced by a small editorial team, led by CommsConsult. We welcome suggestions for and contributions to the site.

  • Home
  • About Us
  • Cookies
  • Contribute

Our contributors

  • Paula FrayPaula Fray
  • Shubha JayaramShubha Jayaram
  • AvatarSue Martin
  • Maria BalarinMaria Balarin
  • James HarveyJames Harvey
  • Emily HayterEmily Hayter
  • Susan KoshySusan Koshy
  • Ronald MunatsiRonald Munatsi
  • Ajoy DattaAjoy Datta

Browse all authors

Friends and partners

  • AuthorAid
  • Global Development Network (GDN)
  • INASP
  • Institute of Development Studies (IDS)
  • International Initiative for Impact Evaluation (3ie)
  • ODI RAPID
  • On Think Tanks
  • Politics & Ideas
  • Research for Development (R4D)
  • Research Impact

Copyright © 2021 Research to Action. All rights reserved. Log in

This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish. Read MoreCookie settingsACCEPT
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are as essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Non-necessary

Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.

SAVE & ACCEPT