/
WCCC Selector Mock Training/Testing Feedback

WCCC Selector Mock Training/Testing Feedback

Owned by Elizabeth Seyler
Last updated: Apr 03, 2025
4 min read

04-01-2025

Attending: Cora Rose Bobo-Shisler, Victoria Ackroyd, Shannon Mitchell, Marguerite Dibble, Elizabeth Seyler

Mock Facilitator Training

  • Shannon gives an overview of the purpose of testing.

  • Was it helpful to have the document in advance? - There was a bug opening the tool link in firefox

  • Facilitators should make sure to use the “Develop” link

  • Complete the facilitator form ahead of testing to walk through what that will feel like.

  • Elizabeth will update the form to ensure people can submit multiple responses

  • Cora didn’t realize how the browse cover crop flow worked, so mentioning that to other facilitators would be good.

  • Cora also glad to see how to get to the selected crops and the comparison view.

  • Cora will check about updates on recruiting & who will test

  • How to communicate the testers? → Email Marguerite & Elizabeth so we can have a tracker

  • This looks great! The way it’s laid out is very helpful, it answers so many of my questions for me. Excited to try for the mock test and see how it goes. The biggest part is the narrative and seeing how I approach interacting with people

  • encourage people to narrate their experience as they’re going through (added to the brief)

  • Based on how it goes with Victoria, we might make tweaks before the Monday testing.

  • Victoria may have small interruptions during the mock testing session.

  • Are their options to record sessions tomorrow? → we can, Elizabeth will

    • Cora would like to see how it looks → invited for tomorrow

04-02-2025

Session 1: Attending: Clint Mattox (Oregon), Victoria Ackroyd (facilitator), Juliet Norton, Shannon Mitchell, Marguerite Dibble, Elizabeth Seyler, who recorded it on Teams.

Elizabeth’s notes for Facil Training: 

  • Good that Victoria prompted him to look for data source based on her own knowledge. Do you see anything on the page that may answer your question about data sources?

  • Good that Victoria first asked for general feedback, and if respondent didn’t see the filters, she prompted him to look at them.

  • Very helpful if respondent thinks out loud: “I’m not sure where to go or what to do. What will happen next?”

  • Good Victoria Q: Is there anything you can hover over that will help you understand?

  • Good redirect by V: Let’s redirect away from the data for now and return to thoughts on the design/page items.

  • V does good job managing the time

  • Ask whether any species are missing.

  • Tempting to ask all questions at once, but try to split into two or three questions, unless the respondent answers some on their own.

  • Add the four ecoregions to the question near end of Facil Form–ask which region they’re in? Are the regions already listed? I think so

  • Could delete “is there anything else you want us to know?” bc he will then be filling out a survey with the same info?...

  • Res Survey:

    • Q 16 and Q19 fix wording

    • Q 21 and Q 20 fix wording (or thereabouts)

  • When inviting respondents to a testing session, use Zoom or, if using Teams, be sure to use a laptop AND a monitor so that you may fill out the Facil Form while viewing the shared screen of respondent.

  • Shannon: provide more context? The script is there for support, not a hard guide. Do what you want to keep the session flowing. Can you tell me about what you’re thinking or trying or wanting? Then say “let’s try this” then “was that clear or not clear?” What’s your thought process right now? What are you looking for? What’s coming up for you?” Cheat sheet: here are some prompts you can use if conversation is dragging.

  • Victoria: likes the materials. Part of it is practice and some is the respondents themselves. 

  • Silence is fine and good. 

  • Reassure the respondent as they go–this is great feedback.

@Shannon Mitchell @Marguerite Dibble While Victoria was recording feedback in the Facilitator Form, Juliet and I were compiling a list of bugs and design issues. Juliet created GitHub tickets for the bugs. See her WCCC User Testing doc for the design issues (which may complement Victoria’s notes) to consider once testing is complete.

Session 2: Attending: Sri Pinnamaneni (respondent), Victoria Ackroyd (facilitator), Shannon Mitchell, Elizabeth Seyler. Recorded in Victoria’s Zoom: https://www.zoomgov.com/rec/share/fecax4CA8gnY4Eyld3KxAKri0dT_zcuUv6nL2KQFmqwkLGq3OhA3jkK1OpcSHXFq.ORJ76s7meKVIiGDv
Passcode: f9v%N&BK

Shannon’s notes:

  • Add a request to screenshare to the script.

  • Do we need direction on what to do with the popup?

  • Describe which page the “home page” is

  • encourage facilitators to take questions 1 by 1 not all at once. Make sure people are speaking to what the feedback is used for

  • Encourage respondents to explore for a moment or two before asking questions, encourage them to enter in whatever they think is right for their area.

  • Include a disclaimer about the data at the start

  • Let people know we’re specifically looking to learn about what works for the west

  • Tell people to use the tool

  • maybe adjust the questions to ask for narration? Is there anything you notice that feels like its missing or needed? Tell us what you think?
    - or flip it to “We’re curious to hear if this page feels like it has what’s needed to support people in the west, is there anything that feels like it’s missing or needed?

  • Design idea: Should we have some callouts on the infosheet → “Looking for seeding rates? try out our seeding rate calculate HERE”

  • Design Idea: Could info sheet be searchable

  • Change question to “Do you use another tool or factor for __? If so how does this compare?”

  • Should we have a dropdown for eco-region? do we have that already?

  • Unclear on the “how do you use the land” question → maybe add examples.

  • Cheat sheet → if it gets awkward here are some prompts

Elizabeth’s notes:

  • Try to ask one question at a time. Makes it easier for people to answer.

  • If they’ve completely missed key elements (such as the polygon tool), point them out and ask if user understands what they mean.

Next Steps:

  • Elizabeth updating the Facilitator Brief and Facilitator Form to reflect mock testing discoveries.

  • Shannon and Marguerite will review said changes

  • Elizabeth will send materials to Nick before Monday meeting for review before mock testing that day

 

Related content