Eriol and Kelsey
Dec 6, 2021
Please welcome Eriol Fox and Kelsey Smith, @erioldoesdesign & @klsyjnn with
@USABLE_tools - A project to provide design resources to open source tool teams
December 6th to 13th on @imakefoss
Interview: https://t.co/YHmk3GWcEd
@imakefoss is a Twitter rotation curation account. https://t.co/SnQFOUBlQv
Dec 6, 2021
The project @USABLE_tools is a collaboration between @Simplysecure, @WeAreOkthanks and @internews looking to build resources for #OSS tool teams to help them understand #design practices and how that can help them create more user centered tools.
Dec 6, 2021
We’re focusing on #usertesting #usability testing in #OSS this week. Highlighting our ‘user testing can be fun’ resource, built as an interactive ‘game’ (in @twine thanks Twine!) so you can follow through with our coder squirrel Hex đżď¸ as they learn all about user testing.
Dec 6, 2021
You can play the game on the Usable tools https://t.co/9dM3DEYLS6 page https://t.co/DctNEi5kbj User testing is based in conversation and interactions with your tool/software users so we wanted a similar way to engage with the concept, so, a clickable story based guide!
Dec 6, 2021
You can also find the HTML files and issue tracker (for bugs) here on GitHub https://t.co/6skd4d51BC
Dec 6, 2021
We wanted to make sure that others who have ideas, stories, tips and resources to offer around user testing in OSS can add them as issues or add to the HTML Twine code themselves - after all co-creation across multiple perspectives in OSS is what makes it great :)
Dec 6, 2021
Hi there #imakefoss community! It’s @EriolDoesDesign and @klsyjnn here from @simplysecureorg under a collective alias know as Hex (the đżď¸ squirrel) we’ll be co-tweeting this week about a project we’re working on called @USABLE_tools.
Dec 6, 2021
@EriolDoesDesign @klsyjnn @simplysecureorg @USABLE_tools (Updated this tweet with ‘correct’ twitter links 𤌠mistakes happen! haha)
Dec 6, 2021
So youâll be greeted at the start of the game by our forest critters, Hex the squirrel đżď¸ developer and Pixel the skunk 𦨠designer. Hex is here to ask all the questions developers might have about user testing in their OSS tool. https://t.co/Ce6vRUh3Zd
Dec 6, 2021
Alt text: The game title screen shows Pixel the skunk and hex the squirrel and the text âUsability Testing can be fun! An FAQ for small open source teamsâ These are some common questions we see about user testing.
Dec 6, 2021
Hex asks: What is user testing and usability testing?
Pixel answers: User testing and usability testing improves the design, leading to a better experience for your users. https://t.co/214m1qU7ny
Dec 6, 2021
@twine Oops the twine account is actually @twinethreads sorry Twine!
Dec 6, 2021
Hex asks: But whatâs involved in user testing and usability testing?
Pixel answers: Thereâs a few stages included in user testing and usability testing, letâs look at them now! https://t.co/15TsqrxPwt
Dec 6, 2021
Pixel explains: First thereâs deciding what youâll test. We’ll be covering this in detail in the next few days. If all these acorns are âbacklogâ issues, choosing one to test is focused and achievable. https://t.co/kSIFY5yMWq
Dec 6, 2021
Pixel explains: Once youâve decided what to test, invite a handful of users to user test with you. Ideally 5 users, or as many as you can gather! Weâll talk more about recruiting users later this week. https://t.co/Cf7H8Or00s
Dec 6, 2021
Pixel explains: Watch them use your software one by one and write down what you observe about their behaviours, comments, and reactions. https://t.co/t9SxxgMeQr
Dec 6, 2021
Pixel explains: Identify the commonalities in what users say and do with your OSS tool/software. This activity is great to do as an OSS tool developer team. https://t.co/iou9dDWoMy
Dec 6, 2021
Pixel explains: Make improvements to your OSS tool/software. These now should be linked to tangible, visible user insight and feedback! https://t.co/5Zz2z2DQmK
Dec 6, 2021
Hex asked, what is user testing? So all together: Find a handful of users, watch them, note observations, identity commonalities, make improvements! https://t.co/abJH7LNtWR
Dec 6, 2021
Have you and your team tried user testing before? Tell us how it went!
Dec 7, 2021
Today weâre going to talk about the difference between user testing and the types of testing you might already do.
But first, what kinds of testing have you done on your #OSS ?
Dec 7, 2021
You might already have channels and communications for things like bugs, ideas, or questions. Thereâs a difference between collecting information ad-hoc and sitting down to clearly test a part of your OSS tool.
Dec 7, 2021
During a testing session, you see the issues as the user encounters them, instead of reading a ticket or forum post that could lack vital context.
Dec 7, 2021
During user testing, you can discover usability issues and bugs, but also learn about your usersâ motivations.
When you know your user better, you can make better, more inclusive software.
Dec 7, 2021
Hex asks: I already do a lot of testing, where does usability testing fit in?
Pixel answers: Well Hex, user testing helps you to improve the design and usability of your OSS, leading to a better experience for your users. For example⌠https://t.co/sVj1b1JGgB
Dec 7, 2021
Pixel explains: You can test a new design on a sketch pad, to avoid less user friendly features before you code. https://t.co/OfeUgGH1cZ
Dec 7, 2021
Pixel explains: You can find ways to improve the app with high impact and low effort. https://t.co/blbunTUC8s
Dec 7, 2021
Pixel explains: You can discover features that users expect to be there, but arenât. https://t.co/V6tTaFieja
Dec 7, 2021
Hex asks: We have a big backlog of issues and emails already! Why should I find more problems?
Pixel answers: Testing helps you understand the effect of a proposed change before investing time and money into building it. And thereâs more⌠https://t.co/gbwieSAwvn
Dec 7, 2021
Pixel explains: Testing can help you prioritize your backlog and find improvements that will make the biggest impact. https://t.co/tpvrGNPwgT
Dec 7, 2021
Pixel explains: You can find out what are the most interesting or common issues amongst a particular user group. https://t.co/0tOOrKFRJj
Dec 7, 2021
Pixel explains: You get to control who your target users are, rather than the loudest voices on the mailing list. https://t.co/kFMjx4oSyK
Dec 7, 2021
As we close out day 2 of our takeover donât forget to give our FAQ/Guide/Game a try!
You can find it playable from your browser here: https://t.co/DctNEi5kbj
And the code in a repository on GitHub: https://t.co/6skd4cNqK4
Dec 7, 2021
Eriol made a poll to gather some understanding of how closely your OSS backlog tasks are linked to user insight - take a look and give a reply :) https://t.co/6RV0fhbB6y
Dec 8, 2021
Good morning (or afternoon/evening depending on where you are)! Today weâre going to talk about how much time user testing typically takes.
Dec 8, 2021
Weâll also talk about making a decision on what to test and how to best use your time when conducting user tests. Because your time is precious and needs to work best for you, the OSS community, and your OSS toolâs needs.
Dec 8, 2021
Time is…difficult for everyone in OSS for deep and complicated reasons…mostly to do with, well…ensuring you can continue to live comfortably. Not many folks get to âmake a livingâ from OSS work and we recognise that.
Dec 8, 2021
User testing and usability should work within your means as an OSS contributor and community, thereâs always ways to make it achievable and a practical use of your time (as well as fun!)
Dec 8, 2021
Hex asks: How much time will this take? Iâm already very busy. Pixel answers: If you do usability testing before you put effort into code, you will save time. https://t.co/41adqiu2G7
Dec 8, 2021
Pixel explains: Make it a habit. For example, you could designate one evening a month for testing. https://t.co/BoCNF1A6vD
Dec 8, 2021
Pixel explains: Or, how about when you’re at a conference, hackerspace, cafe, crafting event, workshop, rave, etc? Where your community of users already are! https://t.co/rnROo3mIro
Dec 8, 2021
Pixel explains: Even though 30-45 minutes is optimal, even 15 minutes of user testing can make an impact. https://t.co/urykKuPFmJ
Dec 8, 2021
Hex asks: What are we testing? Pixel answers: Pick a topic or experience that can be tested in 30-45 minutes. It takes practice to know what can be covered in that time. https://t.co/qMOb1VnIKM
Dec 8, 2021
Pixel explains: Do you have ideas for changes that youâre not yet 100% sure about? https://t.co/5sW9xCZP0M
Dec 8, 2021
Pixel explains: Test sketches on a piece of paper to understand the effect of a proposed change before you invest time into building it. https://t.co/dJFCYVoAOd
Dec 8, 2021
Pixel explains: For example, say you have these options of a ‘typical software’ youâd like to test: https://t.co/N4YPT5Bwwc
Dec 8, 2021
Pixel explains: The entire OSS would typically take well over 30-45 minutes to test. Being more specific will help! https://t.co/3OxbYLJMvC
Dec 8, 2021
Pixel explains: A time and date picker is small but is it uniquely different to generic time and date pickers to make it a worthwhile problem to investigate? https://t.co/zzBKs4a9qk
Dec 8, 2021
Pixel explains: Registration and login is often a critical part of tools/software and unless itâs complicated, could be tested in 30-45 mins. https://t.co/vnZwlbWZuO
Dec 8, 2021
Pixel explains: Testing your tutorials and onboarding is useful because you may have made assumptions about how users learn about your OSS tool or software. You can test your docs with users too! https://t.co/qdWKf0UC8J
Dec 8, 2021
So you should have a better idea of how to pick a topic to test and how much time it should take, along with why itâs good to test these topics and ideas with users before you invest time in code.
Dec 8, 2021
What kinds of topics have you tested with users? Has it helped you refine your ideas?
Dec 8, 2021
And the last poll to close out today:
Where do you find users to test with for your OSS projects? If none of the poll answer are correct, reply with where and how! :) https://t.co/bflXZCxDWQ
Dec 9, 2021
@simulo @EriolDoesDesign Agreed! We would love to see more open, longer diaries studies in OSS :)
Dec 9, 2021
Hello everyone, today we will talk about getting test participants and how to conduct a user test.
Dec 9, 2021
Youâre so close to your work - every once and a while you need someone to look at your software with a fresh perspective to see what you canât.
Dec 9, 2021
Hex asks: âHow can I make the testing representative?â
Pixel answers: The ideal number is five participants. With more than five, the results become redundant. But if you canât do five tests, thatâs ok! One test is better than zero tests. https://t.co/OHaIHAvmTB
Dec 9, 2021
Pixel explains: Itâs best to test with participants who represent your users. https://t.co/X9bA80QUky
Dec 9, 2021
Pixel explains: To recruit, get the word out! Advertise that youâre looking for participants, and let them know the basic details. Could you offer anything in exchange for participating? https://t.co/7quujj9A6i
Dec 9, 2021
When conducting a user test, openness, humility, and curiosity are important qualities to embrace.
Dec 9, 2021
Hex asks: Should I tell them how to use my software?
Pixel answers: So tempting! But hereâs what we recommend⌠https://t.co/bJtELMQfgu
Dec 9, 2021
Pixel explains: Try not to explain your software, correct their mistakes, or defend your choices. Your job is to observe and your participantâs job is to be honest. https://t.co/E6OIaPoxtf
Dec 9, 2021
Pixel explains: Use some time at the end of the session to clear up any misunderstandings. https://t.co/WvOqE9JzqY
Dec 9, 2021
We at @simplysecureorg use this resource all the time to help us get the most information out of a user test: https://t.co/4NdWS4udBg (Thanks @mollyclare !)
Dec 9, 2021
Today’s poll below via Eriol’s twitter!
Tell us about if you’ve explained your OSS to users and if you have concerns about doing user testing on your OSS? https://t.co/b4vH3NHBFJ
Dec 10, 2021
Wow, that week went quickly! Itâs our last day here for @imakefoss and weâve got one last topic to cover: What do you do after the user testing!
Dec 10, 2021
Hex asks: What do I do after the test? Pixel answers: Well, you (and your team) should find time to think through what you observed and ask yourselves these questions… https://t.co/xoksELHDsL
Dec 10, 2021
Pixel explains: Did you notice commonalities in what users said or experienced about the part of your OSS you were testing? https://t.co/cuQqzPeAOk
Dec 10, 2021
Pixel explains: Pay attention to which parts, processes and aspects of your OSS are confusing to your participants. https://t.co/D4kjh5QtkC
Dec 10, 2021
Pixel explains: But donât forget to also cover what worked well. Which parts were simple for users and easily understood? https://t.co/JAEMpQTosT
Dec 10, 2021
Pixel explains: These questions are part of a process called âsynthesisâ and there are many different ways to synthesize user insight from testing. https://t.co/l0npcqWpIv
Dec 10, 2021
Pixel explains: Next, youâll want to share with any other contributors and community members! Keep it short and answer these questions… https://t.co/NQ012Bd3Cj
Dec 10, 2021
Pixel explains: What did you do? Briefly outline and explain what you did. This helps everyone to understand the scope and what user testing is (and isnât). https://t.co/Jud59AOf9Z
Dec 10, 2021
Pixel explains: What are the interesting things you learned? Itâs great if you have some quotes from the test participants. https://t.co/gZ4gZZwkWM
Dec 10, 2021
Pixel explains: Finally… What are you going to do about it? What issues will be focussed on and why? Will you do more testing to dig into more detail? https://t.co/QI0tdpiWTZ
Dec 10, 2021
Thank you for spending the week with us! Weâve spoken briefly about one aspect of doing design in OSS (user testing and usability testing!) There are so many more kinds of design present in OSS that weâd need several weeks to cover them. đ
Dec 10, 2021
Weâd like to thank you for watching, listening, and remind you that you can check out the game version of our user testing resource here: https://t.co/DctNEimV2R
Dec 10, 2021
Thank you so much and let us know if you want to talk design in OSS 1-to-1. Have a great Friday! ~ @erioldoesdesign and @klsyjnn of @simplysecureorg for the @USABLE_tools project. Thanks to our collaborators @WeAreOkthanks and @internews