Add new page for collecting user testing participants

[mcturco]

Reason/Context

I think it would be beneficial if we were to start performing usability tests across our tools periodically to help us gather data that could lead to more grounded ideas for design improvements.

I have an idea to create a new page on the website that can explain the process of being a participant in a user research study and steps to get involved. And because we are open source, this page could also attract an audience of other product designers looking to make open source contributions or to maybe gain experience conducting a user research study. More contributors to add to our community in ways other than code!

I think to start, perhaps a simple introduction paragraph and contact form to sign-up to be a participant will be great. I believe contact form submissions are connected to mailchimp, so we can probably set it up the same way, unless someone has a better idea!

Then, we would add the link to this page in our slackbot welcome message for new slack members, social media, and maybe a call to action section somewhere on the homepage of the website.

Would love to know what others think about this idea!

Scope

• Create a research page to have participants sign up for the research study #1991
• Define research objectives #3205
• Identify our target audience #3206
• Create a set of questions for the survey and interview #3207
• Develop a research plan #1996
• Recruit participants for the study #1997
• Conduct usability tests and user interviews #1998
• Analyse and synthesize data #2000
• Propose and recommend design improvement #2002
• Create an online form for the participants #1995
• Implement the research page #1999
• Implement design improvements #2001

[boyney123]

Hey @mcturco

I think it would be beneficial if we were to start performing usability tests across our tools periodically to help us gather data that could lead to more grounded ideas for design improvements.

I think it's a great idea, the more feedback we have the better, what I'm slowly discovering is people will use our OSS tooling but probably mainly consume vs provide feedback. Any things we can explore to create feedback loops would be interesting, otherwise, it's use guessing all the time.

More contributors to add to our community in ways other than code!

Yeah, would be great to have that. If we get something going, I would be interested to see how we can measure this? Mainly out of curiosity more than anything, UX and designers open source would be pretty cool!

Another idea for feedback/data is telemetry data with our tools (anonymous). This means we could have usage of our tooling going to metrics somewhere where we could review what is going on. I've not really got much experience with tooling metrics like this, but I have seen other OOS projects do this (they ask you if it's OK before you engage with their tool, think NextJS do this). Just another idea...

[mcturco]

Hi @boyney123! And thanks for your feedback! 😄

what I'm slowly discovering is people will use our OSS tooling but probably mainly consume vs provide feedback. Any things we can explore to create feedback loops would be interesting, otherwise, it's use guessing all the time.

Yes and another interesting part of OSS is that sometimes the user IS the one who establishes a problem, has ideas to fix it, and then fixes it. But, if we could observe someone's emotions while they are using the product and carrying out tasks, we can determine what the pain points are and brainstorm how we can come up with solutions. You can get a lot of information from humans just by observing their body language and facial expressions, especially when it is in the moment!

If we get something going, I would be interested to see how we can measure this?

Do you mean see how many new members come from this new page? Yeah, I think maybe a good way to measure this is by adding the "Join on Github" "Join on Slack" buttons somewhere on this page and then we can measure the clicks there?

Another idea for feedback/data is telemetry data with our tools (anonymous). This means we could have usage of our tooling going to metrics somewhere where we could review what is going on.

I think if we could set something up in our tools to automatically gather user data, that would be great! This would be more quantitative research vs qualitative research, which is what I am looking for in doing the usability testing and user interviews. I think that this could be a great supplement to that to possibly back the visual data with numbers!

[derberg]

I think it would be nice if such document would be part of other documents that should belong under dedicated community subpage, where we talk about how to contribute, and user testing would simply be one of many ways people can contribute

[akshatnema]

@mcturco, Have you created any design in Figma related to this page? If not, no worries, I will love to work on Figma as well to design this page. And I am willing to work on the codebase to make this page on the website.

[mcturco]

Hi @akshatnema
I have not yet created a design for this page yet, but if you would like to help that would be great! I think the elements that we would need on this page would be as follows:

• Page title: User Research (or something similar)
• Slug: /user-research
• Intro paragraph: I can come up with the copy for this, but thinking of having something short that explains that we are looking for contributions in the form of design, conducting user research, and being a user research test participant (Maybe we can create a visual that lists these "ways to contribute" with icons?)
• Form to sign up to be a user research participant: Name, Email, Time zone

If you think of anything else that we can add to this page feel free to propose it!

[akshatnema]

@mcturco Yepp, this looks exactly what I thought of this page. I will look for some designs ( or make it one such myself 😄 ) in Figma first and will show you soon.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity 😴

It will be closed in 120 days if no further activity occurs. To unstale this issue, add a comment with a detailed explanation.

There can be many reasons why some specific issue has no activity. The most probable cause is lack of time, not lack of interest. AsyncAPI Initiative is a Linux Foundation project not owned by a single for-profit company. It is a community-driven initiative ruled under open governance model.

Let us figure out together how to push this issue forward. Connect with us through one of many communication channels we established here.

Thank you for your patience ❤️

[mcturco]

@magicmatatjahu @derberg @fmvilas can one of you help to remove the stale label on this issue? Thanks in advance!! 😄

[magicmatatjahu]

@mcturco Done :)

[mcturco]

@magicmatatjahu THANK YOU! 😄

[akshatnema]

@mcturco are we gonna still take forward this issue? We have designed the Figma file, almost ready with the basic layout of the page, only requiring what data and form need to be rendered there.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity 😴

It will be closed in 120 days if no further activity occurs. To unstale this issue, add a comment with a detailed explanation.

There can be many reasons why some specific issue has no activity. The most probable cause is lack of time, not lack of interest. AsyncAPI Initiative is a Linux Foundation project not owned by a single for-profit company. It is a community-driven initiative ruled under open governance model.

Let us figure out together how to push this issue forward. Connect with us through one of many communication channels we established here.

Thank you for your patience ❤️

[akshatnema]

@mcturco do we still need to implement this on the website?

[derberg]

I don't think we have anyone in the community that can drive this forward atm, so I suggest we close it for now and reopen whenever it is needed

[Mayaleeeee]

I'd love to work on this though @derberg , that's if it's still open.

[derberg]

@Mayaleeeee but you mean on design or something else? The problem here is not getting new sub page created, but actually coordinating user testing and everything around it.

There is a new bigger topic that needs fresh design - case studies, and not only -> #921. So if you are looking for a design topic, that has no concept now and no owner, this is the right one 😄 especially that use cases / case studies collection is one of the critical areas I wanna grow in the coming months

[Mayaleeeee]

Ohh... Okay, that's fine.
I'll check it out.

[derberg]

@Mayaleeeee lemme know if you need more details.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity 😴

It will be closed in 120 days if no further activity occurs. To unstale this issue, add a comment with a detailed explanation.

There can be many reasons why some specific issue has no activity. The most probable cause is lack of time, not lack of interest. AsyncAPI Initiative is a Linux Foundation project not owned by a single for-profit company. It is a community-driven initiative ruled under open governance model.

Let us figure out together how to push this issue forward. Connect with us through one of many communication channels we established here.

Thank you for your patience ❤️

[Mayaleeeee]

Hi @derberg @mcturco

I'm still very much interested in this issue, and I would love to take it up since I worked on something similar during my Outreachy internship. It will also help me improve my user research skills. Furthermore, understanding the problems our users face while using the AsyncAPI website will enable us to design a more user-friendly and accessible interface for them.

However, I do have a few questions, and I may have more in the future.

• Will the usability testing be conducted remotely?

• Has the design been implemented on the website?

• What exactly do we intend to achieve with the usability testing?

• Is there anything else I need to know? Please feel free to discuss it with me.

[mcturco]

Hey @Mayaleeeee, thanks for your interest in this issue! Answers to your questions below:

Will the usability testing be conducted remotely?

Yes, via zoom

Has the design been implemented on the website?

No, we will still need a design proposal for this new page and an idea of where to offer the survey via the homepage.

What exactly do we intend to achieve with the usability testing?

Think of this as a way to gather a pool of users that would be interested in participating in a UX study. It doesn't have to be limited to usability testing, but we can put together a list of basic questions like:

• Company and size
• How did you find AsyncAPI
• What is your role
• What tools are you using to adopt AsyncAPI into your workflow
• What tools do you still need in order to adopt AsyncAPI in your workflow

And other questions if needed. This part is important because then you can group the users based on the study you are conducting.

Let me know if you have any other questions, but I would start first with the questions we are going to ask and then we can lay this out in a form on the website. We could also just create a form using Google Forms or others and just have that linked on the website. Whatever makes the most sense for implementation.

[derberg]

just a hint from my side that @AceTheCreator got a pretty good experience with online forms (added them to conference.asyncapi.com) so adding one for user testing should not be that hard. Just a small note

[Mayaleeeee]

Thanks, @mcturco, but could you please clarify the study's specific research objectives or goals? I would like to ensure that I clearly understand what we aim to achieve through this research. For the usability tests, you've already mentioned the objectives above; I wonder if we have more, though.

[Miracle56u]

Okay

[Miracle56u]

How to Participate
We can outline the different ways to contribute as a Participant or User Experience Researcher. Under this section, we can have two headers. The first header will explain what a participant in the study will do and include a picture of user research participants. We can add a CTA button that says "Become a Participant". The second header will be "UXR Contributor" and follow the same format with a CTA "Contribute as a UXR".

Mayaleee,
Please I'll need more information as touching this section,
What are the participants expected to do in the study and UXR contributor?
Also benefits for participants, you said we are going to represent that with icons.

[Mayaleeeee]

How to Participate
We can outline the different ways to contribute as a Participant or User Experience Researcher. Under this section, we can have two headers. The first header will explain what a participant in the study will do and include a picture of user research participants. We can add a CTA button that says "Become a Participant". The second header will be "UXR Contributor" and follow the same format with a CTA "Contribute as a UXR".

Mayaleee,
Please I'll need more information as touching this section,
What are the participants expected to do in the study and UXR contributor?

The participants are the users who will interact with and evaluate our website.

The UXR contributors are those interested in contributing to AsyncAPI research. Just like we have design contributors, we need more user research contributors as well

Also benefits for participants, you said we are going to represent that with icons.

For the benefits, we could have

Contributing to Knowledge
Compensation
Making a difference

[Miracle56u]

Okay.
How about the "How to participate"?
Is it like a guide or something

[Miracle56u]

How do we structure it?
What are the steps to be captured

[Mayaleeeee]

How do we structure it? What are the steps to be captured

Miracle, I will reply to this tomorrow.
Thank you so much for your work on the design.

[Miracle56u]

It's okay Mayaleeee!
I appreciate.
Beautiful morning to you, that's if it's morning at your end.

[Mayaleeeee]

Hi @Miracle56u, I hope you're doing well. Do you have any updates on the design you are working on? Have you encountered any difficulties? I recall you mentioning you would share a draft with me, but I am still waiting to receive it.

Please don't feel pressured; I just wanted to see if you have any updates.

[Mayaleeeee]

Okay. How about the "How to participate"? Is it like a guide or something

Yeah.

The guide will explain how to participate and get involved. Don't worry about the details yet - the main focus is to complete the design, and we can brainstorm the wording later.

[Miracle56u]

How do we structure it? What are the steps to be captured

Miracle, I will reply to this tomorrow. Thank you so much for your work on the design.

Good morning Mayalee.
Trust you are doing great.
Haven't heard from you as promised
I want to believe you are okay!

[Mayaleeeee]

Okay. How about the "How to participate"? Is it like a guide or something

Yeah.

The guide will explain how to participate and get involved. Don't worry about the details yet - the main focus is to complete the design, and we can brainstorm the wording later.

Hello @Miracle56u
I have replied to your message here. 🙂

[Miracle56u]

Greetings Mayaleeee
Sure you are doing great.
I'm still expecting your feedback as touching the design I sent to you, to know if I'm on the right direction.
Thank you so much.

[reachaadrika]

@Mayaleeeee I would love to build this page for the website, if the designs are ready ?

[Mayaleeeee]

@Mayaleeeee I would love to build this page for the website if the designs are ready.

Alright, @reachaadrika, I will let you know when it's ready.
Thank you.

[naina35]

@Mayaleeeee I would love to build this page for the website, if the designs are ready ?

i would love to help and contribute

[Mayaleeeee]

@Mayaleeeee I would love to build this page for the website, if the designs are ready ?

i would love to help and contribute

Thank you, @naina35. Could you please clarify if you are referring to the design aspect?

[Mayaleeeee]

Greetings Mayaleeee Sure you are doing great. I'm still expecting your feedback as touching the design I sent to you, to know if I'm on the right direction. Thank you so much.

Hello @Miracle56u Any update on the design?

[sambhavgupta0705]

hey @Miracle56u any update on this feature

[Mayaleeeee]

Hello everyone, this project is on hold, and I plan to propose it for our next mentorship program.

Thank you.

[sambhavgupta0705]

@Mayaleeeee I think first we should carry out our discussion here and then open issue as issues are there from 2 years there has been no to little progress on them

[sambhavgupta0705]

We can discuss this issue in the upcoming design meet

[Mayaleeeee]

@Mayaleeeee I think first we should carry out our discussion here and then open issue as issues are there from 2 years there has been no to little progress on them

@sambhavgupta0705
Thanks for your message. I’m not sure which issue you’re referring to. Could you please specify the issue you have in mind? I want to make sure I understand the discussion.

[Mayaleeeee]

We can discuss this issue in the upcoming design meet

@sambhavgupta0705
Thank you for your suggestion. I’m currently focused on the agenda for the upcoming meeting, which I’ve been preparing for extensively. Also, I am not fully clear on what aspects of the issue you’d like to discuss, and I feel it would be more productive to address this in a separate meeting where we can dedicate proper time and attention. I hope you understand.