End-user research needed

[reillyeon]

The "User research" section is based on feedback from developers, not end-users. To build a solution we need to understand how users will respond to developers using this proposed API and what their mental model is for sharing ML models between origins.

[tomayac]

In order to address this Issue, I've started to draft a user experience research survey that I hope we can refine over the next few days and then ultimately send out to users. @christianliebel, @beaufortfrancois, @reillyeon, @jyasskin, and @yashrajbharti, you all have edit access to the current version. Feel free to make changes directly, or just send feedback here on the thread.

Once we are happy, I plan on asking for feedback on the survey from or Chrome User Experience Research folks, but I thought we should have a first round of feedback ourselves based on joint swarm common sense…

For the demographics section, I'm not super sure myself whether we should (or are allowed to) ask for things like age or identified-with gender, but I'm sure there's someone out there who knows what we commonly do.

[yashrajbharti]

I went through the set of questions and have a few of mine which could potentially be helpful:

UX Related:

1. Would you prefer browser settings to allow automatic approvals for trusted sites to reduce interruptions?

   • Yes
   • No
   • I'm not sure

2. How do you usually interact with permission prompts on websites?

   • I read them carefully before deciding
   • I usually click "Allow" without reading
   • I usually click "Deny" to be safe
   • I am not sure

3. Have you ever accidentally accepted or denied a permission prompt due to unclear wording or design?

   • Yes
   • No
   • I'm not sure

4. What improvements do you think would make COS permission prompts easier to understand? (Open-ended)

Demographic questions (I am too not sure if we are allowed to ask gender, but if we do, it must be optional):

1. What is your age group?

   • Under 18
   • 18–24
   • 25–34
   • 35–44
   • 45–54
   • 55+
   • Prefer not to say

2. What is your gender? (optional)

   • Male
   • Female
   • Non-binary
   • Prefer not to say
   • Other (please specify)

3. Do you work in a technical field (e.g., software development, IT, UX design, etc.)?

   • Yes
   • No

4. Do you frequently use websites that store and process large files (e.g., an AI model, a game engine, or a database)?

   • Yes, daily
   • Yes, sometimes
   • Rarely
   • Never

Accessibility Concerns:

1. Do you use any assistive technologies (e.g., screen readers, voice control, keyboard navigation) while browsing the web?

   • Yes
   • No
   • Prefer not to say

2. Have you ever faced difficulties interacting with permission prompts due to accessibility issues?

   • Yes, often
   • Sometimes
   • No, never

Some edits (I fixed a typo in the form, but I felt other edits are better to be asked in this thread):

This question can be a checkbox allowing multiple correct options.

---

Here, we can add another option: "Reason the website wants to access it"

---

A similar question can be asked:

If a trusted website (e.g., your bank or a government site) asks for shared storage access, would you be more likely to grant it than an unknown website?

• Yes
• No
• I'm not sure

Also, If one of the goals for the end-user research is to understand mental models, we can ask these:

Trust & Mental Models:

1. How much do you trust your web browser to manage shared files securely?

   • Completely trust it
     ( a 1 through 5)
   • Completely distrust it

2. When a website requests to access a file from another website, what do you assume is happening? (Open-ended)

Would love to add / discuss further any that apply.

[tomayac]

To the Googlers on this Issue thread, I found a great document with UXR best practices for survey design and a demographic question bank. (Sorry non-Googlers.)