Benchmarking task flows of data points [by conducting a comparative analysis of CKAN websites]

[Aparna1Gopal]

Overview

• Identify all existing data points across CKAN websites (both Government & Enterprise) for benchmarking
• Conduct a gap analysis of existing current AtD website (pre CKAN additions)
• Related to Issue: Website User Flows and Wireflows Website User Flows and Wireflows #145

Action Items

Comparative Analysis of CKAN websites

• Identify standard template / best practice for such analysis
• Open new project in Dovetail software to conduct this visual analysis
• Formulate Research Plan
• Send Research Plan to PMs for feedback
• Revise Research Plan based on feedback
• Set-up study (in Dovetail & Figma)
• Conduct Comparative analysis of 5 CKAN websites
• Identify the data points & best practices across selected 5 CKAN websites
• Compare & contrast the identified best practices with the existing ATD website
• Identify gaps in the ATD website
• Create research findings presentation
• Present research insights & recommendations to the team, stakeholders, and the organization
• Review & revise changes based on feedback

Documentation

• Work with UX designer to have the data content updated into the latest version of Figma Reorganize Home Page #255
• Complete & Update Wiki
• Review with PMs & close issue

Resources/Instructions

Selecting UX RESEARCH METHODS
Research Plan for UX studies
Usability Testing: Gap Analysis
Inclusive Design and Accessibility
Usability Testing: First Click Tests
Sample Size: Selecting the right sample size in your UX Research
Likert Scale
Competitive/Comparative Spreadsheet for Website Template

Google Drive

Wiki

TEMPLATE FOR PROJECT PROGRESS

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Blockers: "Difficulties or errors encountered."
Availability: "How much time will you have this week to work on this issue?"
ETA: "When do you expect this issue to be completed?"
Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

ask for help at your next meeting
put a "Status: Help Wanted" label on your issue and pull request
put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"

Working on the following related Issues: (Research resources and progress are interconnected)
#191
#192
Website User Flows and Wireflows #145
Currently set up GitHub issues and relevant resources to start on the Research Plan and proceed.

Blockers: "Difficulties or errors encountered."
None, as have met with PMs last week to streamline steps related to the product pivot

Availability: "How much time will you have this week to work on this issue?"
6-10 hours

ETA: "When do you expect this issue to be completed?"
Ongoing
Plan on completing Research Plans for all three above issues this week and create the survey design draft copy for #191

Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

ask for help at your next meeting
put a "Status: Help Wanted" label on your issue and pull request
put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Notes

Resources: Gap Analysis

UX MATURITY GAP ANALYSIS
Benchmark your UX operation against global best practices

https://www.humanfactors.com/uxsupport/ux_maturity_gap_analysis.asp?utm_medium=email&utm_source=Act-On%20Software&utm_content=email&utm_campaign=Avoid%20the%2024%20perils%20that%20derail%20UX%20Maturity&utm_term=Learn%20more%20about%20the%20UX%20Maturity%20Gap%20Analysis&utm_medium=email&utm_source=Act-On%20Software&utm_content=email&utm_campaign=Avoid%20the%2024%20perils%20that%20derail%20UX%20Maturity&utm_term=Learn%20more%20about%20the%20UX%20Maturity%20Gap%20Analysis

Gap analysis
https://www.designmethods.co.uk/ux-strategy/gap-analysis

GSoD 2021: Perl’s Content Audit and Gap Analysis uxplanet.org
https://uxplanet.org/tagged/gap-analysis

Unbridged Knowledge Gaps Hurt UX
https://www.nngroup.com/articles/unbridged-knowledge-gaps/

Resources: SWOT Analysis

https://www.uxpin.com/studio/blog/competitive-analysis-for-ux/

Resources: Competitive Analysis

https://careerfoundry.com/en/blog/ux-design/competitive-analysis-ux/

https://xd.adobe.com/ideas/process/user-research/guide-to-competitive-analysis-ux-design/

https://uxdesign.cc/going-beyond-the-classic-competitive-analysis-matrix-a-ux-case-study-549c2e7e05b8

[Aparna1Gopal]

Notes

Steps for Research Plan

• Formulate Research Plan (includes gap analysis of selected CKAN and existing ATD Prototype)
• Aim: Identify and obtain industry best practices and benchmarking
• Conduct SWOT Analysis on Excel/Figma/Miro,using existing industry standards and framework
• Conduct Accessibility Audit on Excel/Figma/Miro, using existing industry standards and framework (i.e. WCAG 2.1)
• First Click Tests
• Design the survey attached to the CKAN websites (to identify the user type - data expert/novice) (Recorded in the Research Plan)
• Embed Usability Hub for first click testing of CKAN websites, for automated quantitative usability testing
• Recruit external research participants using existing Slack channels
• Data Collection (over 2-3 weeks for preliminary analytics,across 10-20 external users and research participants)
• Analyze data for best practices using Dovetail (qualitative data and marking)
• Draft User Journey Maps/ Empathy Maps/ Affinity Maps (based on specific user personas)
• Research Findings: Identify the Benchmarking criteria, Best Practices for AtD's website redesign (based on existing CKAN)
• Present results & findings to ATD Team using Canva or Google Slides

[Aparna1Gopal]

Notes

• The dependent issue Competitive analysis (unmoderated usability testing) of CKAN websites - Userflows  #191 is currently collecting automated data (for the next 4-5 weeks)

• In the meantime, this dependent issue is being worked on Benchmarking task flows of data points [by conducting a comparative analysis of CKAN websites] #192, to triangulate with above issue

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"

• Based on Slack communication with PM Lucy C, currently working on this issue while the dependent issue Competitive analysis (unmoderated usability testing) of CKAN websites - Userflows  #191 collects data

• Cleaned up the Action items and getting it ready to launch the research with projected timelines

• Formulating the Research Plan

Blockers: "Difficulties or errors encountered."
None

Availability: "How much time will you have this week to work on this issue?"
6 hours

ETA: "When do you expect this issue to be completed?"
4-5 weeks

Pictures: "Add any pictures of the visual changes made to the site so far."
N/A
If you need help, be sure to either:

ask for help at your next meeting
put a "Status: Help Wanted" label on your issue and pull request
put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Formulating Research Plan

Blockers: "Difficulties or errors encountered."
None
(Will be seeking feedback from PMs and UX Leads once Research Plan is complete)

Availability: "How much time will you have this week to work on this issue?"
6 hours

ETA: "When do you expect this issue to be completed?"
Please check projected Timeline under Action Items

Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

ask for help at your next meeting
put a "Status: Help Wanted" label on your issue and pull request
put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Notes:

SWOT versus Gap Analysis

SWOT has a set framework, whereas a gap analysis can be what you make it

The SWOT analysis uses a simple four-block grid framework to help managers visualize their business from four set perspectives. Although every SWOT analysis is a bit different — with varying outcomes and conclusions — the structure is always the same: strengths, weaknesses, opportunities, and threats.

SWOT is great for organizations starting out, while a gap analysis is great anywhere, anytime
Another way that SWOT and gap analyses differ is in when they are best put to use. As a sweeping, big-picture analysis, a SWOT analysis is a great tool for businesses just starting out or when assessing the viability of a new business idea. It’s also appropriate when a business is looking to pivot in another direction or enter a new market.

Although an organization can easily adapt a SWOT analysis for any kind of process or project — even smaller ones — it’s particularly useful when a company is trying to understand its position and potential with a bird’s-eye perspective of the business landscape.

[Aparna1Gopal]

@mxajPrice An FYI, I have currently been working on this issue #192 as I await the data collection on dependent issue #191

Hence, I am moving #192 back into in progress.

And moving #191 into prioritized backlog for its current data collection duration.

CC: @lrchang2

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"

Tasks currently working on:

• Formulating Research Plan
• Transferring research questions/ interview script to UsabilityHub
• Receive feedback from PMs and Project Leads
• Pilot test the Usability Hub unmoderated test
• Receive feedback from pilot test, revise and have it ready for external participant recruitment via Slack

Blockers: "Difficulties or errors encountered."
None
(Will be seeking feedback from PMs and UX/Dev Leads once Research Plan is complete)

Availability: "How much time will you have this week to work on this issue?"
6 hours

ETA: "When do you expect this issue to be completed?"
Please check projected Timeline under Action Items

Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

ask for help at your next meeting
put a "Status: Help Wanted" label on your issue and pull request
put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"

Tasks currently working on:

• Formulating draft of Research Plan
• Circulate Research Plan amongst PMs for feedback
• Transferring research questions/ interview script to UsabilityHub
• Finalize Research Plan after receiving feedback from PMs and Project Leads
• Pilot test the Usability Hub unmoderated test
• Receive feedback from pilot test, revise and have it ready for external participant recruitment via Slack

Blockers: "Difficulties or errors encountered."
None
(Will be seeking feedback from PMs and UX/Dev Leads once Research Plan is complete)

Availability: "How much time will you have this week to work on this issue?"
6 hours

ETA: "When do you expect this issue to be completed?"
Please check projected Timeline under Action Items

Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

ask for help at your next meeting
put a "Status: Help Wanted" label on your issue and pull request
put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"

Tasks currently working on:

• Formulating draft of Research Plan
• Circulate Research Plan amongst PMs for feedback
• Transferring research questions/ interview script to UsabilityHub
• Finalize Research Plan after receiving feedback from PMs and Project Leads
• Pilot test the Usability Hub unmoderated test
• Receive feedback from pilot test, revise and have it ready for external participant recruitment via Slack

Blockers: "Difficulties or errors encountered."
None
(Will be seeking feedback from PMs and UX/Dev Leads once Research Plan is complete)

Availability: "How much time will you have this week to work on this issue?"
6 hours

ETA: "When do you expect this issue to be completed?"
Please check projected Timeline under Action Items

Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

ask for help at your next meeting
put a "Status: Help Wanted" label on your issue and pull request
put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Set up the study in Dovetail to start collecting & analysing the data
Working through the 5 CKANs

Blockers: "Difficulties or errors encountered."
None

Availability: "How much time will you have this week to work on this issue?"
4-6 hours

ETA: "When do you expect this issue to be completed?"
1 week

[Aparna1Gopal]

Notes: @Aparna1Gopal
#191 (comment)

Competitor websites identified based on PMs' product vision. Contacted PM (Lucy C & AJ) via Slack. Below are the websites to be tested on:

https://africaopendata.org/
https://hri.fi/en_gb/
https://data.gov/
https://data.humdata.org/

I am going to be adding https://data.gov.sg/, as well due to their active use of iconography/favicons on their website.

[lrchang2]

@Aparna1Gopal Please add update using this template (even if you have a pull request)

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Blockers: "Difficulties or errors encountered."
Availability: "How much time will you have this week to work on this issue?"
ETA: "When do you expect this issue to be completed?"
Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

1. ask for help at your next meeting
2. put a "Status: Help Wanted" label on your issue and pull request
3. put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"

• Working through analysing the 5 CKANs using Excel & Dovetail
• Comparing & contrasting with current version of ATD website

Blockers: "Difficulties or errors encountered."
None
Just taking more time than planned as the CKAN websites are dense

Availability: "How much time will you have this week to work on this issue?"
4-6 hours

ETA: "When do you expect this issue to be completed?"
1 week

[lrchang2]

@Aparna1Gopal
Please add update using this template (even if you have a pull request)

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Blockers: "Difficulties or errors encountered."
Availability: "How much time will you have this week to work on this issue?"
ETA: "When do you expect this issue to be completed?"
Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

1. ask for help at your next meeting
2. put a "Status: Help Wanted" label on your issue and pull request
3. put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Completed: Completed the data collection across 3 CKAN websites on Dovetail
Left to do: Data collection across 2 CKAN websites, compare & contrast with ATD Website, complete the report

Blockers: "Difficulties or errors encountered."
The websites are dense so picking & choosing which aspects to collect & analyse. Based on last week's team meeting, only focusing on the aspects that aligns with ATD's vision.

Availability: "How much time will you have this week to work on this issue?"
4-6 hours

ETA: "When do you expect this issue to be completed?"
1 week

Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

ask for help at your next meeting
put a "Status: Help Wanted" label on your issue and pull request
put up a request for assistance on the #access-the-data channel.

[lrchang2]

@Aparna1Gopal
Please add update using this template (even if you have a pull request)

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Blockers: "Difficulties or errors encountered."
Availability: "How much time will you have this week to work on this issue?"
ETA: "When do you expect this issue to be completed?"
Pictures: "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either:

1. ask for help at your next meeting
2. put a "Status: Help Wanted" label on your issue and pull request
3. put up a request for assistance on the #access-the-data channel.

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Completed: Data Collection - Completed the data collection across 5 CKAN websites on Dovetail. Used the elements on CKAN closest to current ATD prototype to compare.
Left to do: Data Analysis (thematic analysis), compare & contrast with ATD Website, complete the report
Also met with 311-data PM team to discuss ATD's Comparative analysis strategy (knowledge transfer)

Blockers: "Difficulties or errors encountered."
Nothing in particular. Just sorting through the different CKANs.

Availability: "How much time will you have this week to work on this issue?"
4-6 hours

ETA: "When do you expect this issue to be completed?"
1 week
Presenting draft of the report next week at team meeting

Pictures: "Add any pictures of the visual changes made to the site so far."

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"

• Completed: Data Collection - Completed the data collection across 5 CKAN websites on Dovetail. Used the elements on CKAN closest to current ATD prototype to compare.

• Left to do: Data Analysis (thematic analysis), compare & contrast with ATD Website, complete the report

• Added another CKAN website to the Analysis (opendata.swiss). Based on last week's team meeting & this website serving as a good example of a potential CKAN to replicate for ATD.

Blockers: "Difficulties or errors encountered."
Nothing in particular. Just sorting through the different CKANs.

Availability: "How much time will you have this week to work on this issue?"
4-6 hours

ETA: "When do you expect this issue to be completed?"
1-2 weeks
Working on draft of Research results & findings

Pictures: "Add any pictures of the visual changes made to the site so far."

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"

Completed: Data Collection - Completed the data collection across 6 CKAN websites on Dovetail. Used the elements on CKAN closest to current ATD prototype to compare. Added another CKAN website to the Analysis (opendata.swiss). Based on team meeting consensus, this website serves as a good example of a potential CKAN to replicate for ATD.

Left to do: Data Analysis (thematic analysis), compare & contrast with ATD Website, complete the report.
Towards the end of the analysis & putting together the draft report. Working on draft of Research results & findings.

Blockers: "Difficulties or errors encountered."
None

Availability: "How much time will you have this week to work on this issue?"
4-6 hours

ETA: "When do you expect this issue to be completed?"
1 week

Pictures: "Add any pictures of the visual changes made to the site so far."

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Completed Affinity Mapping & Data Analysis
Putting together the Wiki & Report

Blockers: "Difficulties or errors encountered."
None

Availability: "How much time will you have this week to work on this issue?"
4-6 hours

ETA: "When do you expect this issue to be completed?"
2-3 days

Pictures: "Add any pictures of the visual changes made to the site so far."

[Aparna1Gopal]

Progress: "What is the current status of your project? What have you completed and what is left to do?"

• Had a presentation/ walkthrough to share research findings & insights during last week's team meeting.
• Putting together the documentation now & close the issue.

The following documents are being worked on:

• Complete slide deck presentation (5-6 pages) of research findings
• Copy Dovetail report to Google Docs
• Download pdfs of CKANs data collection from Dovetail
• Create and Update Wiki
• Update PMs

Blockers: "Difficulties or errors encountered."
None

Availability: "How much time will you have this week to work on this issue?"
4-6 hours

ETA: "When do you expect this issue to be completed?"
2-3 days

Pictures: "Add any pictures of the visual changes made to the site so far."

[Aparna1Gopal]

@mxajPrice @Cathyyyyyyyy

• Completed the following documentation:
  • Complete slide deck presentation of research findings
  • Copy Dovetail report to Google Docs
  • Download pdfs of CKAN data collection from Dovetail
  • Create and Update Wiki
  • Update PMs
• Updated Wiki
• This Issue is complete & can be closed

[mxajPrice]

This is complete.