About
I'm a paragraph. Click here to add your own text and edit me. It’s easy. Just click “Edit Text” or double click me to add your own content and make changes to the font.
Usability Test
We started this project by designing two scenarios in which a user would use both Chat GPT and Wikipedia to find the same information.
We ensured that our users had roughly the same familiarity with both Chat GPT and Wikipedia.
Scenario 1:
With our first scenario, we wanted to learn which platform made it easier for users to answer one simple question.
For scenario two, we asked our users to: Please use both Wikipedia and Chat GPT to discover who the first Emperor of China was.
After observing the users complete this task, we asked them some follow up questions about their experience.
Was it more enjoyable finding the answer using Chat GPT or Wikipedia? Why?
Was it easier using Chat GPT or Wikipedia? Why?
Did you learn more than you intended to using Chat GPT or Wikipedia? Which one? Why?
Scenario 2:
With our second scenario, we wanted to discover which platform was better for getting a basic understanding of something.
For scenario two, we asked our users to: Please use both Chat GPT and Wikipedia to learn about Serie A. Find out what it is, who the most recent champions are, who has the most championships and how many, and the competition format.
After observing the users complete this task, we asked them some follow up questions about their experience.
Was it more enjoyable finding the answers using Chat GPT or Wikipedia? Why?
Was it easier using Chat GPT or Wikipedia? Why?
How were Chat GPT and Wikipedia different when used to learn a couple different things instead of one fact?
Do you trust Chat GPT or Wikipedia more? Why?
Survey
After our usability test, we had our users complete a short survey to collect data on which platform they preferred.
For our survey, we used a Likert Scale format, but we substituted Chat GPT and Wikipedia for Strongly Disagree and Strongly Agree. We did this to find out which platform users preferred in different ways.
Questions focused on the ease of use, learnability, consistency, ands validity of the platforms.
Results
The results from our survey and usability test were:
-
Most Users liked Chat GPT more than Wikipedia
-
Users prefer Wikipedia because: it almost always provides pictures and gives more in depth information than Chat GPT
-
Users prefer Chat GPT because: they can ask it anything they want, they do not have to scroll to find what they are looking for, and the layout is easier to understand
-
Users lack trust in both because Wikipedia can be edited by anyone and Chat GPT pulls information from a lot of sources
With these findings we concluded that:
-
Chat GPT is better for getting specific information quickly and easily
-
Wikipedia is better for in depth information when users do not know exactly what they are looking for
Recommendations for Wikipedia
Wikipedia could add the option to search for something within an article, recognize spelling errors, and ensure that information on it is accurate
-
High-Priority Issues
-
It can be difficult to find something specific in a Wikipedia article
-
-
Medium-Priority Issues
-
Wikipedia is not trusted by some people
-
-
Low-Priority Issues
-
Wikipedia does not recognize spelling errors
-