Wiki Accountability

Nondescript Watchlist Link

Confusing Watchlist

Confusing Watchlist, Part 2

Pending Reviews

How well are we doing with reviewers?

Big improvements

At the bottom of Pending Reviews

Watch Suggestions

Watch Suggestions: Real Conversation

Disclaimer: the names are fake and the words are paraphrased, but the conversation is real.

The other day Amy and Bob were heckling each other about who was watching more pages.

• Amy: "I'm watching almost as many pages as our boss...I'm going to get more than her!"
• Bob: "It just seems to randomly suggest pages to me, though. Why would I care about Rule #12345?"
• Amy: "Well, that rule page is about your hardware."
• Bob: "Oh, well maybe I do want to watch that!"

How has Watch Suggestions helped?

Page Watch Quality

Page Watch Quality

Goals

Without continuous contributions and qualified reviews from everyone in your community, a wiki is just another dumpster of outdated and unreliable information.

Review Initial goals

1. Determine number of reviewers for each page
2. Determine a way to rate contributors
3. Combine (1) and (2) to identify weak points in our data
4. Address weak points

Review Short term goals

1. Encourage users to do their reviews
2. Eliminate singly-watched pages

Our Goals from a different view

1. Increase number of watchers for each page
2. Increase frequency of reviews performed on each page
3. Increase quality of reviews performed on each page

Refocus our goals

Instead of focusing on adding content, our focus is now on the quality of our content.

Even Wikipedia is criticized for focusing on quantity over quality (Source)

Who are our users?

EVA Group Analysis

• 743 viewers
• 100 contributors
• 47 active contributors

Range of Response

• Early adopters
• Those that began using after some help and motivation
• Viewers, but not contributors
• Viewers, contributors, but not reviewers
• Stubborn, refuse to even view the wiki

Motivation

Extrinsic vs. Intrinsic

Intrinsic motivation

• Competence
• Autonomy
• Relatedness

User Personality Types

• Competitors - Act on other users (challenge, showoff, compare)
• Self-Expressers - Act on content (create, build, design, customize)
• Explorers - Interact with content (view, collect, review, curate)
• Collaborators - Interacting with users (share, comment, help)

Online Communities

• In a zero-sum game, we are opponents: One wins, others lose
• In a non-zero-sum game, we are partners: We all win or we all lose

User activity loops

The wiki police!

Educational tools

• Welcome e-mail
• Tutorial pages
• Semantic Forms
• Screencasts
• Guided Tours

Meeting Minutes

Subject Matter Expert

Pending Reviews

Watch Suggestions

What we plan to add

Target Behavior

• Watch Pages
• Edit often
• Review promptly
• Use page history and diff tool
• Review carefully
• Maintain low pending review count

These behaviors are directly related to our new scores:

• User Engagement Score
• Page Scores

Thanks