The Wikipedia Adventure: Difference between revisions

From CommunityData
No edit summary
Line 12: Line 12:


== Current TO DO list ==
== Current TO DO list ==
 
* '''introduction'''
* Revise introduction to focus on two study framing
** focus on two study framing
** Change framing to show that two studies were always part of the plan
** Change framing to show that two studies were always part of the plan
** Incorporate idea that large scale field testing is important
** Incorporate idea that large scale field testing is important
** emphasize hypotheses
*** challenges of deploying new systems in a massive community with passionate, experienced members
*** challenges of deploying new systems in a massive community with passionate, experienced members
*** large-scale user survey and invitation-based field experiment under realistic conditions provide more useful evidence (than hallway testing or small-scale usability studies).
*** large-scale user survey and invitation-based field experiment under realistic conditions provide more useful evidence (than hallway testing or small-scale usability studies).
* Incorporate UIST model paper system evaluation stuff suggested by Mako
* '''Background and prior work'''
** Use Webstrates paper (UIST 2015) as a model.
** Continue to improve gamification subsection (mako)
* Add overarching discussion & conclusion sections (sn, jm)
* '''System design'''
** Use Webstrates paper (UIST 2015) as a model (mako)
* '''Study 1:'''
** replace bar charts w new visualizations (sn)
* '''Study 2:'''
** emphasize hypotheses
** add details of random assignment (sn)
** add more descriptive information about the sample and experiment
** incorporate randomization check (compare days in study across treatment & control)
** restrict main analysis to last 100 days of sampling (sn)
*** revise '''all''' reported statistics to reflect this
* Add overarching '''discussion & conclusion''' sections (sn, jm)
** Make sure to address big contributions
** Make sure to address big contributions
* Redo bar chart graphics
** Note that most studies on gamified systems don't do quantitative impact assessment, highlight this as a contribution of our study
* Add citations currently in text
* '''Throughout'''
* Note that most studies on gamified systems don't do quantitative impact assessment, highlight this as a contribution of our study
** Add citations currently in text
* emphasize hypotheses in study 2, and introduction
** Remove excess uses of passive voice
 
== Recent changes log ==
 
* change language around Teahouse
* change language around Teahouse
* add more descriptive information about the sample and experiment in Study 2


==Timeline for CSCW 2017 submission==
==Timeline for CSCW 2017 submission==

Revision as of 04:05, 26 May 2016

Project page for The Wikipedia Adventure paper co-authored by Sneha Narayan, Jake Orlowitz, Jonathan Morgan, Mako Hill, and Aaron Shaw.


Current Status

We are in the process of revising this for submission to CSCW 2017. The timeline and milestones for submission are living on this page (below).

Resources

  • We're writing on sharelatex. The project lives here.
  • Bibliography is currently stored in a shared zotero directory. Aaron and Mako can share access if needed.


Current TO DO list

  • introduction
    • focus on two study framing
    • Change framing to show that two studies were always part of the plan
    • Incorporate idea that large scale field testing is important
    • emphasize hypotheses
      • challenges of deploying new systems in a massive community with passionate, experienced members
      • large-scale user survey and invitation-based field experiment under realistic conditions provide more useful evidence (than hallway testing or small-scale usability studies).
  • Background and prior work
    • Continue to improve gamification subsection (mako)
  • System design
    • Use Webstrates paper (UIST 2015) as a model (mako)
  • Study 1:
    • replace bar charts w new visualizations (sn)
  • Study 2:
    • emphasize hypotheses
    • add details of random assignment (sn)
    • add more descriptive information about the sample and experiment
    • incorporate randomization check (compare days in study across treatment & control)
    • restrict main analysis to last 100 days of sampling (sn)
      • revise all reported statistics to reflect this
  • Add overarching discussion & conclusion sections (sn, jm)
    • Make sure to address big contributions
    • Note that most studies on gamified systems don't do quantitative impact assessment, highlight this as a contribution of our study
  • Throughout
    • Add citations currently in text
    • Remove excess uses of passive voice

Recent changes log

  • change language around Teahouse

Timeline for CSCW 2017 submission

Thursday, May 19th

  • Refine organization of Study 1 findings (sn) [Done]
  • Analyze differential attrition in Study 2 (sn) [Done]
  • Add overarching discussion & conclusion sections (sn, jm) [Done]
    • make sure to address big contributions
  • Fill in as many "TO DO" items as possible in the doc (sn) [Done]
    • Refine prior work section on gamification (Mako)
  • Incorporate UIST model paper system evaluation stuff suggested by Mako
    • Use Webstrates paper (UIST 2015) as a model.
  • Refine Study 2 Discussion (Jmo, Sneha) [Done]
    • Explain why TWA didn't alter behavior
  • get extracted data from the bar charts and redo graphics (sn)

Monday, May 23rd

  • Add more descriptive info on sample and experiment in Study 2 (sn, as)
  • insert new graphics (sn)
  • add and fix citations (sn)
  • Emphasize hypotheses in study 2 (sn)
  • change language around how we talk about Teahouse (Jm, sn)
  • highlight contribution to gamification literature (jm, sn)
  • do multiple passes through the whole paper, editing language, grammar and everything else (sn, as, whoever else wants to)
  • share this with folks peer reviewing CSCW paper (sn)

Friday, May 20th

  • read it a hundred times, make sure the title works

Friday, May 27th

  • submit final version! (though earlier is better)