Editing Zooniverse research (2016-2017 archive)
From CommunityData
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 1: | Line 1: | ||
Playground for Jim, Darren, and Aaron to build up a project analyzing volunteer management in [http://zooniverse.org the Zooniverse]. | Playground for Jim, Darren, and Aaron to build up a project analyzing volunteer management in [http://zooniverse.org the Zooniverse]. | ||
== | == Action items for next meeting == | ||
* Read [https://www.zooniverse.org/lab-best-practices/introduction Best Practices Guide] (all sections) for Zooniverse Project Builder. | |||
** Map shared leadership concepts to best practices document. | |||
* | * Keep doing classifications to familiarize with projects. | ||
* | * Find a structured/methodical way to read a bunch of talk/forum interactions between Science Team members and volunteers. | ||
* | ** Suggested projects included: GalaxyZoo2, PlanetHunters, Snapshot Serengeti, SpaceWarps. | ||
** Take notes about the kinds of interactions you observe with an eye towards which ones might embody different leadership/management practices and styles (start w. Zhu et al's "shared leadership" categories and build from there) that could lead to different volunteer behaviors. | |||
* reading and lit review from Zotero directory | |||
== Pending Action Items == | |||
* Build out planning document draft based on Aaron's rough rationale for the project. | |||
* More reading (start w Zooniverse and shared leadership then move on from there). | |||
** volunteer engagement | |||
** (shared) leadership | |||
** community management | |||
** citizen science | |||
** Kevin Crowston | |||
** Carsten Oesterlund | |||
** Andrea Wiggins | |||
** Rob Simpson | |||
** Chris Lintott (academic director of zooniverse) | |||
== Meeting logs == | |||
03-29-16: laid out plans for the quarter; set some preliminary work goals. | |||
== | 04-04-16: talked about predicted probabilities for unrelated projects; revised and updated work goals for next week. | ||
== Goals == | |||
'''Spring 2016''' | |||
* Fully developed planning document including a thorough analysis plan. | |||
* A cleaned up dataset (variables and measures that we can model; not just raw database records). | |||
== Preliminary Project Overview == | |||
'''Understanding Effective Leadership and Volunteer Engagement in Citizen Science''' | |||
''' | '''Rationale:''' | ||
Prior research investigating the mechanisms of effective crowd work and citizen science has focused on volunteer/worker motivations, algorithmic and computational techniques for quality control/improvement, and task/incentive design. Despite a number of findings indicating that the patterns of interaction between requesters and volunteers/workers shape participant experiences and work contributions in important ways, these interactions remain largely unexplored as a domain of analysis, design, and intervention. This is arguably an especially important design space in the context of citizen science, where "the crowd" consists entirely of volunteers and poor volunteer management or relations would likely result in complete project failure. | |||
As task requesters in citizen science are scientists who perform important leadership functions for the project as a whole, we draw on prior literature analyzing effective leadership in volunteer online communities. Several studies by Haiyi Zhu and colleagues in the context of peer production show that "shared leadership" behaviors increase newcomer motivation and participation along multiple dimensions, but may adversely affect experienced participant motivation and participation. | |||
This study will contribute a comparative analysis of requester-volunteer interactions in a sample of citizen science projects from within the Zooniverse platform. Building on literature on crowd work, citizen science, and studies of effective leadership in online communities and peer production, we construct models to test whether shared leadership behaviors lead to enhanced citizen scientist engagement. | |||
'''Analytic approach:''' | |||
Use observational data drawn from Zooniverse database records to build variables and multilevel models that test whether science team member behaviors and science team - volunteer interactions consistent with shared leadership predict increased volunteer engagement and higher quality contributions. <more details needed here> | |||
''' | '''Dependent variables (all nested within projects):''' | ||
*Count of volunteer contributions | |||
*Median/total quality of contributions (using gold-standard data where available) | |||
*Volunteer survival rate: time on zooniverse platform, completed project (0/1) | |||
*Number of active volunteers throughout project? | |||
*Risk of highly negative interactions between volunteers and science team members (if we can identify these) | |||
**from my observations I have yet to find these. | |||
**these seems like an independent, not a dependent variable | |||
== Notes == | == Notes == | ||
''' notes 04-04-16 to 04-13-16 ''' | |||
'''types of shared leadership (from Zhu et al.)''' | |||
* | *transactional (positive feedback) | ||
* | *aversive (negative feedback) | ||
* | *directive (directive message) | ||
*person focused (social message) | |||
* | |||
[https://www.zooniverse.org/lab-best-practices/introduction '''Zooniverse Best Practices'''] | [https://www.zooniverse.org/lab-best-practices/introduction '''Zooniverse Best Practices'''] | ||
Line 99: | Line 90: | ||
**positive feedback, report on accomplishments (transactional) | **positive feedback, report on accomplishments (transactional) | ||
'''notes from observations''' | |||
'''notes from observations''' | |||
* question level vs. board/discussion level | * question level vs. board/discussion level | ||
* scientist feedback and volunteer feedback--supports shared leadership | * scientist feedback and volunteer feedback--supports shared leadership | ||
* | * most feedback isn't exactly "leadership". responding to requests for information, information sharing, not exactly directive leadership. | ||
* single response vs multi-response questions | * single response vs multi-response questions | ||
* questions from research team vs questions from public | * questions from research team vs questions from public | ||
* | * most chat is response to questions | ||
* | * not much traditional "leadership" because instructions are pretty clear/explicit. most discussion above & beyond the project | ||
** only examples of transactional (and possibly directive) leadership | ** only examples of transactional (and possibly directive) leadership | ||
** we might find examples of social leadership, but likely in smaller projects | ** we might find examples of social leadership, but likely in smaller projects | ||
Line 115: | Line 105: | ||
* is an informational post directive leadership? is it directive leadership when it responds to a question? | * is an informational post directive leadership? is it directive leadership when it responds to a question? | ||
** information sharing is an important component of engaging volunteers, but isn't necessarily "leadership" | ** information sharing is an important component of engaging volunteers, but isn't necessarily "leadership" | ||
** | ** can we find lit on information sharing? communities of practice? | ||
* | * responses to questions might be a good indication of leadership | ||
** | ** sometimes responses are just informational | ||
* types of contributors | * types of contributors | ||
Line 125: | Line 115: | ||
** zooniverse employee | ** zooniverse employee | ||
** admin (spacewarps) | ** admin (spacewarps) | ||
''' independent vars ''' | ''' independent vars ''' | ||
Line 152: | Line 141: | ||
** frequency of blog posts | ** frequency of blog posts | ||
** length of blog posts | ** length of blog posts | ||