Wiki language research
Project management wiki for Darren, Jim (and Aaron's) cultural peer production research.
- write rough draft of preliminary findings for 6/21
- continue hand-coding samples
- take notes on interesting patters (in notes document on spreadsheets)
- note if names of bots are included in "list of bots"
- Week 1: Write initial analysis
- Week 2-3: Flag bot edits, pull new samples for coding based on updated percentiles, write new draft of analysis
- week 3-6: Develop hypotheses and run analysis
- Cross cultural deliberative practices
- Discussion structure
- Something else?
- more qualitative coding + bot spot checks
- Week 7-CHI Deadline: writing
meeting logs & notes
DG: I spent some time looking at the data distributions and ran a bunch of models on the simple EN models overnight. The data for len_1 are reallllly long-tailed with very low frequencies -- this is causing the convergence issues. Below is a table of the simple model (len_1 ~ num_editors_1), run through a series of truncated data sets. The models will converge all the way up to removing the final data point out of the 4,077,819 data points we have. In other words, I was able to get convergence by dropping a single data point. Here's a quick table of the results from running the models:
|Yes||10000||99.99846%||0.0903963||0.0000536||0.2806345||1||missing only 63 data points (4077756/4077819)|
|Yes||50000||99.999975%||0.0896678||0.0000536||0.2858428||1||missing only 1 data point|
|No||no cutoff||100%||.||.||.||1||cannot compute an improvement, discontinuous region encountered|
So, there are a few things we should take note of when looking at the data here:
- len_1 ranges in this data set from: 2 - 133,529
- as the cutoff increases (i.e., more data included in the model) the coeff for editors decreases (to be expected since we have longer tail) and the SE stabilizes around .0000536.
- alpha also increases (as expected)
- the last data point is len_1 = 133,529; but if you look at the tabs you get to 99.99% of the data at len_1 ~= 2500, and the last 5 len_1's are 28364, 30313, 34390, 44586, and then 133529. that's likely causing all kinds of havoc with numerous things (e.g., dispersion calculations, covariance and corr issues, etc.)
Jim, Darren, and Aaron discussed the introduction, related work, and research contribution for the CSCW paper. Related work: get away from lit review style of writing (for instance "we know that temporal issues are important (cite)", don't use authors as subjects, end each section for warent for our work; Discussion/Contribution: make a bulleted list of potential contributions for the paper.
Darren and Jim discussed the background section of the paper.
Aaron and Jim discussed the background section of the paper. Key takeaways: write the Durkhiem section more concisely and explicitly show the connection to our study, change the en:wp to be less lit-review-y and just show how it connects to ideas and expectations in the paper (also mention that it informs methods), cut a lot of "Applications to Organizations, Communities, and Social Movements", think of using Omnipedia earlier on because it shows that culture is acting as structuring (for content). Generally, think about building up conceptual relationships needed to understand the paper. Try writing a one sentence description of what each section is supposed to do in the paper.
Jim and Darren discussed a qualitative coding plan for the undergrads, and writing goals for the coming week. Jim showed Darren the location of data files on Jakku for future data analysis.
Jim and Darren discussed the overall outline of the paper and the framing of the background section. Specifically: 1) write the intro using the "the world is increasingly globalized" framing, 2) first include previous work on english wikipedia (especially on collaboration and bias, e.g. keegan, kittur, shaw, wagner, bryant), 3) then include small studies hyperlingual studies and studies on hyperlingual content (e.g. hecht, herring, hara), and 3) write about gap in previous lit (i.e. difference in collaboration practices)
created coding scheme in order to describe structure of talk pages
discussed project balancing and timeline, goals for theoretical framing, and qualitative coding