Editing Internet Research Methods (Spring 2016)

From CommunityData
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.

Latest revision Your text
Line 260: Line 260:
* Schneider, Steven, Kirsten Foot, and Paul Wouters, 2009, “[https://canvas.uw.edu/files/35982270/download?download_frd=1 Web Archiving as E-Research],” in e-Research: Transformation in Scholarly Practice, Nicholas Jankowski (Ed.), Routledge, pp. 205-221. ''[Available in Canvas]''
* Schneider, Steven, Kirsten Foot, and Paul Wouters, 2009, “[https://canvas.uw.edu/files/35982270/download?download_frd=1 Web Archiving as E-Research],” in e-Research: Transformation in Scholarly Practice, Nicholas Jankowski (Ed.), Routledge, pp. 205-221. ''[Available in Canvas]''
* Brügger, N. (2011). [https://canvas.uw.edu/files/35981768/download?download_frd=1 Web archiving—Between past, present, and future.] In M. Consalvo & C. Ess (Eds.), The Handbook of Internet Studies (pp. 24–42). Chichester, West Susssex: Blackwell. ''[Available in Canvas]''
* Brügger, N. (2011). [https://canvas.uw.edu/files/35981768/download?download_frd=1 Web archiving—Between past, present, and future.] In M. Consalvo & C. Ess (Eds.), The Handbook of Internet Studies (pp. 24–42). Chichester, West Susssex: Blackwell. ''[Available in Canvas]''
* Rogers, Richard, Chapter 3 "[https://canvas.uw.edu/files/35982101/download?download_frd=1 The Website as Archived Object]" from Digital Methods, pp. 61-82. ''[Available through Canvas]''<!-- REMOVE NEXT TIME -->
* Rogers, Richard, Chapter 3 "[https://canvas.uw.edu/files/35982101/download?download_frd=1 The Website as Archived Object]" from Digital Methods, pp. 61-82. ''[Available through Canvas]''
* Graeff, E., Stempeck, M., & Zuckerman, E. (2014). [http://firstmonday.org/ojs/index.php/fm/article/view/4947 The battle for “Trayvon Martin”: Mapping a media controversy online and off-line.] First Monday, 19(2). ''[Free Online]''
* Graeff, E., Stempeck, M., & Zuckerman, E. (2014). [http://firstmonday.org/ojs/index.php/fm/article/view/4947 The battle for “Trayvon Martin”: Mapping a media controversy online and off-line.] First Monday, 19(2). ''[Free Online]''


Line 341: Line 341:
* Williams, M. (2007). [http://doi.org/10.1177/1468794107071408 Avatar watching: participant observation in graphical online environments.] Qualitative Research, 7(1), 5–24. ''[Available through UW Libraries]''
* Williams, M. (2007). [http://doi.org/10.1177/1468794107071408 Avatar watching: participant observation in graphical online environments.] Qualitative Research, 7(1), 5–24. ''[Available through UW Libraries]''
: Note: Fantastic more general introduction but takeaways that are more specifically targetted toward people studying virtual reality type environments with virtual physicality.
: Note: Fantastic more general introduction but takeaways that are more specifically targetted toward people studying virtual reality type environments with virtual physicality.
'''Apropos of class discussion:'''
* Borges, J. L. (1998). [https://canvas.uw.edu/files/36195543/download?download_frd=1 Pierre Mendard, author of the Quixote]. In A. Hurley (Trans.), Collected Fictions (pp. 88–95). New York, N.Y., U.S.A: Viking Press. ''[Available in Canvas]''
* Maxwell, J. A. (2002). [https://canvas.uw.edu/files/36195592/download?download_frd=1 Understanding and validity in qualitative research]. In A. M. Huberman & M. B. Miles (Eds.), The Qualitative Researcher’s Companion (pp. 37–64). SAGE. ''[Available in Canvas]''


=== Week 4: Monday April 18: Online Interviews ===
=== Week 4: Monday April 18: Online Interviews ===
Line 386: Line 381:
* Garton, Laura, Caroline Haythornthwaite, and Barry Wellman, "[http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.1997.tb00062.x/abstract Studying Online Social Networks]," Journal of Computer-Mediated Communication, V. 3, N. 1, June, 1997. ''[Free Online]''
* Garton, Laura, Caroline Haythornthwaite, and Barry Wellman, "[http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.1997.tb00062.x/abstract Studying Online Social Networks]," Journal of Computer-Mediated Communication, V. 3, N. 1, June, 1997. ''[Free Online]''
* Mislove, Alan, et al (2007), "[https://dl.acm.org/citation.cfm?id=1298311 Measurement and Analysis of Online Social Networks]," IMC 2007, October 24-27, San Diego, CA ''[Available through UW Libraries]''
* Mislove, Alan, et al (2007), "[https://dl.acm.org/citation.cfm?id=1298311 Measurement and Analysis of Online Social Networks]," IMC 2007, October 24-27, San Diego, CA ''[Available through UW Libraries]''
* Keegan, B., Gergle, D., & Contractor, N. (2013). [http://abs.sagepub.com/content/57/5/595 Hot Off the Wiki Structures and Dynamics of Wikipedia’s Coverage of Breaking News Events.] American Behavioral Scientist, 57(5), 595–622. ''[Available through UW Libraries]''
'''Optional Readings:'''
* Howard, Phil, "[http://nms.sagepub.com/content/4/4/550.short Network Ethnography and Hypermedia Organization: New Organizations, New Media, New Myths]," New Media and Society, December 2002, 4(4), pp. 550-574. ''[Available through UW Libraries]''
* Howard, Phil, "[http://nms.sagepub.com/content/4/4/550.short Network Ethnography and Hypermedia Organization: New Organizations, New Media, New Myths]," New Media and Society, December 2002, 4(4), pp. 550-574. ''[Available through UW Libraries]''
* Keegan, B., Gergle, D., & Contractor, N. (2013). [http://abs.sagepub.com/content/57/5/595 Hot Off the Wiki Structures and Dynamics of Wikipedia’s Coverage of Breaking News Events.] American Behavioral Scientist, 57(5), 595–622. ''[Available through UW Libraries]''  <!-- REMOVE NEXT TIME -->


=== Week 4: Saturday April 23: CDSW Session 2 ===
=== Week 4: Saturday April 23: CDSW Session 2 ===
Line 401: Line 399:
'''Required Readings:'''
'''Required Readings:'''


* Reips, U.-D. (2002). [http://doi.org/10.1026//1618-3169.49.4.243 Standards for Internet-based experimenting]. Experimental Psychology, 49(4), 243–256. [[http://iscience.deusto.es/wp-content/uploads/2010/04/ulf27.pdf Alternate Link]]
* Hergueux, J., & Jacquemet, N. (2014). Social preferences in the online laboratory: a randomized experiment. Experimental Economics, 18(2), 251–283. [Available through UW Libraries]
* Hergueux, J., & Jacquemet, N. (2014). [http://doi.org/10.1007/s10683-014-9400-5 Social preferences in the online laboratory: a randomized experiment]. Experimental Economics, 18(2), 251–283. ''[Available through UW Libraries]''
* Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006). Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market. Science, 311(5762), 854–856. [Available through UW Libraries]
* Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006). [http://doi.org/10.1126/science.1121066 Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market]. Science, 311(5762), 854–856. ''[Available through UW Libraries]''
* Restivo, M., & van de Rijt, A. (2012). Experimental Study of Informal Rewards in Peer Production. PLoS ONE, 7(3), e34358. [Free Online]
* Rijt, A. van de, Kang, S. M., Restivo, M., & Patil, A. (2014). [http://doi.org/10.1073/pnas.1316836111 Field experiments of success-breeds-success dynamics]. Proceedings of the National Academy of Sciences, 111(19), 6934–6939. ''[Available through UW Libraries]'' [[http://www.akshaynpatil.com/papers/success.pdf Alternative Link]]
* Bond, R. M., Fariss, C. J., Jones, J. J., Kramer, A. D. I., Marlow, C., Settle, J. E., & Fowler, J. H. (2012). A 61-million-person experiment in social influence and political mobilization. Nature, 489(7415), 295–298. [Available through UW Libraries]
* Bond, R. M., Fariss, C. J., Jones, J. J., Kramer, A. D. I., Marlow, C., Settle, J. E., & Fowler, J. H. (2012). [http://doi.org/10.1038/nature11421 A 61-million-person experiment in social influence and political mobilization]. Nature, 489(7415), 295–298. ''[Available through UW Libraries]''
* Cosley, D., Frankowski, D., Terveen, L., & Riedl, J. (2007). SuggestBot: Using Intelligent Task Routing to Help People Find Work in Wikipedia. In Proceedings of the 12th International Conference on Intelligent User Interfaces (pp. 32–41). New York, NY, USA: ACM. [Available through UW Libraries]
* Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences, 111(24), 8788–8790. [Available through UW Libraries]
: Note: We've already read but I'd like to discuss it again.


'''Optional Readings:'''
'''Optional Readings:'''


* Zhu, H., Zhang, A., He, J., Kraut, R., & Kittur, A. (2013). [http://doi.org/10.1145/2470654.2481311 Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia]. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Paris, France: ACM. ''[Available through UW Libraries]''
* Zhu, H., Zhang, A., He, J., Kraut, R., & Kittur, A. (2013). Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Paris, France: ACM. [Available through UW Libraries]
* Restivo, M., & van de Rijt, A. (2012). [http://dx.doi.org/10.1371/journal.pone.0034358 Experimental Study of Informal Rewards in Peer Production]. PLoS ONE, 7(3), e34358. ''[Free Online]''
* Restivo, M., & van de Rijt, A. (0). No praise without effort: experimental evidence on how rewards affect Wikipedia’s contributor community. Information, Communication & Society, 0(0), 1–12. [Available through UW Libraries]
: This is really just a more in-depth version of the experiments in the Restivo and van de Rijt article described above.
* Restivo, M., & van de Rijt, A. (0). [http://doi.org/10.1080/1369118X.2014.888459 No praise without effort: experimental evidence on how rewards affect Wikipedia’s contributor community]. Information, Communication & Society, 0(0), 1–12. ''[Available through UW Libraries]''
: Note: This piece is, more or less, a continuation of the Restivo and van de Rijt piece included above but it is longer and goes into much more depth on at least one of the important theoretical issues.
: Note: This piece is, more or less, a continuation of the Restivo and van de Rijt piece included above but it is longer and goes into much more depth on at least one of the important theoretical issues.
* Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014). [http://doi.org/10.1073/pnas.1320040111 Experimental evidence of massive-scale emotional contagion through social networks]. Proceedings of the National Academy of Sciences, 111(24), 8788–8790. ''[Available through UW Libraries]''
: Note: We've already read but I'd like to discuss it again.
* Cosley, D., Frankowski, D., Terveen, L., & Riedl, J. (2007). [http://doi.org/10.1145/1216295.1216309 SuggestBot: Using Intelligent Task Routing to Help People Find Work in Wikipedia]. In Proceedings of the 12th International Conference on Intelligent User Interfaces (pp. 32–41). New York, NY, USA: ACM. ''[Available through UW Libraries]''
* Reinecke, K., & Gajos, K. Z. (2015). [http://doi.org/10.1145/2675133.2675246 LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples]. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (pp. 1364–1378). New York, NY, USA: ACM. ''[Available through UW Libraries]''


=== Week 5: Wednesday April 27: Surveys ===
=== Week 5: Wednesday April 27: Surveys ===
Line 425: Line 419:
'''Required Readings:'''
'''Required Readings:'''


* Van Selm, Martine & Nicholas Jankowski (2006), "[http://doi.org/10.1007/s11135-005-8081-8 Conducting Online Surveys]," Quality and Quantity, 40: 435-456. ''[Available through UW Libraries]''
* Van Selm, Martine & Nicholas Jankowski (2006), "Conducting Online Surveys," Quality and Quantity, 40: 435-456. [Available through UW Libraries]
* Walejko, Gina, "[https://canvas.uw.edu/files/36334690/download?download_frd=1 Online survey: Instant publication, instant mistake, all of the above]," from Research Confidential: Solutions to Problems Most Research Scientists Pretend They Never Have, University of Michigan Press, 2009, pp. 101-121. ''[Available in Canvas]''
* Walejko, Gina, "Online survey: Instant publication, instant mistake, all of the above," from Research Confidential: Solutions to Problems Most Research Scientists Pretend They Never Have, University of Michigan Press, 2009, pp. 101-121.sk [Available in Canvas]
* Joseph A. Konstan, B. R. Simon Rosser, Michael W. Ross, Jeffrey Stanton, & Weston M. Edwards, “[http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.2005.tb00248.x/full The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research],” Journal of Computer-Mediated Communication, V.10, N. 2, January 2005. ''[Free Online]''
* Joseph A. Konstan, B. R. Simon Rosser, Michael W. Ross, Jeffrey Stanton, & Weston M. Edwards, “The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research” Journal of Computer-Mediated Communication, V.10, N. 2, January 2005. [Free Online]
* Hill, B. M., & Shaw, A. (2013). [http://dx.doi.org/10.1371/journal.pone.0065782 The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation]. PLoS ONE, 8(6), e65782. ''[Free Online]''
* Hill, B. M., & Shaw, A. (2013). The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation. PLoS ONE, 8(6), e65782. [Free Online]
* Salganik, M. J., & Levy, K. E. C. (2015). [http://doi.org/10.1371/journal.pone.0123483 Wiki Surveys: Open and Quantifiable Social Data Collection]. PLOS ONE, 10(5), e0123483. ''[Free Online]''
* Salganik, M. J., & Levy, K. E. C. (2012). Wiki surveys: Open and quantifiable social data collection. arXiv:1202.0500 [cs, Stat]. [Free Online]
: Note: [http://www.technologyreview.com/view/531696/inspired-by-wikipedia-social-scientists-create-a-revolution-in-online-surveys/ This journalistic account of the research] may also be useful.
: Note: This journalistic account of the research may also be useful.


'''Optional Readings:'''
'''Optional Readings:'''
Line 436: Line 430:
If you don't have a background in survey design, these two have been recommended by our guest speaker as good basic things to read:
If you don't have a background in survey design, these two have been recommended by our guest speaker as good basic things to read:


* Krosnick, J. A. (1999). [http://doi.org/10.1146/annurev.psych.50.1.537 Survey Research]. Annual Review of Psychology, 50(1), 537–567. ''[Available through UW Libraries]''
* Krosnick, J. A. (1999).Survey research. Annual Review of Psychology 50, 537-567. [Free Online]
* Krosnick, J. A. (1999). Maximizing measurement quality: Principles of good questionnaire design. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of Political Attitudes. New York: Academic Press.
* Krosnick, J. A. (1999).Maximizing measurement quality: Principles of good questionnaire design . In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of political attitudes. New York: Academic Press. [Free Online]


These are other texts on the subject that you might find useful:
These are other texts on the subjct that you might find useul:


* Dal, Michael, "[https://canvas.uw.edu/files/36335114/download?download_frd=1 Online data collection and data analysis using emergent technologies]," Ch. 12 in HET. ''[Available in Canvas]''
* Dal, Michael, "Online data collection and data analysis using emergent technologies," Ch. 12 in HET.
* Smith, Tom W. and John Sokolowski, "[https://canvas.uw.edu/files/36335113/download?download_frd=1 The use of audiovisuals in surveys]," Ch. 19 in HET. ''[Available in Canvas]''
* Smith, Tom W. and John Sokolowski, "The use of audiovisuals in surveys," Ch. 19 in HET.
* Kellock, Anne, et. al. "[https://canvas.uw.edu/files/36335148/download?download_frd=1 Using technology and the experience sampling method to understand real life]," Ch. 24 from HET. ''[Available in Canvas]''
* Kellock, Anne, et. al. "Using technology and the experience sampling method to understand real life," Ch. 24 from HET.
* Yun, Gi Woong and Craig Trumbo, "[http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.2000.tb00112.x/abstract Comparative Response to a Survey Executed by Post, E-mail and Web Form]," Journal of Computer-Mediated Communication, V.6, N.1, September, 2000. ''[Free Online]''
* Yun, Gi Woong and Craig Trumbo, "Comparative Response to a Survey Executed by Post, E-mail and Web Form," Journal of Computer-Mediated Communication, V.6, N.1, September, 2000.
* Hargittai, Eszter, and Chris Karr, "[https://canvas.uw.edu/files/36334928/download?download_frd=1 WAT R U DOIN? Studying the Thumb Generation Using Text Messaging]," from Research Confidential: Solutions to Problems Most Research Scientists Pretend They Never Have, University of Michigan Press, 2009, pp. 192-216. ''[Available in Canvas]''
* Hargittai, Eszter, and Chris Karr, "WAT R U DOIN? Studying the Thumb Generation Using Text Messaging," from Research Confidential: Solutions to Problems Most Research Scientists Pretend They Never Have, University of Michigan Press, 2009, pp. 192-216. [Available in Canvas]
* Wright, Kevin, "[http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.2005.tb00259.x/abstract Researching Internet-Based Populations: Advantages and Disadvantages of Online Survey Research, Online Questionnaire Authoring Software Packages, and Web Survey Services]," Journal of Computer-Mediated Communication, V. 10, N. 3, April 2005. ''[Free Online]''
* Wright, Kevin, "Researching Internet-Based Populations: Advantages and Disadvantages of Online Survey Research, Online Questionnaire Authoring Software Packages, and Web Survey Services," Journal of Computer-Mediated Communication, V. 10, N. 3, April 2005. [Free Online]


=== Week 6: Monday May 2: Narrative, Discourse and Visual Analysis ===
=== Week 6: Monday May 2: Narrative, Discourse and Visual Analysis ===
Line 456: Line 450:
Narrative Analysis:
Narrative Analysis:


* Mitra, A. (1999). [http://doi.org/10.1111/j.1083-6101.1999.tb00330.x Characteristics of the WWW Text: Tracing Discursive Strategies]. Journal of Computer-Mediated Communication, 5(1), 0–0. ''[Free Online]''
* Mitra, Ananda, "Characteristics of the WWW Text: Tracing Discursive Strategies," Journal of Computer-Mediated Communication, V.5, N. 1, September, 1999. [Free Online]
* Kaun, Anne (2010), "[http://ejournals.library.ualberta.ca/index.php/IJQM/article/view/7165 Open-Ended Online Diaries: Capturing Life as it is Narrated]," International Journal of Qualitative Methods, Vol. 9 Issue 2, p133-148. ''[Free Online]''
* Kaun, Anne (2010), "Open-Ended Online Diaries: Capturing Life as it is Narrated," International Journal of Qualitative Methods, Vol. 9 Issue 2, p133-148. [Available through UW Libraries]
* Gubrium, Aline and K.C. Nat Turner, "Digital storytelling as an emergent method for social research and practice," Ch. 21 in HET.


Visual Analysis:
Discourse Analysis:


* Hochman, N., & Schwartz, R. (2012). [https://www.aaai.org/ocs/index.php/ICWSM/ICWSM12/paper/view/4782 Visualizing Instagram: Tracing Cultural Visual Rhythms]. In Sixth International AAAI Conference on Weblogs and Social Media. ''[Available through UW Libraries]''
* Honeycutt, Courtenay (2005), “Hazing as a process of boundary maintenance in an online community”, Journal of Computer-Mediated Communication, 10(2). [Available through UW Libraries]
* Hochman, N., & Manovich, L. (2013). [http://firstmonday.org/ojs/index.php/fm/article/viewArticle/4711/ Zooming into an Instagram City: Reading the local through social media]. First Monday, 18(7). ''[Free Online]''
:Note: Combines quantitative and qualitative computer-mediated discourse analysis methods.*


'''Optional Readings:'''
Narrative Analysis:
*  Gubrium, Aline and K.C. Nat Turner, "[https://canvas.uw.edu/files/36418703/download?download_frd=1 Digital storytelling as an emergent method for social research and practice]," Ch. 21 in HET.


Visual Analysis:
Visual Analysis:


* Newbold, Curtis, 2013, "[http://thevisualcommunicationguy.com/2015/01/12/how-to-do-a-visual-analysis-a-five-step-process/ How to Do a Visual Analysis (A 5-Step Process)]". ''[Free Online]''
* Newbold, Curtis, 2013, "How to Do a Visual Analysis (A 5-Step Process)". [Free Online]
: Note: Although I'm not a fan of infograpraphics as a genre, I suppose it makes sense that visual communication people would put together a pretty good one! If you're already familiar with visual analysis from the rhetorical tradition, there's not going to be a lot new here. If this is new for you, this will help you frame and understand the other readings.
: Note: Although I'm not a fan of infograpraphics as a genre, I suppose it makes sense that visual communication people would put together a pretty good one! If you're already familiar with visual analysis from the rhetorical tradition, there's not going to be a lot new here. If this is new for you, this will help you frame and understand the other readings.
* Torralba, A. (2009). [http://videolectures.net/nips09_torralba_uvs/ Understanding Visual Scenes]. Tutorial presented at the NIPS, Vancouver, BC, Canada. Part I. ''[Free Online]''
* Baab, L. M. (2008). Portraits of the future church: A rhetorical analysis of congregational websites. Journal of Communication and Religion, 31(2), 143–181. [Free Online]
: Note: Lynne did her PhD in the UW Communication Deptartment, and this article is based on one of the chapters from her dissertation. She developed the initial research design for this study as a student in an earlier version of this course.
* Hochman, N., & Schwartz, R. (2012). Visualizing Instagram: Tracing Cultural Visual Rhythms. In Sixth International AAAI Conference on Weblogs and Social Media. [Available through UW Libraries]
* Hochman, N., & Manovich, L. (2013). Zooming into an Instagram City: Reading the local through social media. First Monday, 18(7). [Free Online]
 
'''Optional Readings:'''
* Torralba, A. (2009). Understanding Visual Scenes. Tutorial presented at the NIPS, Vancouver, BC, Canada. Part I. [Free Online]
: Note: This is a two part (each part is one hour) lecture and tutorial by a expert in computer vision. I strongly recommend watching Part I. I think this gives you a good sense of the nature of the kinds of challenges that were (and still are) facing the field of computer vision and anybody trying to have their computer look at images.
: Note: This is a two part (each part is one hour) lecture and tutorial by a expert in computer vision. I strongly recommend watching Part I. I think this gives you a good sense of the nature of the kinds of challenges that were (and still are) facing the field of computer vision and anybody trying to have their computer look at images.


These five paper are all technical approaches to doing image classification using datasets from Internet-based datasets of images like Flickr, Google Image Search, Google Street View, or Instagram. Each of these describes interesting and challenges technical issues. If you're interested, it would be a great idea to read these to get a sense for the state of the art and what is and isn't possible:
These five paper are all technical approaches to doing image classification using datasets from Internet-based datasets of images like Flickr, Google Image Search, Google Street View, or Instagram. Each of these describes interesting and challenges technical issues. If you're interested, it would be a great idea to read these to get a sense for the state of the art and what is and isn't possible:


* Jaffe, A., Naaman, M., Tassa, T., & Davis, M. (2006). [http://doi.org/10.1145/1178677.1178692 Generating Summaries and Visualization for Large Collections of Geo-referenced Photographs]. In Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval (pp. 89–98). New York, NY, USA: ACM. ''[Available through UW Libraries]''
* Jaffe, A., Naaman, M., Tassa, T., & Davis, M. (2006). Generating Summaries and Visualization for Large Collections of Geo-referenced Photographs. In Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval (pp. 89–98). New York, NY, USA: ACM. [Available through UW Libraries]
* Simon, I., Snavely, N., & Seitz, S. M. (2007). [http://doi.org/10.1109/ICCV.2007.4408863 Scene Summarization for Online Image Collections]. In Computer Vision, IEEE International Conference on (Vol. 0, pp. 1–8). Los Alamitos, CA, USA: IEEE Computer Society. ''[Free Online]''
* Simon, I., Snavely, N., & Seitz, S. M. (2007). Scene Summarization for Online Image Collections. In Computer Vision, IEEE International Conference on (Vol. 0, pp. 1–8). Los Alamitos, CA, USA: IEEE Computer Society. [Free Online]
* Crandall, D. J., Backstrom, L., Huttenlocher, D., & Kleinberg, J. (2009). [http://doi.org/10.1145/1526709.1526812 Mapping the World’s Photos]. In Proceedings of the 18th International Conference on World Wide Web (pp. 761–770). New York, NY, USA: ACM. ''[Available through UW Libraries]''
* Crandall, D. J., Backstrom, L., Huttenlocher, D., & Kleinberg, J. (2009). Mapping the World’s Photos. In Proceedings of the 18th International Conference on World Wide Web (pp. 761–770). New York, NY, USA: ACM. [Available through UW Libraries]
* San Pedro, J., & Siersdorfer, S. (2009). [http://doi.org/10.1145/1526709.1526813 Ranking and Classifying Attractiveness of Photos in Folksonomies]. In Proceedings of the 18th International Conference on World Wide Web (pp. 771–780). New York, NY, USA: ACM. ''[Available through UW Libraries]''
* San Pedro, J., & Siersdorfer, S. (2009). Ranking and Classifying Attractiveness of Photos in Folksonomies. In Proceedings of the 18th International Conference on World Wide Web (pp. 771–780). New York, NY, USA: ACM. [Available through UW Libraries]
* Doersch, C., Singh, S., Gupta, A., Sivic, J., & Efros, A. A. (2012). [http://doi.org/10.1145/2185520.2185597 What Makes Paris Look Like Paris?] ACM Trans. Graph., 31(4), 101:1–101:9. ''[Available through UW Libraries]''
* Doersch, C., Singh, S., Gupta, A., Sivic, J., & Efros, A. A. (2012). What Makes Paris Look Like Paris? ACM Trans. Graph., 31(4), 101:1–101:9. [Available through UW Libraries]


Discourse Analysis:
=== Week 6: Wednesday May 4: Design Research ===


* Honeycutt, Courtenay (2005), “[http://onlinelibrary.wiley.com/enhanced/doi/10.1111/j.1083-6101.2005.tb00240.x Hazing as a process of boundary maintenance in an online community]”, Journal of Computer-Mediated Communication, 10(2). [Available through UW Libraries]
'''To Be Decided'''
:Note: Combines quantitative and qualitative computer-mediated discourse analysis methods.*
 
=== Week 6: Wednesday May 4: Crowdsourced Data Analysis and Experimentation ===
 
'''Assignment:'''
 
* Find and complete at least 2 "hits" as a worker on [http://mturk.com Amazon Mechnical Turk]. Note that to do this you will need to create a ''worker'' account on Mturk.
** Record (write down) details and notes about your tasks: What did you do? Who was the requester? What could you was the purpose of the task (as best you could tell)? What was the experience like? What research applications can you (not) imagine for this kind of system?
* Design and deploy a small-scale research task on Mturk. Note that to do this, you will need to create a ''requester'' account on Mturk. Be sure to allow some time to get the task design the way you want it! Some ideas for study designs you might do:
** A small survey.
** Classification of texts or images (e.g., label tweets, pictures, or comments from a discussion thread).
** A small experiment (e.g., you can do a survey where you insert ''different'' images and ask the same set of questions. Check out the [https://requester.mturk.com/help/getting_started.html Mturk requester getting started guide]
* Prepare to share details of your small-scale research task in class, including results (they will come fast).
 
''Note:'' In terms of running your task, it will cost real money and you have to put money on your Amazon account yourself. You've each got a $3 budget. Please use your credit card to put $3 on your account right away. I will pay each of you $3 in cash next week to reimburse you for the cost of running the experiment.
 
'''Required Readings:'''
 
* [https://docs.aws.amazon.com/AWSMechTurk/latest/RequesterUI/Introduction.html Amazon Mechanical Turk Requester UI Guide] ''[Free Online]''
* [https://mturkpublic.s3.amazonaws.com/docs/MTURK_BP.pdf Amazon Mechanical Turk Best Practices Guide]. ''[Free Online]''
* Weinberg, J., Freese, J., & McElhattan, D. (2014). [https://www.sociologicalscience.com/articles-vol1-19-292/ Comparing Data Characteristics and Results of an Online Factorial Survey between a Population-Based and a Crowdsource-Recruited Sample]. Sociological Science, 1, 292–310. ''[Free Online]''
* Shaw, A. (2015). [https://canvas.uw.edu/files/36419326/download?download_frd=1 Hired Hands and Dubious Guesses: Adventures in Crowdsourced Data Collection]. In E. Hargittai & C. Sandvig (Eds.), Digital Research Confidential: The Secrets of Studying Behavior Online. The MIT Press. ''[Available in Canvas]''
 
'''Optional Readings:'''
 
* Gray, M. L., Suri, S., Ali, S. S., & Kulkarni, D. (2016). [http://sidsuri.com/Publications_files/collab_paper21.pdf The Crowd is a Collaborative Network]. Proceedings of Computer-Supported Cooperative Work. ''[Free Online]''
* Kittur et al. (2013). [http://hci.stanford.edu/publications/2013/CrowdWork/futureofcrowdwork-cscw2013.pdf The Future of Crowd Work]. Proceedings of Computer-Supported Cooperative Work. ''[Free Online]''
 
'''Resources:'''
* [http://www.mturk-tracker.com/ Mturk Tracker]


=== Week 6: Saturday May 7: CDSW Session 3 ===
=== Week 6: Saturday May 7: CDSW Session 3 ===
Line 525: Line 491:
This session will run from 9am-3pm. Details on the [[CDSW Spring 2016]] page.
This session will run from 9am-3pm. Details on the [[CDSW Spring 2016]] page.


=== Week 7: Monday May 9: Consulting Week (i.e., no group meeting) ===
=== Week 7: Monday May 9: NO CLASS (Consulting Week) ===


During this week, we not meet together. Instead, I will schedule one-on-one in person meetings of an hour with each student individually to catch up with you about your project and to work directly with you to resolve any technical issues you have run into with data collection, etc.
During this week, we not meet together. Instead, I will schedule one-on-one in person meetings of at least half an hour with each student individually to catch up with about your project and to work directly with you to resolve any technical issues you have run into with data collection, etc.


=== Week 7: Wednesday May 11: Consulting Week (i.e., no group meeting) ===
=== Week 7: Wednesday May 11: NO CLASS (Consulting Week) ===
=== Week 8: Monday May 16: Crowdsourced Data Analysis ===


=== Week 8: Monday May 16: Consulting Week (i.e., no group meeting) ===
'''Assignment:'''
 
During this week, we not meet together. Instead, I will schedule one-on-one in person meetings of an hour with each student individually to catch up with you about your project and to work directly with you to resolve any technical issues you have run into with data collect


=== Week 8: Wednesday May 18: Consulting Week (i.e., no group meeting) ===
* Find and complete at least 2 "hits" as a worker on Amazon Mechnical Turk.
 
* Forthcoming assignment on running your own hit on AMT. I'm currently waiting for details from a collaborator who used a similar assignment similar in the past.
=== Week 9: Monday May 23: Design Research ===
 
Today we'll have a guest visitor — [http://www.andresmh.com/ Andrés Monroy-Hernández] from [http://fuse.microsoft.com/ Microsoft Resarch's FUSE labs] and affiliate faculty in the Department of Communication and Department of Human-Centered Design and Engineering at UW. Monroy-Hernández research involves studying people by designing and building systems. He's built a number of very large and successful socio-technical systems as part of his research. In his graduate work, he build the [http://scratch.mit.edu/ Scratch Online Community] which is now used by more than 10 million people.
 
I've asked him to come and talk to us about design research as a process. As a result, it will be helpful to read about two projects he has worked on recently that he will talked to us about. Those projects are called NewsPad and Eventful.


'''Required Readings:'''
'''Required Readings:'''


* Olsen, D. R., Jr. (2007). [http://doi.org/10.1145/1294211.1294256 Evaluating User Interface Systems Research.] In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (pp. 251–258). New York, NY, USA: ACM. [Available through UW Libraries]
* Amazon Mechanical Turk Requester UI Guide (pp. 1-15). [Free Online]
* J. Nathan Matias and Andres Monroy-Hernandez, [http://research.microsoft.com/apps/pubs/default.aspx?id=208886 NewsPad: Designing for Collaborative Storytelling in Neighborhoods]. CHI Work in Progress Paper. ACM, March 2014.
* Amazon Mechanical Turk Best Practices Guide. [Free Online]
* Elena Agapie, Jaime Teevan, and Andrés Monroy-Hernández, [http://research.microsoft.com/apps/pubs/default.aspx?id=252315 Crowdsourcing in the Field: A Case Study Using Local Crowds for Event Reporting], in Human Computation (HCOMP), AAAI - Association for the Advancement of Artificial Intelligence, August 2015.
* Weinberg, J., Freese, J., & McElhattan, D. (2014). Comparing Data Characteristics and Results of an Online Factorial Survey between a Population-Based and a Crowdsource-Recruited Sample. Sociological Science, 1, 292–310. [Free Online]
* Two very short videos describing the systems: [http://research.microsoft.com/en-us/projects/newspad/ NewsPad by FUSE Labs] and [http://research.microsoft.com/en-us/projects/eventful/ Eventful by FUSE Labs]
* Shaw, A. (2015). Hired Hands and Dubious Guesses: Adventures in Crowdsourced Data Collection. In E. Hargittai & C. Sandvig (Eds.), Digital Research Confidential: The Secrets of Studying Behavior Online. The MIT Press. [Available in Canvas]


=== Week 9: Wednesday May 25: Digital Trace and Sensor Data ===
=== Week 8: Wednesday May 18: TBD ===
=== Week 9: Monday May 23: Sensor Data ===


'''Required Readings:'''
'''Required Readings:'''


Read any 2 of these 4 chapters from the [https://global.oup.com/academic/product/the-handbook-of-emergent-technologies-in-social-research-9780195373592 Handbook of Emerging Technology in Social Research]:
Read any 2 of these 4 HET chapters:
 
* Eagle, Nathan, "[https://canvas.uw.edu/files/36870285/download?download_frd=1 Mobile phones as sensors for social research]," Ch. 22 in HET.
* Visser, Albertine and Ingrid Mulder, "[https://canvas.uw.edu/files/36870283/download?download_frd=1 Emergent technologies for assessing social feelings and experiences]," Ch. 16 in HET.
* de Haan, Geert, et. al., "[https://canvas.uw.edu/files/36870284/download?download_frd=1 Bringing the research lab into everyday life: Exploiting sensitive environments to acquire data for social research]," Ch. 23 in HET.
* Fowler, Chris, et. al., "[https://canvas.uw.edu/files/36870282/download?download_frd=1 Living laboratories: Social research applications and evaluations]," Ch. 27 in HET.
* Holohan, Anne, et. al., "[https://canvas.uw.edu/files/36870280/download?download_frd=1 The digital home: A new locus of social science research]," Ch. 28 in HET.


=== Week 10: Monday May 30: Final Presentations  ===
* Eagle, Nathan, "Mobile phones as sensors for social research," Ch. 22 in HET.
=== Week 10: Wednesday June 1: Final Presentations  ===
* Visser, Albertine and Ingrid Mulder, "Emergent technologies for assessing social feelings and experiences," Ch. 16 in HET.
* de Haan, Geert, et. al., "Bringing the research lab into everyday life: Exploiting sensitive environments to acquire data for social research," Ch. 23 in HET.
* Fowler, Chris, et. al., "Living laboratories: Social research applications and evaluations," Ch. 27 in HET.
* Holohan, Anne, et. al., "The digital home: A new locus of social science research," Ch. 28 in HET.


=== Not Covered: Hyperlink Networks ===
=== Week 9: Wednesday May 25: Hyperlink Networks ===


* Jackson, Michele, (1997), "Assessing the Structure of the Communication on the World Wide Web," Journal of Computer-Mediated Communication, V. 3, N. 1, June, 1997.
* Jackson, Michele, (1997), "Assessing the Structure of the Communication on the World Wide Web," Journal of Computer-Mediated Communication, V. 3, N. 1, June, 1997.
* Jackson, Michele, (2011), "What Should Researchers Infer From Links on an Organization's Site?", blog post at http://assett.colorado.edu/jackson/what-should-researchers-infer-from-links-on-an-organizations-site/
* Jackson, Michele, (2011), "What Should Researchers Infer From Links on an Organization's Site?", blog post at http://assett.colorado.edu/jackson/what-should-researchers-infer-from-links-on-an-organizations-site/
* Olesen, Thomas (2004), "The Transnational Zapatista Solidarity Network: An Infrastructure Analysis," Global Networks, 4(1):89-107 [Although this article uses the term infrastructure analysis, the method employed is best described as a hyperlink network analysis.]
* Olesen, Thomas (2004), "The Transnational Zapatista Solidarity Network: An Infrastructure Analysis," Global Networks, 4(1):89-107 [Although this article uses the term infrastructure analysis, the method employed is best described as a hyperlink network analysis.]
=== Week 10: Monday May 30: Final Presentations  ===
=== Week 10: Wednesday June 1: Final Presentations  ===


== Administrative Notes ==
== Administrative Notes ==
Please note that all contributions to CommunityData are considered to be released under the Attribution-Share Alike 3.0 Unported (see CommunityData:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To protect the wiki against automated edit spam, we kindly ask you to solve the following CAPTCHA:

Cancel Editing help (opens in new window)