Editing Internet Research Methods (Spring 2016)

From CommunityData
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.

Latest revision Your text
Line 252: Line 252:
=== Week 2: Wednesday April 6: Web Archiving ===
=== Week 2: Wednesday April 6: Web Archiving ===


<!-- NOTE: probably drop rogers; probably add chapter 2 in eszter and christian's book -->
'''Facilitator:''' Janny
'''Facilitator:''' Janny


Line 260: Line 259:
* Schneider, Steven, Kirsten Foot, and Paul Wouters, 2009, “[https://canvas.uw.edu/files/35982270/download?download_frd=1 Web Archiving as E-Research],” in e-Research: Transformation in Scholarly Practice, Nicholas Jankowski (Ed.), Routledge, pp. 205-221. ''[Available in Canvas]''
* Schneider, Steven, Kirsten Foot, and Paul Wouters, 2009, “[https://canvas.uw.edu/files/35982270/download?download_frd=1 Web Archiving as E-Research],” in e-Research: Transformation in Scholarly Practice, Nicholas Jankowski (Ed.), Routledge, pp. 205-221. ''[Available in Canvas]''
* Brügger, N. (2011). [https://canvas.uw.edu/files/35981768/download?download_frd=1 Web archiving—Between past, present, and future.] In M. Consalvo & C. Ess (Eds.), The Handbook of Internet Studies (pp. 24–42). Chichester, West Susssex: Blackwell. ''[Available in Canvas]''
* Brügger, N. (2011). [https://canvas.uw.edu/files/35981768/download?download_frd=1 Web archiving—Between past, present, and future.] In M. Consalvo & C. Ess (Eds.), The Handbook of Internet Studies (pp. 24–42). Chichester, West Susssex: Blackwell. ''[Available in Canvas]''
* Rogers, Richard, Chapter 3 "[https://canvas.uw.edu/files/35982101/download?download_frd=1 The Website as Archived Object]" from Digital Methods, pp. 61-82. ''[Available through Canvas]''<!-- REMOVE NEXT TIME -->
* Rogers, Richard, Chapter 3 "[https://canvas.uw.edu/files/35982101/download?download_frd=1 The Website as Archived Object]" from Digital Methods, pp. 61-82. ''[Available through Canvas]''
* Graeff, E., Stempeck, M., & Zuckerman, E. (2014). [http://firstmonday.org/ojs/index.php/fm/article/view/4947 The battle for “Trayvon Martin”: Mapping a media controversy online and off-line.] First Monday, 19(2). ''[Free Online]''
* Graeff, E., Stempeck, M., & Zuckerman, E. (2014). [http://firstmonday.org/ojs/index.php/fm/article/view/4947 The battle for “Trayvon Martin”: Mapping a media controversy online and off-line.] First Monday, 19(2). ''[Free Online]''


Line 297: Line 296:


'''Optional Readings:'''
'''Optional Readings:'''
I'm assuming you have at least a rough familiarity with [https://en.wikipedia.org/wiki/Content_analysis content analysis] as a methodology. If your not as comfortable with this, check out the Wikipedia article to start. These help provide more of a background into content analysis (in general, and online):


* Van Selm, Martine & Jankowski, Nick, (2005) "[https://canvas.uw.edu/files/36066292/download?download_frd=1 Content Analysis of Internet-Based Documents.]" Unpublished Manuscript. ''[Available in Canvas]''
* Van Selm, Martine & Jankowski, Nick, (2005) "[https://canvas.uw.edu/files/36066292/download?download_frd=1 Content Analysis of Internet-Based Documents.]" Unpublished Manuscript. ''[Available in Canvas]''
* Neuendorf, K. A. (2002). The content analysis guidebook. Thousand Oaks, Calif.: Sage Publications. ''[Available from Instructor]''
* Krippendorff, K. (2005). Content analysis: an introduction to its methodology. Thousand Oaks; London; New Delhi: Sage. ''[Available from Instructor]''
Examples of more traditional content analysis using online content:


* Trammell, K. D., Tarkowski, A., Hofmokl, J., & Sapp, A. M. (2006). [http://doi.org/10.1111/j.1083-6101.2006.00032.x Rzeczpospolita blogów (Republic of Blog): Examining Polish Bloggers Through Content Analysis.] Journal of Computer-Mediated Communication, 11(3), 702–722. ''[Free Online]''
Some other great examples of people using textual analysis include:
* Woolley, J. K., Limperos, A. M., & Oliver, M. B. (2010). [http://doi.org/10.1080/15205436.2010.516864 The 2008 Presidential Election, 2.0: A Content Analysis of User-Generated Political Facebook Groups.] Mass Communication and Society, 13(5), 631–652. ''[Available from UW Libraries]'''


Another example of topic modeling, but from political science:
* Trammell, K. D., Tarkowski, A., Hofmokl, J., & Sapp, A. M. (2006). [http://doi.org/10.1111/j.1083-6101.2006.00032.x Rzeczpospolita blogów (Republic of Blog): Examining Polish Bloggers Through Content Analysis.] Journal of Computer-Mediated Communication, 11(3), 702–722. ''[Available through UW Libraries]''
* Woolley, J. K., Limperos, A. M., & Oliver, M. B. (2010). [http://doi.org/10.1080/15205436.2010.516864
The 2008 Presidential Election, 2.0: A Content Analysis of User-Generated Political Facebook Groups.] Mass Communication and Society, 13(5), 631–652.


* Barberá, P., Bonneau, R., Egan, P., Jost, J. T., Nagler, J., & Tucker, J. (2014). [http://smapp.nyu.edu/SMAPP_Website_Papers_Articles/leadersAndFollowersMeasuringPolitical.pdf Leaders or Followers? Measuring Political Responsiveness in the US Congress Using Social Media Data.] Presented at the Annual Meeting of the American Political Science Association. ''[Free Online]''
* Barberá, P., Bonneau, R., Egan, P., Jost, J. T., Nagler, J., & Tucker, J. (2014). [http://smapp.nyu.edu/SMAPP_Website_Papers_Articles/leadersAndFollowersMeasuringPolitical.pdf Leaders or Followers? Measuring Political Responsiveness in the US Congress Using Social Media Data.] Presented at the Annual Meeting of the American Political Science Association. ''[Free Online]''
Line 319: Line 313:
'''Required Readings:'''
'''Required Readings:'''


* Robinson, Laura and Jeremy Schulz, "[https://canvas.uw.edu/files/36067312/download?download_frd=1 New fieldsites, new methods: New ethnographic opportunities]," Ch. 8 in HET. ''[Available in Canvas]''
* Murthy, Dhiraj, "Emergent digital ethnographic methods for social research," Ch. 7 in HET. [Available in Canvas]
* [Selections] Jemielniak, D. (2014). Common Knowledge?: An Ethnography of Wikipedia. Stanford, California: Stanford University Press. [https://canvas.uw.edu/files/36067463/download?download_frd=1 "Introduction" and "Appendix A: Methodology."] ''[Available in Canvas]''
* Robinson, Laura and Jeremy Schulz, "New fieldsites, new methods: New ethnographic opportunities," Ch. 8 in HET. [Available in Canvas]
* Geiger, R. S., & Ribes, D. (2010). [http://doi.org/10.1145/1718918.1718941 The Work of Sustaining Order in Wikipedia: The Banning of a Vandal.] In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (pp. 117–126). New York, NY, USA: ACM. ''[Available through UW Libraries]''
* Geiger, R. S. and Ribes, D. (2011), "Trace Ethnography: Following Coordination through Documentary Practices," Proceedings of the 44th Hawaii International Conference on System Sciences. [Available in Canvas]
* Geiger, R. S., & Ribes, D. (2011). [http://doi.org/10.1109/HICSS.2011.455 Trace Ethnography: Following Coordination Through Documentary Practices.] In Proceedings of the 2011 44th Hawaii International Conference on System Sciences (pp. 1–10). Washington, DC, USA: IEEE Computer Society. ''[Available through UW Libraries]''
* Response by danah boyd To Hine's "Question One: How Can Qualitative Internet Researchers Define the Boundaries of Their Projects?" from Internet Inquiry: Conversations About Method, Annette Markham and Nancy Baym (Eds.), Sage, 2009, pp. 1-32. [Available in Canvas]
:Note: You may also be interest in reading the essay by Hine that boyd is responding to. [Available in Canvas]
* [Selections] Jemielniak, D. (2014). Common Knowledge?: An Ethnography of Wikipedia. Stanford, California: Stanford University Press. "Introduction" and "Appendix A: Methodology." [Available in Canvas]
 
'''Optional Readings:'''
'''Optional Readings:'''


* Coleman, E. G. (2010). [http://doi.org/10.1146/annurev.anthro.012809.104945 Ethnographic Approaches to Digital Media.] Annual Review of Anthropology, 39(1), 487–505. ''[Available through UW Libraries]''
* Paccagnella, Luciano (1997), “Getting the Seat of Your Pants Dirty: Strategies for Ethnographic Research on Virtual Communities,” Journal of Computer-Mediated Communication, 3(1), June. [Available through UW Libraries]
* [https://canvas.uw.edu/files/36079509/download?download_frd=1 Response by danah boyd To Hine's "Question One: How Can Qualitative Internet Researchers Define the Boundaries of Their Projects?"] from Internet Inquiry: Conversations About Method, Annette Markham and Nancy Baym (Eds.), Sage, 2009, pp. 1-32. ''[Available in Canvas]''
: Note: This is one of the early academic articles about online participant observation; I recommend it to those who want to read some early pointers.
:Note: You may also be interest in reading [https://canvas.uw.edu/files/36079510/download?download_frd=1 the essay by Hine that boyd is responding to]. ''[Available in Canvas]''
* Humphreys, L. 2007. Mobile social networks and social practice: A case study of dodgeball. Journal of Computer-Mediated Communication (13) 1. [Available through UW Libraries]
 
This is the canonical book-length account and ''the'' main citation in this space:
 
* Hine, C. (2000). Virtual ethnography. London, UK: SAGE Publications. ''[Available from Instructor]''
 
These are all other interesting and/or frequently cited examples of Internet-based ethnographies:
 
* Humphreys, L. (2007). [http://doi.org/10.1111/j.1083-6101.2007.00399.x Mobile Social Networks and Social Practice: A Case Study of Dodgeball.] Journal of Computer-Mediated Communication, 13(1), 341–360. ''[Available through UW Libraries]''
: Note: Dodgeball is a mobile social network system (MSNS) that allows groups of friends to connect and meet up via mobile phone. The author employed participant observation in order to understand norms of interaction in the MSNS "space".
: Note: Dodgeball is a mobile social network system (MSNS) that allows groups of friends to connect and meet up via mobile phone. The author employed participant observation in order to understand norms of interaction in the MSNS "space".
* Brotsky, S. R., & Giles, D. (2007). [http://doi.org/10.1080/10640260701190600 Inside the “Pro-ana” Community: A Covert Online Participant Observation.] Eating Disorders, 15(2), 93–109. ''[Available through UW Libraries]''
* Brotsky, Sarah R. and David Giles. 2007. “Inside the ‘Pro-Ana’ Community: A Covert Participation Observation.Eating Disorders: pro The Journal of Treatment & Prevention 15(2): 93-109 (http://www.tandfonline.com/doi/abs/10.1080/10640260701190600)
:Note: To conduct the study reported in this paper the authors created a used a fake profile in order to observe the psychological support offered to participants.
:Note: To conduct the study reported in this paper the authors created a used a fake profile in order to observe the psychological support offered to participants.
* Williams, M. (2007). [http://doi.org/10.1177/1468794107071408 Avatar watching: participant observation in graphical online environments.] Qualitative Research, 7(1), 5–24. ''[Available through UW Libraries]''
* Beaulieu, Anne, and Mette Terp Hoybye, "Studying mailing lists: Text, temporality, interaction, and materiality at the intersection of e-mail and the web," Ch. 11 in HET. [Available in Canvas]
: Note: Fantastic more general introduction but takeaways that are more specifically targetted toward people studying virtual reality type environments with virtual physicality.
* Williams, Matthew. 2007. “Avatar Watching: Participant Observation in Graphical Environments.Qualitative Research 7(1): 5-24. [Available through UW Libraries]
 
: Note: Fantastic more general introduction but takeaways that are more specifically targetted toward people studying virtual reality type environments with virtual [hysicality.
'''Apropos of class discussion:'''
* Coleman, E. G. (2010). Ethnographic Approaches to Digital Media. Annual Review of Anthropology, 39(1), 487–505. [Available through UW Libraries]
 
* Borges, J. L. (1998). [https://canvas.uw.edu/files/36195543/download?download_frd=1 Pierre Mendard, author of the Quixote]. In A. Hurley (Trans.), Collected Fictions (pp. 88–95). New York, N.Y., U.S.A: Viking Press. ''[Available in Canvas]''
* Maxwell, J. A. (2002). [https://canvas.uw.edu/files/36195592/download?download_frd=1 Understanding and validity in qualitative research]. In A. M. Huberman & M. B. Miles (Eds.), The Qualitative Researcher’s Companion (pp. 37–64). SAGE. ''[Available in Canvas]''


=== Week 4: Monday April 18: Online Interviews ===
=== Week 4: Monday April 18: Online Interviews ===
Line 353: Line 339:
'''Required Readings:'''
'''Required Readings:'''


* O’Connor, H., Madge, C., Shaw, R., & Wellens, J. (2008). [http://srmo.sagepub.com/view/the-sage-handbook-of-online-research-methods/n15.xml Internet-based Interviewing]. In N. G. Fielding, R. M. Lee, & G. Blank (Eds.), The SAGE Handbook of Online Research Methods (pp. 271–289). London, UK: SAGE Publications, Ltd. ''[Available through UW Libraries]''
* Markham, Annette (1998), "The Shifting Project, the Shifting Self," from Life Online, Altamira Press, 1998, pp. 61-84. [Available in Canvas]
* Stewart, K., & Williams, M. (2005). [http://doi.org/10.1177/1468794105056916 Researching online populations: the use of online focus groups for social research.] Qualitative Research, 5(4), 395–416.
: Note: One of the earliest books on online life and one of the earliest attempts to do online interviewing. This is dated, but highlight some important challenge.
* Hanna, P. (2012). [http://doi.org/10.1177/1468794111426607 Using internet technologies (such as Skype) as a research medium: a research note.] Qualitative Research, 12(2), 239–242. ''[Available through UW Libraries]''
* Stromer-Galley, Jennifer (2003), "Depth Interviews for the Study of Motives and Perceptions of Internet Use," International Communication Association, San Diego, May. [Available in Canvas]
: Note: Start reading on page 8 on "The Internet and the Interview". The beginning is a theoretical argument that's not really relevant to this class.
* Hanna, P. (2012). Using internet technologies (such as Skype) as a research medium: a research note. Qualitative Research, 12(2), 239-242. [Available through UW Libraries]
: Note: Short article you can basically skim. Read it quickly so you can cite it later.
: Note: Short article you can basically skim. Read it quickly so you can cite it later.
* Dowling, S. (2012). [http://srmo.sagepub.com/view/cases-in-online-interview-research/n11.xml Online Asynchronous and Face-to-Face Interviewing: Comparing Methods for Exploring Women’s Experiences of Breastfeeding Long Term]. In Salmons, J. (Ed.), Cases in Online Interview Research (pp. 277–303). 2455 Teller Road,  Thousand Oaks  California  91320  United States: SAGE Publications, Inc. ''[Available through UW Libraries]''
* Morgan, David L. and Bojana Lobe, "Online focus groups," Ch. 9 in HET. [Available in Canvas]


'''Optional Readings:'''
'''Optional Readings:'''


* boyd, danah. (2015). [https://canvas.uw.edu/files/36133652/download?download_frd=1 Making sense of teen life: Strategies for capturing ethnographic data in a networked era.] In E. Hargittai & C. Sandvig (Eds.), Digital Research Confidential: The Secrets of Studying Behavior Online. Cambridge, Massachusetts: The MIT Press. ''[Available in Canvas]''
* Salmons, J. (2014). Qualitative Online Interviews: Strategies, Design, and Skills. SAGE Publications. [Publisher Page]
: Note: Strongly focused on enthnographic interviews with tons of very specific details. Fantastic article on interviewing, although perhaps a bit weak on Internet specific advice.
* danah boyd. (Forthcoming). “Making Sense of Teen Life: Strategies for Capturing Ethnographic Data in a Networked Era.In Hargittai, E. & Sandvig, C. (Eds.) Digital Research Confidential: The Secrets of Studying Behavior Online. Cambridge, MA: MIT Press. [Available in Canvas]
* Markham, Annette (1998), "[https://canvas.uw.edu/files/36133806/download?download_frd=1 The Shifting Project, the Shifting Self]," from Life Online, Altamira Press, 1998, pp. 61-84. ''[Available in Canvas]''
: Note: Strongly focused on enthnographic interviews with tons of very specific details. Fantastic article on interviewing, but a bit weak on Internet specific advice.
: Note: One of the earliest books on online life and one of the earliest attempts to do online interviewing. This is dated, but highlight some important challenge.
* Chou, C. (2001). Internet heavy use and addiction among Taiwanese college students: an online interview study. CyberPsychology & Behavior, 4(5), 573-585. [Available through UW Libraries]
* Stromer-Galley, Jennifer (2003), "[https://canvas.uw.edu/files/36133838/download?download_frd=1 Depth Interviews for the Study of Motives and Perceptions of Internet Use]," International Communication Association, San Diego, May. ''[Available in Canvas]''
: Note: Start reading on page 8 on "The Internet and the Interview". The beginning is a theoretical argument that's not really relevant to this class.* Chou, C. (2001). [http://online.liebertpub.com/doi/abs/10.1089/109493101753235160 Internet heavy use and addiction among Taiwanese college students: an online interview study.] CyberPsychology & Behavior, 4(5), 573-585. ''[Available through UW Libraries]''
 
'''Alternate Accounts:'''
 
These texts are largely redundant to the required texts above but do provide a different perspective and examples:
 
* Salmons, J. (2014). Qualitative Online Interviews: Strategies, Design, and Skills. SAGE Publications.
: This is a book that lays out what claims to be a comprehensive account to online interviewing. Take a quick through the [https://canvas.uw.edu/files/36133582/download?download_frd=1 preface and table of contents] and read [https://canvas.uw.edu/files/36133581/download?download_frd=1 Chapter 1]. ''[Both Available in Canvas.]''
: I have the book and am happy to loan my copy to anybody in the class that thinks this will be a core part of their research.
* Morgan, David L. and Bojana Lobe, "[https://canvas.uw.edu/files/36133861/download?download_frd=1 Online focus groups]," Ch. 9 in HET. ''[Available in Canvas]''
* Gaiser, T. J. (2008). [http://srmo.sagepub.com/view/the-sage-handbook-of-online-research-methods/n16.xml Online Focus Groups]. In N. G. Fielding, R. M. Lee, & G. Blank (Eds.), The SAGE Handbook of Online Research Methods (pp. 290–307). London, UK: SAGE Publications, Ltd. ''[Available through UW Libraries]''


=== Week 4: Wednesday April 20: Social Network Analysis ===
=== Week 4: Wednesday April 20: Social Network Analysis ===
Line 384: Line 360:
'''Required Readings:'''
'''Required Readings:'''


* Garton, Laura, Caroline Haythornthwaite, and Barry Wellman, "[http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.1997.tb00062.x/abstract Studying Online Social Networks]," Journal of Computer-Mediated Communication, V. 3, N. 1, June, 1997. ''[Free Online]''
* Garton, Laura, Caroline Haythornthwaite, and Barry Wellman, "Studying Online Social Networks," Journal of Computer-Mediated Communication, V. 3, N. 1, June, 1997. [Free Online]
* Mislove, Alan, et al (2007), "[https://dl.acm.org/citation.cfm?id=1298311 Measurement and Analysis of Online Social Networks]," IMC 2007, October 24-27, San Diego, CA ''[Available through UW Libraries]''
* Howard, Phil, "Network Ethnography and Hypermedia Organization: New Organizations, New Media, New Myths," New Media and Society, December 2002, 4(4), pp. 550-574. [Available through UW Libraries]
* Howard, Phil, "[http://nms.sagepub.com/content/4/4/550.short Network Ethnography and Hypermedia Organization: New Organizations, New Media, New Myths]," New Media and Society, December 2002, 4(4), pp. 550-574. ''[Available through UW Libraries]''
* Mislove, Alan, et al (2007), "Measurement and Analysis of Online Social Networks," IMC 2007, October 24-27, San Diego, CA [Available Through UW Libraries]
* Keegan, B., Gergle, D., & Contractor, N. (2013). [http://abs.sagepub.com/content/57/5/595 Hot Off the Wiki Structures and Dynamics of Wikipedia’s Coverage of Breaking News Events.] American Behavioral Scientist, 57(5), 595–622. ''[Available through UW Libraries]''  <!-- REMOVE NEXT TIME -->
* Keegan, B., Gergle, D., & Contractor, N. (2013). Hot Off the Wiki Structures and Dynamics of Wikipedia’s Coverage of Breaking News Events. American Behavioral Scientist, 57(5), 595–622. [Free Online]


=== Week 4: Saturday April 23: CDSW Session 2 ===
=== Week 4: Saturday April 23: CDSW Session 2 ===
Line 401: Line 377:
'''Required Readings:'''
'''Required Readings:'''


* Reips, U.-D. (2002). [http://doi.org/10.1026//1618-3169.49.4.243 Standards for Internet-based experimenting]. Experimental Psychology, 49(4), 243–256. [[http://iscience.deusto.es/wp-content/uploads/2010/04/ulf27.pdf Alternate Link]]
* Hergueux, J., & Jacquemet, N. (2014). Social preferences in the online laboratory: a randomized experiment. Experimental Economics, 18(2), 251–283. [Available through UW Libraries]
* Hergueux, J., & Jacquemet, N. (2014). [http://doi.org/10.1007/s10683-014-9400-5 Social preferences in the online laboratory: a randomized experiment]. Experimental Economics, 18(2), 251–283. ''[Available through UW Libraries]''
* Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006). Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market. Science, 311(5762), 854–856. [Available through UW Libraries]
* Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006). [http://doi.org/10.1126/science.1121066 Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market]. Science, 311(5762), 854–856. ''[Available through UW Libraries]''
* Restivo, M., & van de Rijt, A. (2012). Experimental Study of Informal Rewards in Peer Production. PLoS ONE, 7(3), e34358. [Free Online]
* Rijt, A. van de, Kang, S. M., Restivo, M., & Patil, A. (2014). [http://doi.org/10.1073/pnas.1316836111 Field experiments of success-breeds-success dynamics]. Proceedings of the National Academy of Sciences, 111(19), 6934–6939. ''[Available through UW Libraries]'' [[http://www.akshaynpatil.com/papers/success.pdf Alternative Link]]
* Bond, R. M., Fariss, C. J., Jones, J. J., Kramer, A. D. I., Marlow, C., Settle, J. E., & Fowler, J. H. (2012). A 61-million-person experiment in social influence and political mobilization. Nature, 489(7415), 295–298. [Available through UW Libraries]
* Bond, R. M., Fariss, C. J., Jones, J. J., Kramer, A. D. I., Marlow, C., Settle, J. E., & Fowler, J. H. (2012). [http://doi.org/10.1038/nature11421 A 61-million-person experiment in social influence and political mobilization]. Nature, 489(7415), 295–298. ''[Available through UW Libraries]''
* Cosley, D., Frankowski, D., Terveen, L., & Riedl, J. (2007). SuggestBot: Using Intelligent Task Routing to Help People Find Work in Wikipedia. In Proceedings of the 12th International Conference on Intelligent User Interfaces (pp. 32–41). New York, NY, USA: ACM. [Available through UW Libraries]
* Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences, 111(24), 8788–8790. [Available through UW Libraries]
: Note: We've already read but I'd like to discuss it again.


'''Optional Readings:'''
'''Optional Readings:'''


* Zhu, H., Zhang, A., He, J., Kraut, R., & Kittur, A. (2013). [http://doi.org/10.1145/2470654.2481311 Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia]. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Paris, France: ACM. ''[Available through UW Libraries]''
* Zhu, H., Zhang, A., He, J., Kraut, R., & Kittur, A. (2013). Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Paris, France: ACM. [Available through UW Libraries]
* Restivo, M., & van de Rijt, A. (2012). [http://dx.doi.org/10.1371/journal.pone.0034358 Experimental Study of Informal Rewards in Peer Production]. PLoS ONE, 7(3), e34358. ''[Free Online]''
* Restivo, M., & van de Rijt, A. (0). No praise without effort: experimental evidence on how rewards affect Wikipedia’s contributor community. Information, Communication & Society, 0(0), 1–12. [Available through UW Libraries]
: This is really just a more in-depth version of the experiments in the Restivo and van de Rijt article described above.
* Restivo, M., & van de Rijt, A. (0). [http://doi.org/10.1080/1369118X.2014.888459 No praise without effort: experimental evidence on how rewards affect Wikipedia’s contributor community]. Information, Communication & Society, 0(0), 1–12. ''[Available through UW Libraries]''
: Note: This piece is, more or less, a continuation of the Restivo and van de Rijt piece included above but it is longer and goes into much more depth on at least one of the important theoretical issues.
: Note: This piece is, more or less, a continuation of the Restivo and van de Rijt piece included above but it is longer and goes into much more depth on at least one of the important theoretical issues.
* Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014). [http://doi.org/10.1073/pnas.1320040111 Experimental evidence of massive-scale emotional contagion through social networks]. Proceedings of the National Academy of Sciences, 111(24), 8788–8790. ''[Available through UW Libraries]''
: Note: We've already read but I'd like to discuss it again.
* Cosley, D., Frankowski, D., Terveen, L., & Riedl, J. (2007). [http://doi.org/10.1145/1216295.1216309 SuggestBot: Using Intelligent Task Routing to Help People Find Work in Wikipedia]. In Proceedings of the 12th International Conference on Intelligent User Interfaces (pp. 32–41). New York, NY, USA: ACM. ''[Available through UW Libraries]''
* Reinecke, K., & Gajos, K. Z. (2015). [http://doi.org/10.1145/2675133.2675246 LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples]. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (pp. 1364–1378). New York, NY, USA: ACM. ''[Available through UW Libraries]''


=== Week 5: Wednesday April 27: Surveys ===
=== Week 5: Wednesday April 27: Surveys ===
Line 425: Line 397:
'''Required Readings:'''
'''Required Readings:'''


* Van Selm, Martine & Nicholas Jankowski (2006), "[http://doi.org/10.1007/s11135-005-8081-8 Conducting Online Surveys]," Quality and Quantity, 40: 435-456. ''[Available through UW Libraries]''
* Van Selm, Martine & Nicholas Jankowski (2006), "Conducting Online Surveys," Quality and Quantity, 40: 435-456. [Available through UW Libraries]
* Walejko, Gina, "[https://canvas.uw.edu/files/36334690/download?download_frd=1 Online survey: Instant publication, instant mistake, all of the above]," from Research Confidential: Solutions to Problems Most Research Scientists Pretend They Never Have, University of Michigan Press, 2009, pp. 101-121. ''[Available in Canvas]''
* Walejko, Gina, "Online survey: Instant publication, instant mistake, all of the above," from Research Confidential: Solutions to Problems Most Research Scientists Pretend They Never Have, University of Michigan Press, 2009, pp. 101-121.sk [Available in Canvas]
* Joseph A. Konstan, B. R. Simon Rosser, Michael W. Ross, Jeffrey Stanton, & Weston M. Edwards, “[http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.2005.tb00248.x/full The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research],” Journal of Computer-Mediated Communication, V.10, N. 2, January 2005. ''[Free Online]''
* Joseph A. Konstan, B. R. Simon Rosser, Michael W. Ross, Jeffrey Stanton, & Weston M. Edwards, “The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research” Journal of Computer-Mediated Communication, V.10, N. 2, January 2005. [Free Online]
* Hill, B. M., & Shaw, A. (2013). [http://dx.doi.org/10.1371/journal.pone.0065782 The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation]. PLoS ONE, 8(6), e65782. ''[Free Online]''
* Hill, B. M., & Shaw, A. (2013). The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation. PLoS ONE, 8(6), e65782. [Free Online]
* Salganik, M. J., & Levy, K. E. C. (2015). [http://doi.org/10.1371/journal.pone.0123483 Wiki Surveys: Open and Quantifiable Social Data Collection]. PLOS ONE, 10(5), e0123483. ''[Free Online]''
* Salganik, M. J., & Levy, K. E. C. (2012). Wiki surveys: Open and quantifiable social data collection. arXiv:1202.0500 [cs, Stat]. [Free Online]
: Note: [http://www.technologyreview.com/view/531696/inspired-by-wikipedia-social-scientists-create-a-revolution-in-online-surveys/ This journalistic account of the research] may also be useful.
: Note: This journalistic account of the research may also be useful.


'''Optional Readings:'''
'''Optional Readings:'''
Line 436: Line 408:
If you don't have a background in survey design, these two have been recommended by our guest speaker as good basic things to read:
If you don't have a background in survey design, these two have been recommended by our guest speaker as good basic things to read:


* Krosnick, J. A. (1999). [http://doi.org/10.1146/annurev.psych.50.1.537 Survey Research]. Annual Review of Psychology, 50(1), 537–567. ''[Available through UW Libraries]''
* Krosnick, J. A. (1999).Survey research. Annual Review of Psychology 50, 537-567. [Free Online]
* Krosnick, J. A. (1999). Maximizing measurement quality: Principles of good questionnaire design. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of Political Attitudes. New York: Academic Press.
* Krosnick, J. A. (1999).Maximizing measurement quality: Principles of good questionnaire design . In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of political attitudes. New York: Academic Press. [Free Online]


These are other texts on the subject that you might find useful:
These are other texts on the subjct that you might find useul:


* Dal, Michael, "[https://canvas.uw.edu/files/36335114/download?download_frd=1 Online data collection and data analysis using emergent technologies]," Ch. 12 in HET. ''[Available in Canvas]''
* Dal, Michael, "Online data collection and data analysis using emergent technologies," Ch. 12 in HET.
* Smith, Tom W. and John Sokolowski, "[https://canvas.uw.edu/files/36335113/download?download_frd=1 The use of audiovisuals in surveys]," Ch. 19 in HET. ''[Available in Canvas]''
* Smith, Tom W. and John Sokolowski, "The use of audiovisuals in surveys," Ch. 19 in HET.
* Kellock, Anne, et. al. "[https://canvas.uw.edu/files/36335148/download?download_frd=1 Using technology and the experience sampling method to understand real life]," Ch. 24 from HET. ''[Available in Canvas]''
* Kellock, Anne, et. al. "Using technology and the experience sampling method to understand real life," Ch. 24 from HET.
* Yun, Gi Woong and Craig Trumbo, "[http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.2000.tb00112.x/abstract Comparative Response to a Survey Executed by Post, E-mail and Web Form]," Journal of Computer-Mediated Communication, V.6, N.1, September, 2000. ''[Free Online]''
* Yun, Gi Woong and Craig Trumbo, "Comparative Response to a Survey Executed by Post, E-mail and Web Form," Journal of Computer-Mediated Communication, V.6, N.1, September, 2000.
* Hargittai, Eszter, and Chris Karr, "[https://canvas.uw.edu/files/36334928/download?download_frd=1 WAT R U DOIN? Studying the Thumb Generation Using Text Messaging]," from Research Confidential: Solutions to Problems Most Research Scientists Pretend They Never Have, University of Michigan Press, 2009, pp. 192-216. ''[Available in Canvas]''
* Hargittai, Eszter, and Chris Karr, "WAT R U DOIN? Studying the Thumb Generation Using Text Messaging," from Research Confidential: Solutions to Problems Most Research Scientists Pretend They Never Have, University of Michigan Press, 2009, pp. 192-216. [Available in Canvas]
* Wright, Kevin, "[http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.2005.tb00259.x/abstract Researching Internet-Based Populations: Advantages and Disadvantages of Online Survey Research, Online Questionnaire Authoring Software Packages, and Web Survey Services]," Journal of Computer-Mediated Communication, V. 10, N. 3, April 2005. ''[Free Online]''
* Wright, Kevin, "Researching Internet-Based Populations: Advantages and Disadvantages of Online Survey Research, Online Questionnaire Authoring Software Packages, and Web Survey Services," Journal of Computer-Mediated Communication, V. 10, N. 3, April 2005. [Free Online]


=== Week 6: Monday May 2: Narrative, Discourse and Visual Analysis ===
=== Week 6: Monday May 2: Narrative, Discourse and Visual Analysis ===
Line 456: Line 428:
Narrative Analysis:
Narrative Analysis:


* Mitra, A. (1999). [http://doi.org/10.1111/j.1083-6101.1999.tb00330.x Characteristics of the WWW Text: Tracing Discursive Strategies]. Journal of Computer-Mediated Communication, 5(1), 0–0. ''[Free Online]''
* Mitra, Ananda, "Characteristics of the WWW Text: Tracing Discursive Strategies," Journal of Computer-Mediated Communication, V.5, N. 1, September, 1999. [Free Online]
* Kaun, Anne (2010), "[http://ejournals.library.ualberta.ca/index.php/IJQM/article/view/7165 Open-Ended Online Diaries: Capturing Life as it is Narrated]," International Journal of Qualitative Methods, Vol. 9 Issue 2, p133-148. ''[Free Online]''
* Kaun, Anne (2010), "Open-Ended Online Diaries: Capturing Life as it is Narrated," International Journal of Qualitative Methods, Vol. 9 Issue 2, p133-148. [Available through UW Libraries]
* Gubrium, Aline and K.C. Nat Turner, "Digital storytelling as an emergent method for social research and practice," Ch. 21 in HET.


Visual Analysis:
Discourse Analysis:


* Hochman, N., & Schwartz, R. (2012). [https://www.aaai.org/ocs/index.php/ICWSM/ICWSM12/paper/view/4782 Visualizing Instagram: Tracing Cultural Visual Rhythms]. In Sixth International AAAI Conference on Weblogs and Social Media. ''[Available through UW Libraries]''
* Honeycutt, Courtenay (2005), “Hazing as a process of boundary maintenance in an online community”, Journal of Computer-Mediated Communication, 10(2). [Available through UW Libraries]
* Hochman, N., & Manovich, L. (2013). [http://firstmonday.org/ojs/index.php/fm/article/viewArticle/4711/ Zooming into an Instagram City: Reading the local through social media]. First Monday, 18(7). ''[Free Online]''
:Note: Combines quantitative and qualitative computer-mediated discourse analysis methods.*
 
'''Optional Readings:'''
 
Narrative Analysis:


*  Gubrium, Aline and K.C. Nat Turner, "[https://canvas.uw.edu/files/36418703/download?download_frd=1 Digital storytelling as an emergent method for social research and practice]," Ch. 21 in HET.


Visual Analysis:
Visual Analysis:


* Newbold, Curtis, 2013, "[http://thevisualcommunicationguy.com/2015/01/12/how-to-do-a-visual-analysis-a-five-step-process/ How to Do a Visual Analysis (A 5-Step Process)]". ''[Free Online]''
* Newbold, Curtis, 2013, "How to Do a Visual Analysis (A 5-Step Process)". [Free Online]
: Note: Although I'm not a fan of infograpraphics as a genre, I suppose it makes sense that visual communication people would put together a pretty good one! If you're already familiar with visual analysis from the rhetorical tradition, there's not going to be a lot new here. If this is new for you, this will help you frame and understand the other readings.
: Note: Although I'm not a fan of infograpraphics as a genre, I suppose it makes sense that visual communication people would put together a pretty good one! If you're already familiar with visual analysis from the rhetorical tradition, there's not going to be a lot new here. If this is new for you, this will help you frame and understand the other readings.
* Torralba, A. (2009). [http://videolectures.net/nips09_torralba_uvs/ Understanding Visual Scenes]. Tutorial presented at the NIPS, Vancouver, BC, Canada. Part I. ''[Free Online]''
* Baab, L. M. (2008). Portraits of the future church: A rhetorical analysis of congregational websites. Journal of Communication and Religion, 31(2), 143–181. [Free Online]
: Note: Lynne did her PhD in the UW Communication Deptartment, and this article is based on one of the chapters from her dissertation. She developed the initial research design for this study as a student in an earlier version of this course.
* Hochman, N., & Schwartz, R. (2012). Visualizing Instagram: Tracing Cultural Visual Rhythms. In Sixth International AAAI Conference on Weblogs and Social Media. [Available through UW Libraries]
* Hochman, N., & Manovich, L. (2013). Zooming into an Instagram City: Reading the local through social media. First Monday, 18(7). [Free Online]
 
'''Optional Readings:'''
* Torralba, A. (2009). Understanding Visual Scenes. Tutorial presented at the NIPS, Vancouver, BC, Canada. Part I. [Free Online]
: Note: This is a two part (each part is one hour) lecture and tutorial by a expert in computer vision. I strongly recommend watching Part I. I think this gives you a good sense of the nature of the kinds of challenges that were (and still are) facing the field of computer vision and anybody trying to have their computer look at images.
: Note: This is a two part (each part is one hour) lecture and tutorial by a expert in computer vision. I strongly recommend watching Part I. I think this gives you a good sense of the nature of the kinds of challenges that were (and still are) facing the field of computer vision and anybody trying to have their computer look at images.


These five paper are all technical approaches to doing image classification using datasets from Internet-based datasets of images like Flickr, Google Image Search, Google Street View, or Instagram. Each of these describes interesting and challenges technical issues. If you're interested, it would be a great idea to read these to get a sense for the state of the art and what is and isn't possible:
These five paper are all technical approaches to doing image classification using datasets from Internet-based datasets of images like Flickr, Google Image Search, Google Street View, or Instagram. Each of these describes interesting and challenges technical issues. If you're interested, it would be a great idea to read these to get a sense for the state of the art and what is and isn't possible:


* Jaffe, A., Naaman, M., Tassa, T., & Davis, M. (2006). [http://doi.org/10.1145/1178677.1178692 Generating Summaries and Visualization for Large Collections of Geo-referenced Photographs]. In Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval (pp. 89–98). New York, NY, USA: ACM. ''[Available through UW Libraries]''
* Jaffe, A., Naaman, M., Tassa, T., & Davis, M. (2006). Generating Summaries and Visualization for Large Collections of Geo-referenced Photographs. In Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval (pp. 89–98). New York, NY, USA: ACM. [Available through UW Libraries]
* Simon, I., Snavely, N., & Seitz, S. M. (2007). [http://doi.org/10.1109/ICCV.2007.4408863 Scene Summarization for Online Image Collections]. In Computer Vision, IEEE International Conference on (Vol. 0, pp. 1–8). Los Alamitos, CA, USA: IEEE Computer Society. ''[Free Online]''
* Simon, I., Snavely, N., & Seitz, S. M. (2007). Scene Summarization for Online Image Collections. In Computer Vision, IEEE International Conference on (Vol. 0, pp. 1–8). Los Alamitos, CA, USA: IEEE Computer Society. [Free Online]
* Crandall, D. J., Backstrom, L., Huttenlocher, D., & Kleinberg, J. (2009). [http://doi.org/10.1145/1526709.1526812 Mapping the World’s Photos]. In Proceedings of the 18th International Conference on World Wide Web (pp. 761–770). New York, NY, USA: ACM. ''[Available through UW Libraries]''
* Crandall, D. J., Backstrom, L., Huttenlocher, D., & Kleinberg, J. (2009). Mapping the World’s Photos. In Proceedings of the 18th International Conference on World Wide Web (pp. 761–770). New York, NY, USA: ACM. [Available through UW Libraries]
* San Pedro, J., & Siersdorfer, S. (2009). [http://doi.org/10.1145/1526709.1526813 Ranking and Classifying Attractiveness of Photos in Folksonomies]. In Proceedings of the 18th International Conference on World Wide Web (pp. 771–780). New York, NY, USA: ACM. ''[Available through UW Libraries]''
* San Pedro, J., & Siersdorfer, S. (2009). Ranking and Classifying Attractiveness of Photos in Folksonomies. In Proceedings of the 18th International Conference on World Wide Web (pp. 771–780). New York, NY, USA: ACM. [Available through UW Libraries]
* Doersch, C., Singh, S., Gupta, A., Sivic, J., & Efros, A. A. (2012). [http://doi.org/10.1145/2185520.2185597 What Makes Paris Look Like Paris?] ACM Trans. Graph., 31(4), 101:1–101:9. ''[Available through UW Libraries]''
* Doersch, C., Singh, S., Gupta, A., Sivic, J., & Efros, A. A. (2012). What Makes Paris Look Like Paris? ACM Trans. Graph., 31(4), 101:1–101:9. [Available through UW Libraries]
 
Discourse Analysis:


* Honeycutt, Courtenay (2005), “[http://onlinelibrary.wiley.com/enhanced/doi/10.1111/j.1083-6101.2005.tb00240.x Hazing as a process of boundary maintenance in an online community]”, Journal of Computer-Mediated Communication, 10(2). [Available through UW Libraries]
=== Week 6: Wednesday May 4: Design Research ===
:Note: Combines quantitative and qualitative computer-mediated discourse analysis methods.*


=== Week 6: Wednesday May 4: Crowdsourced Data Analysis and Experimentation ===
'''To Be Decided'''
 
'''Assignment:'''
 
* Find and complete at least 2 "hits" as a worker on [http://mturk.com Amazon Mechnical Turk]. Note that to do this you will need to create a ''worker'' account on Mturk.
** Record (write down) details and notes about your tasks: What did you do? Who was the requester? What could you was the purpose of the task (as best you could tell)? What was the experience like? What research applications can you (not) imagine for this kind of system?
* Design and deploy a small-scale research task on Mturk. Note that to do this, you will need to create a ''requester'' account on Mturk. Be sure to allow some time to get the task design the way you want it! Some ideas for study designs you might do:
** A small survey.
** Classification of texts or images (e.g., label tweets, pictures, or comments from a discussion thread).
** A small experiment (e.g., you can do a survey where you insert ''different'' images and ask the same set of questions. Check out the [https://requester.mturk.com/help/getting_started.html Mturk requester getting started guide]
* Prepare to share details of your small-scale research task in class, including results (they will come fast).
 
''Note:'' In terms of running your task, it will cost real money and you have to put money on your Amazon account yourself. You've each got a $3 budget. Please use your credit card to put $3 on your account right away. I will pay each of you $3 in cash next week to reimburse you for the cost of running the experiment.
 
'''Required Readings:'''
 
* [https://docs.aws.amazon.com/AWSMechTurk/latest/RequesterUI/Introduction.html Amazon Mechanical Turk Requester UI Guide] ''[Free Online]''
* [https://mturkpublic.s3.amazonaws.com/docs/MTURK_BP.pdf Amazon Mechanical Turk Best Practices Guide]. ''[Free Online]''
* Weinberg, J., Freese, J., & McElhattan, D. (2014). [https://www.sociologicalscience.com/articles-vol1-19-292/ Comparing Data Characteristics and Results of an Online Factorial Survey between a Population-Based and a Crowdsource-Recruited Sample]. Sociological Science, 1, 292–310. ''[Free Online]''
* Shaw, A. (2015). [https://canvas.uw.edu/files/36419326/download?download_frd=1 Hired Hands and Dubious Guesses: Adventures in Crowdsourced Data Collection]. In E. Hargittai & C. Sandvig (Eds.), Digital Research Confidential: The Secrets of Studying Behavior Online. The MIT Press. ''[Available in Canvas]''
 
'''Optional Readings:'''
 
* Gray, M. L., Suri, S., Ali, S. S., & Kulkarni, D. (2016). [http://sidsuri.com/Publications_files/collab_paper21.pdf The Crowd is a Collaborative Network]. Proceedings of Computer-Supported Cooperative Work. ''[Free Online]''
* Kittur et al. (2013). [http://hci.stanford.edu/publications/2013/CrowdWork/futureofcrowdwork-cscw2013.pdf The Future of Crowd Work]. Proceedings of Computer-Supported Cooperative Work. ''[Free Online]''
 
'''Resources:'''
* [http://www.mturk-tracker.com/ Mturk Tracker]


=== Week 6: Saturday May 7: CDSW Session 3 ===
=== Week 6: Saturday May 7: CDSW Session 3 ===
Line 525: Line 469:
This session will run from 9am-3pm. Details on the [[CDSW Spring 2016]] page.
This session will run from 9am-3pm. Details on the [[CDSW Spring 2016]] page.


=== Week 7: Monday May 9: Consulting Week (i.e., no group meeting) ===
=== Week 7: Monday May 9: NO CLASS (Consulting Week) ===


During this week, we not meet together. Instead, I will schedule one-on-one in person meetings of an hour with each student individually to catch up with you about your project and to work directly with you to resolve any technical issues you have run into with data collection, etc.
During this week, we not meet together. Instead, I will schedule one-on-one in person meetings of at least half an hour with each student individually to catch up with about your project and to work directly with you to resolve any technical issues you have run into with data collection, etc.


=== Week 7: Wednesday May 11: Consulting Week (i.e., no group meeting) ===
=== Week 7: Wednesday May 11: NO CLASS (Consulting Week) ===
=== Week 8: Monday May 16: Crowdsourced Data Analysis ===


=== Week 8: Monday May 16: Consulting Week (i.e., no group meeting) ===
'''Assignment:'''
 
During this week, we not meet together. Instead, I will schedule one-on-one in person meetings of an hour with each student individually to catch up with you about your project and to work directly with you to resolve any technical issues you have run into with data collect
 
=== Week 8: Wednesday May 18: Consulting Week (i.e., no group meeting) ===
 
=== Week 9: Monday May 23: Design Research ===
 
Today we'll have a guest visitor — [http://www.andresmh.com/ Andrés Monroy-Hernández] from [http://fuse.microsoft.com/ Microsoft Resarch's FUSE labs] and affiliate faculty in the Department of Communication and Department of Human-Centered Design and Engineering at UW. Monroy-Hernández research involves studying people by designing and building systems. He's built a number of very large and successful socio-technical systems as part of his research. In his graduate work, he build the [http://scratch.mit.edu/ Scratch Online Community] which is now used by more than 10 million people.


I've asked him to come and talk to us about design research as a process. As a result, it will be helpful to read about two projects he has worked on recently that he will talked to us about. Those projects are called NewsPad and Eventful.
* Find and complete at least 2 "hits" as a worker on Amazon Mechnical Turk.
* Forthcoming assignment on running your own hit on AMT. I'm currently waiting for details from a collaborator who used a similar assignment similar in the past.


'''Required Readings:'''
'''Required Readings:'''


* Olsen, D. R., Jr. (2007). [http://doi.org/10.1145/1294211.1294256 Evaluating User Interface Systems Research.] In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (pp. 251–258). New York, NY, USA: ACM. [Available through UW Libraries]
* Amazon Mechanical Turk Requester UI Guide (pp. 1-15). [Free Online]
* J. Nathan Matias and Andres Monroy-Hernandez, [http://research.microsoft.com/apps/pubs/default.aspx?id=208886 NewsPad: Designing for Collaborative Storytelling in Neighborhoods]. CHI Work in Progress Paper. ACM, March 2014.
* Amazon Mechanical Turk Best Practices Guide. [Free Online]
* Elena Agapie, Jaime Teevan, and Andrés Monroy-Hernández, [http://research.microsoft.com/apps/pubs/default.aspx?id=252315 Crowdsourcing in the Field: A Case Study Using Local Crowds for Event Reporting], in Human Computation (HCOMP), AAAI - Association for the Advancement of Artificial Intelligence, August 2015.
* Weinberg, J., Freese, J., & McElhattan, D. (2014). Comparing Data Characteristics and Results of an Online Factorial Survey between a Population-Based and a Crowdsource-Recruited Sample. Sociological Science, 1, 292–310. [Free Online]
* Two very short videos describing the systems: [http://research.microsoft.com/en-us/projects/newspad/ NewsPad by FUSE Labs] and [http://research.microsoft.com/en-us/projects/eventful/ Eventful by FUSE Labs]
* Shaw, A. (2015). Hired Hands and Dubious Guesses: Adventures in Crowdsourced Data Collection. In E. Hargittai & C. Sandvig (Eds.), Digital Research Confidential: The Secrets of Studying Behavior Online. The MIT Press. [Available in Canvas]


=== Week 9: Wednesday May 25: Digital Trace and Sensor Data ===
=== Week 8: Wednesday May 18: TBD ===
=== Week 9: Monday May 23: Sensor Data ===


'''Required Readings:'''
'''Required Readings:'''


Read any 2 of these 4 chapters from the [https://global.oup.com/academic/product/the-handbook-of-emergent-technologies-in-social-research-9780195373592 Handbook of Emerging Technology in Social Research]:
Read any 2 of these 4 HET chapters:
 
* Eagle, Nathan, "[https://canvas.uw.edu/files/36870285/download?download_frd=1 Mobile phones as sensors for social research]," Ch. 22 in HET.
* Visser, Albertine and Ingrid Mulder, "[https://canvas.uw.edu/files/36870283/download?download_frd=1 Emergent technologies for assessing social feelings and experiences]," Ch. 16 in HET.
* de Haan, Geert, et. al., "[https://canvas.uw.edu/files/36870284/download?download_frd=1 Bringing the research lab into everyday life: Exploiting sensitive environments to acquire data for social research]," Ch. 23 in HET.
* Fowler, Chris, et. al., "[https://canvas.uw.edu/files/36870282/download?download_frd=1 Living laboratories: Social research applications and evaluations]," Ch. 27 in HET.
* Holohan, Anne, et. al., "[https://canvas.uw.edu/files/36870280/download?download_frd=1 The digital home: A new locus of social science research]," Ch. 28 in HET.


=== Week 10: Monday May 30: Final Presentations  ===
* Eagle, Nathan, "Mobile phones as sensors for social research," Ch. 22 in HET.
=== Week 10: Wednesday June 1: Final Presentations  ===
* Visser, Albertine and Ingrid Mulder, "Emergent technologies for assessing social feelings and experiences," Ch. 16 in HET.
* de Haan, Geert, et. al., "Bringing the research lab into everyday life: Exploiting sensitive environments to acquire data for social research," Ch. 23 in HET.
* Fowler, Chris, et. al., "Living laboratories: Social research applications and evaluations," Ch. 27 in HET.
* Holohan, Anne, et. al., "The digital home: A new locus of social science research," Ch. 28 in HET.


=== Not Covered: Hyperlink Networks ===
=== Week 9: Wednesday May 25: Hyperlink Networks ===


* Jackson, Michele, (1997), "Assessing the Structure of the Communication on the World Wide Web," Journal of Computer-Mediated Communication, V. 3, N. 1, June, 1997.
* Jackson, Michele, (1997), "Assessing the Structure of the Communication on the World Wide Web," Journal of Computer-Mediated Communication, V. 3, N. 1, June, 1997.
* Jackson, Michele, (2011), "What Should Researchers Infer From Links on an Organization's Site?", blog post at http://assett.colorado.edu/jackson/what-should-researchers-infer-from-links-on-an-organizations-site/
* Jackson, Michele, (2011), "What Should Researchers Infer From Links on an Organization's Site?", blog post at http://assett.colorado.edu/jackson/what-should-researchers-infer-from-links-on-an-organizations-site/
* Olesen, Thomas (2004), "The Transnational Zapatista Solidarity Network: An Infrastructure Analysis," Global Networks, 4(1):89-107 [Although this article uses the term infrastructure analysis, the method employed is best described as a hyperlink network analysis.]
* Olesen, Thomas (2004), "The Transnational Zapatista Solidarity Network: An Infrastructure Analysis," Global Networks, 4(1):89-107 [Although this article uses the term infrastructure analysis, the method employed is best described as a hyperlink network analysis.]
=== Week 10: Monday May 30: Final Presentations  ===
=== Week 10: Wednesday June 1: Final Presentations  ===


== Administrative Notes ==
== Administrative Notes ==
Please note that all contributions to CommunityData are considered to be released under the Attribution-Share Alike 3.0 Unported (see CommunityData:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To protect the wiki against automated edit spam, we kindly ask you to solve the following CAPTCHA:

Cancel Editing help (opens in new window)