Editing Designing Internet Research (Winter 2020)
From CommunityData
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 21: | Line 21: | ||
* Describe particular challenges and threats to research validity associated with each method. | * Describe particular challenges and threats to research validity associated with each method. | ||
* For at least one method, be able to provide a detailed description of a research project and feel comfortable embarking on a formative study using this methodology. | * For at least one method, be able to provide a detailed description of a research project and feel comfortable embarking on a formative study using this methodology. | ||
* Given a manuscript (e.g., in the context of a request for peer review), be able to evaluate | * Given a manuscript (e.g., in the context of a request for peer review), be able to evaluate a Internet-based study in terms of its use its methodological choices. | ||
* Use a modern programming language (like Python) to collect a dataset from a web API like those published by Twitter, Reddit, or Wikipedia. | * Use a modern programming language (like Python) to collect a dataset from a web API like those published by Twitter, Reddit, or Wikipedia. | ||
Line 154: | Line 154: | ||
=== Participation === | === Participation === | ||
The course relies heavily on participation and discussion. It is important to realize that we will not summarize reading in class and I will not cover it in lecture. I expect you all to have read it and we will jump in and start discussing it. The "Participation Rubric" section of [ | The course relies heavily on participation and discussion. It is important to realize that we will not summarize reading in class and I will not cover it in lecture. I expect you all to have read it and we will jump in and start discussing it. The "Participation Rubric" section of [https://mako.cc/teaching/assessment.html my detailed page on assessment] gives the rubric I will use in evaluating participation. | ||
=== Assessment === | === Assessment === | ||
I have put together a very detailed page that describes [[ | I have put together a very detailed page that describes [[Assessment|the way I approach assessment and grading]]—both in general and in this course. Please read it carefully I will assign grades for each of following items on the UW 4.0 grade scale according to the weights below: | ||
* Participation: 30% | * Participation: 30% | ||
Line 385: | Line 385: | ||
* boyd, danah. 2015. “Making Sense of Teen Life: Strategies for Capturing Ethnographic Data in a Networked Era.” In Digital Research Confidential: The Secrets of Studying Behavior Online, edited by Eszter Hargittai and Christian Sandvig. Cambridge, Massachusetts: MIT Press. ''[[https://canvas.uw.edu/files/61411386/download?download_frd=1 Available in Canvas]]'' | * boyd, danah. 2015. “Making Sense of Teen Life: Strategies for Capturing Ethnographic Data in a Networked Era.” In Digital Research Confidential: The Secrets of Studying Behavior Online, edited by Eszter Hargittai and Christian Sandvig. Cambridge, Massachusetts: MIT Press. ''[[https://canvas.uw.edu/files/61411386/download?download_frd=1 Available in Canvas]]'' | ||
: Note: Strongly focused on | : Note: Strongly focused on enthnographic interviews with tons of very specific details. Fantastic article on interviewing, although perhaps a bit weak on Internet specific advice. | ||
* Markham, Annette N. 1998. “The Shifting Project, The Shifting Self.” In Life Online: Researching Real Experience in Virtual Space, 61–83. Rowman Altamira. ''[Available from instructor]'' | * Markham, Annette N. 1998. “The Shifting Project, The Shifting Self.” In Life Online: Researching Real Experience in Virtual Space, 61–83. Rowman Altamira. ''[Available from instructor]'' | ||
: Note: One of the earliest books on online life and one of the earliest attempts to do online interviewing. This is dated, but highlight some important challenge. | : Note: One of the earliest books on online life and one of the earliest attempts to do online interviewing. This is dated, but highlight some important challenge. | ||
* Hutchinson, Emma. 2016. “Digital Methods and Perpetual Reinvention? Asynchronous Interviewing and Photo Elicitation.” In Digital Methods for Social Science: An Interdisciplinary Guide to Research Innovation, edited by Helene Snee, Christine Hine, Yvette Morey, Steven Roberts, and Hayley Watson, 143–56. London: Palgrave Macmillan UK. https://doi.org/10.1057/9781137453662_9. ''[[https://doi.org/10.1057/9781137453662_9 Available through UW | * Hutchinson, Emma. 2016. “Digital Methods and Perpetual Reinvention? Asynchronous Interviewing and Photo Elicitation.” In Digital Methods for Social Science: An Interdisciplinary Guide to Research Innovation, edited by Helene Snee, Christine Hine, Yvette Morey, Steven Roberts, and Hayley Watson, 143–56. London: Palgrave Macmillan UK. https://doi.org/10.1057/9781137453662_9. ''[[https://doi.org/10.1057/9781137453662_9 Available through UW libraries]]'' | ||
* Hawkins, Janice. 2018. “The Practical Utility and Suitability of Email Interviews in Qualitative Research.” The Qualitative Report 23 (2). https://digitalcommons.odu.edu/nursing_fac_pubs/24. ''[[https://digitalcommons.odu.edu/nursing_fac_pubs/24 Available free online]]'' | * Hawkins, Janice. 2018. “The Practical Utility and Suitability of Email Interviews in Qualitative Research.” The Qualitative Report 23 (2). https://digitalcommons.odu.edu/nursing_fac_pubs/24. ''[[https://digitalcommons.odu.edu/nursing_fac_pubs/24 Available free online]]'' | ||
Line 405: | Line 405: | ||
=== Week 4: Saturday February 1: CDSW Session 2 === | === Week 4: Saturday February 1: CDSW Session 2 === | ||
As | As description in the section on technical skills above, I expect everybody who is not comfortable with at least basic programming and data collection to attend the [[Community Data Science Workshops (Winter 2020)]] which I am running concurrently with this class. | ||
This session will run from | This session will run from 10am-4pm. Details on the [[CDSW Winter 2020]] page. | ||
=== Week 5: Tuesday February 4: (I) Surveys and (II) Experiments === | === Week 5: Tuesday February 4: (I) Surveys and (II) Experiments === | ||
Line 415: | Line 415: | ||
* Fricker, Jr., Ronald D., and Katja Lozar Manfreda. 2017. “Sampling Methods for Online Surveys.” In The SAGE Handbook of Online Research Methods, edited by Nigel G. Fielding, Raymond M. Lee, and Grant Blank, 2 edition, 162–83. London, UK: SAGE. ''[[https://canvas.uw.edu/files/61598407/download?download_frd=1 Available in Canvas]]'' | * Fricker, Jr., Ronald D., and Katja Lozar Manfreda. 2017. “Sampling Methods for Online Surveys.” In The SAGE Handbook of Online Research Methods, edited by Nigel G. Fielding, Raymond M. Lee, and Grant Blank, 2 edition, 162–83. London, UK: SAGE. ''[[https://canvas.uw.edu/files/61598407/download?download_frd=1 Available in Canvas]]'' | ||
* Walejko, Gina. 2009. “Online Survey: Instant Publication, Instant Mistake, All of the Above.” In Research Confidential: Solutions to Problems Most Social Scientists Pretend They Never Have, edited by Eszter Hargittai, 101–21. Ann Arbor, MI: University of Michigan Press. ''[[ | * Walejko, Gina. 2009. “Online Survey: Instant Publication, Instant Mistake, All of the Above.” In Research Confidential: Solutions to Problems Most Social Scientists Pretend They Never Have, edited by Eszter Hargittai, 101–21. Ann Arbor, MI: University of Michigan Press. ''[[Available in Canvas]]'' | ||
* Konstan, Joseph A., B. R. Simon Rosser, Michael W. Ross, Jeffrey Stanton, and Weston M. Edwards. 2005. “The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research.” Journal of Computer-Mediated Communication 10 (2): 00–00. https://doi.org/10.1111/j.1083-6101.2005.tb00248.x. ''[[https://doi.org/10.1111/j.1083-6101.2005.tb00248.x Free online]]'' | * Konstan, Joseph A., B. R. Simon Rosser, Michael W. Ross, Jeffrey Stanton, and Weston M. Edwards. 2005. “The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research.” Journal of Computer-Mediated Communication 10 (2): 00–00. https://doi.org/10.1111/j.1083-6101.2005.tb00248.x. ''[[https://doi.org/10.1111/j.1083-6101.2005.tb00248.x Free online]]'' | ||
* Hill, Benjamin Mako, and Aaron Shaw. 2013. “The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation.” PLoS ONE 8 (6): e65782. https://doi.org/10.1371/journal.pone.0065782. ''[[https://doi.org/10.1371/journal.pone.0065782 Free online]]'' | * Hill, Benjamin Mako, and Aaron Shaw. 2013. “The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation.” PLoS ONE 8 (6): e65782. https://doi.org/10.1371/journal.pone.0065782. ''[[https://doi.org/10.1371/journal.pone.0065782 Free online]]'' | ||
* Salganik, Matthew J., and Karen E. C. Levy. 2015. “Wiki Surveys: Open and Quantifiable Social Data Collection.” PLOS ONE 10 (5): e0123483. https://doi.org/10.1371/journal.pone.0123483. ''[[https://doi.org/10.1371/journal.pone.0123483 Free online]]'' | * Salganik, Matthew J., and Karen E. C. Levy. 2015. “Wiki Surveys: Open and Quantifiable Social Data Collection.” PLOS ONE 10 (5): e0123483. https://doi.org/10.1371/journal.pone.0123483. ''[[https://doi.org/10.1371/journal.pone.0123483 Free online]]'' | ||
: Note: [http://www.technologyreview.com/view/531696/inspired-by-wikipedia-social-scientists-create-a-revolution-in-online-surveys/ This journalistic account of the research] may also be useful. | : Note: [http://www.technologyreview.com/view/531696/inspired-by-wikipedia-social-scientists-create-a-revolution-in-online-surveys/ This journalistic account of the research] may also be useful. | ||
* Alperin, Juan Pablo, Erik Warren Hanson, Kenneth Shores, and Stefanie Haustein. 2017. “Twitter Bot Surveys: A Discrete Choice Experiment to Increase Response Rates.” In Proceedings of the 8th International Conference on Social Media & Society, 1–4. #SMSociety17. Toronto, ON, Canada: Association for Computing Machinery. https://doi.org/10.1145/3097286.3097313. ''[[https://doi.org/10.1145/3097286.3097313 Available through UW libraries]] | * Alperin, Juan Pablo, Erik Warren Hanson, Kenneth Shores, and Stefanie Haustein. 2017. “Twitter Bot Surveys: A Discrete Choice Experiment to Increase Response Rates.” In Proceedings of the 8th International Conference on Social Media & Society, 1–4. #SMSociety17. Toronto, ON, Canada: Association for Computing Machinery. https://doi.org/10.1145/3097286.3097313. ''[[https://doi.org/10.1145/3097286.3097313 Available through UW libraries]]' | ||
'''Optional Readings:''' | '''Optional Readings:''' | ||
Line 430: | Line 430: | ||
* Mavletova, Aigul, and Mick P. Couper. 2014. “Mobile Web Survey Design: Scrolling versus Paging, SMS versus E-Mail Invitations.” Journal of Survey Statistics and Methodology 2 (4): 498–518. https://doi.org/10.1093/jssam/smu015. ''[[https://doi.org/10.1093/jssam/smu015 Available through UW libraries]]' | * Mavletova, Aigul, and Mick P. Couper. 2014. “Mobile Web Survey Design: Scrolling versus Paging, SMS versus E-Mail Invitations.” Journal of Survey Statistics and Methodology 2 (4): 498–518. https://doi.org/10.1093/jssam/smu015. ''[[https://doi.org/10.1093/jssam/smu015 Available through UW libraries]]' | ||
* Yun, Gi Woong, and Craig W. Trumbo. 2000. “Comparative Response to a Survey Executed by Post, e-Mail, & Web Form.” Journal of Computer-Mediated Communication 6 (1): 0–0. https://doi.org/10.1111/j.1083-6101.2000.tb00112.x. ''[[https://doi.org/10.1111/j.1083-6101.2000.tb00112.x Free online]]'' | * Yun, Gi Woong, and Craig W. Trumbo. 2000. “Comparative Response to a Survey Executed by Post, e-Mail, & Web Form.” Journal of Computer-Mediated Communication 6 (1): 0–0. https://doi.org/10.1111/j.1083-6101.2000.tb00112.x. ''[[https://doi.org/10.1111/j.1083-6101.2000.tb00112.x Free online]]'' | ||
* Hargittai, Eszter, and Chris Karr. 2009. “WAT R U DOIN? Studying the Thumb Generation Using Text Messaging.” In Research Confidential: Solutions to Problems Most Social Scientists Pretend They Never Have, edited by Eszter Hargittai, 192–216. Ann Arbor, MI: University of Michigan Press. ''[[ | * Hargittai, Eszter, and Chris Karr. 2009. “WAT R U DOIN? Studying the Thumb Generation Using Text Messaging.” In Research Confidential: Solutions to Problems Most Social Scientists Pretend They Never Have, edited by Eszter Hargittai, 192–216. Ann Arbor, MI: University of Michigan Press. ''[[Available in Canvas]]'' | ||
If you don't have a background in survey design, these two have been recommended by our guest speaker as good basic things to read: | If you don't have a background in survey design, these two have been recommended by our guest speaker as good basic things to read: | ||
Line 436: | Line 436: | ||
* Krosnick, Jon A. 1999. “Maximizing Measurement Quality: Principles of Good Questionnaire Design.” In Measures of Political Attitudes, edited by John P. Robinson, Phillip R. Shaver, and Lawrence S. Wrightsman. New York: Academic Press. | * Krosnick, Jon A. 1999. “Maximizing Measurement Quality: Principles of Good Questionnaire Design.” In Measures of Political Attitudes, edited by John P. Robinson, Phillip R. Shaver, and Lawrence S. Wrightsman. New York: Academic Press. | ||
* Krosnick, Jon A. 1999. “Survey Research.” Annual Review of Psychology 50 (1): 537–67. https://doi.org/10.1146/annurev.psych.50.1.537. ''[[https://doi.org/10.1146/annurev.psych.50.1.537 Available through UW libraries]]'' | * Krosnick, Jon A. 1999. “Survey Research.” Annual Review of Psychology 50 (1): 537–67. https://doi.org/10.1146/annurev.psych.50.1.537. ''[[https://doi.org/10.1146/annurev.psych.50.1.537 Available through UW libraries]]'' | ||
==== Part II: Experiments ==== | ==== Part II: Experiments ==== | ||
Line 446: | Line 441: | ||
'''Required Readings:''' | '''Required Readings:''' | ||
* Reips, Ulf-Dietrich. 2002. “Standards for Internet-Based Experimenting.” Experimental Psychology 49 (4): 243–56. https://doi.org/10.1026//1618-3169.49.4.243. ''[[https://doi.org/10.1026//1618-3169.49.4.243 Available through UW | * Reips, Ulf-Dietrich. 2002. “Standards for Internet-Based Experimenting.” Experimental Psychology 49 (4): 243–56. https://doi.org/10.1026//1618-3169.49.4.243. ''[[https://doi.org/10.1026//1618-3169.49.4.243 Available through UW libraries]]' | ||
* Salganik, Matthew J., Peter Sheridan Dodds, and Duncan J. Watts. 2006. “Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market.” Science 311 (5762): 854–56. https://doi.org/10.1126/science.1121066. ''[[https://doi.org/10.1126/science.1121066 Available through UW | * Salganik, Matthew J., Peter Sheridan Dodds, and Duncan J. Watts. 2006. “Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market.” Science 311 (5762): 854–56. https://doi.org/10.1126/science.1121066. ''[[https://doi.org/10.1126/science.1121066 Available through UW libraries]]' | ||
* Hergueux, Jérôme, and Nicolas Jacquemet. 2014. “Social Preferences in the Online Laboratory: A Randomized Experiment.” Experimental Economics 18 (2): 251–83. https://doi.org/10.1007/s10683-014-9400-5. ''[[https://doi.org/10.1007/s10683-014-9400-5 Available in Canvas]]'' | * Hergueux, Jérôme, and Nicolas Jacquemet. 2014. “Social Preferences in the Online Laboratory: A Randomized Experiment.” Experimental Economics 18 (2): 251–83. https://doi.org/10.1007/s10683-014-9400-5. ''[[https://doi.org/10.1007/s10683-014-9400-5 Available in Canvas]]'' | ||
* Rijt, Arnout van de, Soong Moon Kang, Michael Restivo, and Akshay Patil. 2014. “Field Experiments of Success-Breeds-Success Dynamics.” Proceedings of the National Academy of Sciences 111 (19): 6934–39. https://doi.org/10.1073/pnas.1316836111. ''[[https://doi.org/10.1073/pnas.1316836111 Available in Canvas]]'' | * Rijt, Arnout van de, Soong Moon Kang, Michael Restivo, and Akshay Patil. 2014. “Field Experiments of Success-Breeds-Success Dynamics.” Proceedings of the National Academy of Sciences 111 (19): 6934–39. https://doi.org/10.1073/pnas.1316836111. ''[[https://doi.org/10.1073/pnas.1316836111 Available in Canvas]]'' | ||
* | * Reinecke, Katharina, and Krzysztof Z. Gajos. 2015. “LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples.” In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, 1364–1378. CSCW ’15. New York, NY, USA: ACM. https://doi.org/10.1145/2675133.2675246. ''[[https://doi.org/10.1145/2675133.2675246 Available through UW libraries]]' | ||
'''Optional Readings:''' | '''Optional Readings:''' | ||
Line 457: | Line 452: | ||
: This piece is set as the intersection of networks and experiments. It's very important but is probably too technical to assign for the whole c.ass | : This piece is set as the intersection of networks and experiments. It's very important but is probably too technical to assign for the whole c.ass | ||
* Kohavi, Ron, Alex Deng, Brian Frasca, Toby Walker, Ya Xu, and Nils Pohlmann. 2013. “Online Controlled Experiments at Large Scale.” In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1168–1176. KDD ’13. Chicago, Illinois, USA: Association for Computing Machinery. https://doi.org/10.1145/2487575.2488217. ''[[https://doi.org/10.1145/2487575.2488217 Available through UW libraries]]' | * Kohavi, Ron, Alex Deng, Brian Frasca, Toby Walker, Ya Xu, and Nils Pohlmann. 2013. “Online Controlled Experiments at Large Scale.” In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1168–1176. KDD ’13. Chicago, Illinois, USA: Association for Computing Machinery. https://doi.org/10.1145/2487575.2488217. ''[[https://doi.org/10.1145/2487575.2488217 Available through UW libraries]]' | ||
* | * Narayan, Sneha, Nathan TeBlunthuis, Wm Salt Hale, Benjamin Mako Hill, and Aaron Shaw. 2019. “All Talk: How Increasing Interpersonal Communication on Wikis May Not Enhance Productivity.” Proceedings of the ACM on Human-Computer Interaction 3 (CSCW): 101:1–101:19. https://doi.org/10.1145/3359203. ''[[https://doi.org/10.1145/3359230 Available through UW libraries]]' | ||
* Zhu, Haiyi, Amy Zhang, Jiping He, Robert E. Kraut, and Aniket Kittur. 2013. “Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia.” In , 2253. ACM Press. https://doi.org/10.1145/2470654.2481311. ''[[https://doi.org/10.1145/2470654.2481311 Available through UW libraries]]' | * Zhu, Haiyi, Amy Zhang, Jiping He, Robert E. Kraut, and Aniket Kittur. 2013. “Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia.” In , 2253. ACM Press. https://doi.org/10.1145/2470654.2481311. ''[[https://doi.org/10.1145/2470654.2481311 Available through UW libraries]]' | ||
* Zhang, Xiaoquan (Michael), and Feng Zhu. 2011. “Group Size and Incentives to Contribute: A Natural Experiment at Chinese Wikipedia.” American Economic Review 101 (4): 1601–15. https://doi.org/10.1257/aer.101.4.1601. ''[[https://doi.org/10.1257/aer.101.4.1601 Available through UW libraries]]' | * Zhang, Xiaoquan (Michael), and Feng Zhu. 2011. “Group Size and Incentives to Contribute: A Natural Experiment at Chinese Wikipedia.” American Economic Review 101 (4): 1601–15. https://doi.org/10.1257/aer.101.4.1601. ''[[https://doi.org/10.1257/aer.101.4.1601 Available through UW libraries]]' | ||
=== Week 6: Tuesday February 11: Crowdsourcing | === Week 6: Tuesday February 11: (I) Crowdsourcing (II) Discourse Analysis === | ||
==== Part I: (I) Crowdsourced Data Analysis and Experimentation ==== | |||
'''Assignment:''' | |||
* Find and complete at least 2 "hits" as a worker on [http://mturk.com Amazon Mechnical Turk]. Note that to do this you will need to create a ''worker'' account on Mturk. | |||
** Record (write down) details and notes about your tasks: What did you do? Who was the requester? What could you was the purpose of the task (as best you could tell)? What was the experience like? What research applications can you (not) imagine for this kind of system? | |||
* Design and deploy a small-scale research task on Mturk. Note that to do this, you will need to create a ''requester'' account on Mturk. Be sure to allow some time to get the task design the way you want it! Some ideas for study designs you might do: | |||
** A small survey. | |||
** Classification of texts or images (e.g., label tweets, pictures, or comments from a discussion thread). | |||
** A small experiment (e.g., you can do a survey where you insert ''different'' images and ask the same set of questions. Check out the [https://requester.mturk.com/help/getting_started.html Mturk requester getting started guide] | |||
* Prepare to share details of your small-scale research task in class, including results (they will come fast). | |||
''Note:'' In terms of running your task, it will cost real money and you have to put money on your Amazon account yourself. You've each got a $3 budget. Please use your credit card to put $3 on your account right away. I will pay each of you $3 in cash next week to reimburse you for the cost of running the experiment. | |||
'''Required Readings:''' | |||
* | * [https://docs.aws.amazon.com/AWSMechTurk/latest/RequesterUI/Introduction.html Amazon Mechanical Turk Requester UI Guide] ''[Free Online]'' | ||
* [https://mturkpublic.s3.amazonaws.com/docs/MTURK_BP.pdf Amazon Mechanical Turk Best Practices Guide]. ''[Free Online]'' | |||
* | * Weinberg, J., Freese, J., & McElhattan, D. (2014). [https://www.sociologicalscience.com/articles-vol1-19-292/ Comparing Data Characteristics and Results of an Online Factorial Survey between a Population-Based and a Crowdsource-Recruited Sample]. Sociological Science, 1, 292–310. ''[Free Online]'' | ||
* Shaw, A. (2015). [https://canvas.uw.edu/files/36419326/download?download_frd=1 Hired Hands and Dubious Guesses: Adventures in Crowdsourced Data Collection]. In E. Hargittai & C. Sandvig (Eds.), Digital Research Confidential: The Secrets of Studying Behavior Online. The MIT Press. ''[Available in Canvas]'' | |||
* | |||
'''Optional Readings:''' | |||
* | * Gray, M. L., Suri, S., Ali, S. S., & Kulkarni, D. (2016). [http://sidsuri.com/Publications_files/collab_paper21.pdf The Crowd is a Collaborative Network]. Proceedings of Computer-Supported Cooperative Work. ''[Free Online]'' | ||
* Kittur et al. (2013). [http://hci.stanford.edu/publications/2013/CrowdWork/futureofcrowdwork-cscw2013.pdf The Future of Crowd Work]. Proceedings of Computer-Supported Cooperative Work. ''[Free Online]'' | |||
'''Resources:''' | |||
* [http://www.mturk-tracker.com/ Mturk Tracker] | |||
==== Part II: Discourse Analysis ==== | |||
''' | '''Required Readings:''' | ||
Narrative Analysis: | |||
* | * Mitra, A. (1999). [http://doi.org/10.1111/j.1083-6101.1999.tb00330.x Characteristics of the WWW Text: Tracing Discursive Strategies]. Journal of Computer-Mediated Communication, 5(1), 0–0. ''[Free Online]'' | ||
* | * Kaun, Anne (2010), "[http://ejournals.library.ualberta.ca/index.php/IJQM/article/view/7165 Open-Ended Online Diaries: Capturing Life as it is Narrated]," International Journal of Qualitative Methods, Vol. 9 Issue 2, p133-148. ''[Free Online]'' | ||
Visual Analysis: | |||
* | * Hochman, N., & Schwartz, R. (2012). [https://www.aaai.org/ocs/index.php/ICWSM/ICWSM12/paper/view/4782 Visualizing Instagram: Tracing Cultural Visual Rhythms]. In Sixth International AAAI Conference on Weblogs and Social Media. ''[Available through UW Libraries]'' | ||
* | * Hochman, N., & Manovich, L. (2013). [http://firstmonday.org/ojs/index.php/fm/article/viewArticle/4711/ Zooming into an Instagram City: Reading the local through social media]. First Monday, 18(7). ''[Free Online]'' | ||
'''Optional Readings:''' | |||
Narrative Analysis: | |||
* Gubrium, Aline and K.C. Nat Turner, "[https://canvas.uw.edu/files/36418703/download?download_frd=1 Digital storytelling as an emergent method for social research and practice]," Ch. 21 in HET. | |||
Visual Analysis: | |||
* Newbold, Curtis, 2013, "[http://thevisualcommunicationguy.com/2015/01/12/how-to-do-a-visual-analysis-a-five-step-process/ How to Do a Visual Analysis (A 5-Step Process)]". ''[Free Online]'' | |||
: Note: Although I'm not a fan of infograpraphics as a genre, I suppose it makes sense that visual communication people would put together a pretty good one! If you're already familiar with visual analysis from the rhetorical tradition, there's not going to be a lot new here. If this is new for you, this will help you frame and understand the other readings. | |||
* Torralba, A. (2009). [http://videolectures.net/nips09_torralba_uvs/ Understanding Visual Scenes]. Tutorial presented at the NIPS, Vancouver, BC, Canada. Part I. ''[Free Online]'' | |||
: Note: This is a two part (each part is one hour) lecture and tutorial by a expert in computer vision. I strongly recommend watching Part I. I think this gives you a good sense of the nature of the kinds of challenges that were (and still are) facing the field of computer vision and anybody trying to have their computer look at images. | |||
These five paper are all technical approaches to doing image classification using datasets from Internet-based datasets of images like Flickr, Google Image Search, Google Street View, or Instagram. Each of these describes interesting and challenges technical issues. If you're interested, it would be a great idea to read these to get a sense for the state of the art and what is and isn't possible: | |||
* Jaffe, A., Naaman, M., Tassa, T., & Davis, M. (2006). [http://doi.org/10.1145/1178677.1178692 Generating Summaries and Visualization for Large Collections of Geo-referenced Photographs]. In Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval (pp. 89–98). New York, NY, USA: ACM. ''[Available through UW Libraries]'' | |||
* Simon, I., Snavely, N., & Seitz, S. M. (2007). [http://doi.org/10.1109/ICCV.2007.4408863 Scene Summarization for Online Image Collections]. In Computer Vision, IEEE International Conference on (Vol. 0, pp. 1–8). Los Alamitos, CA, USA: IEEE Computer Society. ''[Free Online]'' | |||
* Crandall, D. J., Backstrom, L., Huttenlocher, D., & Kleinberg, J. (2009). [http://doi.org/10.1145/1526709.1526812 Mapping the World’s Photos]. In Proceedings of the 18th International Conference on World Wide Web (pp. 761–770). New York, NY, USA: ACM. ''[Available through UW Libraries]'' | |||
* San Pedro, J., & Siersdorfer, S. (2009). [http://doi.org/10.1145/1526709.1526813 Ranking and Classifying Attractiveness of Photos in Folksonomies]. In Proceedings of the 18th International Conference on World Wide Web (pp. 771–780). New York, NY, USA: ACM. ''[Available through UW Libraries]'' | |||
* Doersch, C., Singh, S., Gupta, A., Sivic, J., & Efros, A. A. (2012). [http://doi.org/10.1145/2185520.2185597 What Makes Paris Look Like Paris?] ACM Trans. Graph., 31(4), 101:1–101:9. ''[Available through UW Libraries]'' | |||
Discourse Analysis: | |||
* | * Honeycutt, Courtenay (2005), “[http://onlinelibrary.wiley.com/enhanced/doi/10.1111/j.1083-6101.2005.tb00240.x Hazing as a process of boundary maintenance in an online community]”, Journal of Computer-Mediated Communication, 10(2). [Available through UW Libraries] | ||
:Note: Combines quantitative and qualitative computer-mediated discourse analysis methods.* | |||
=== Week 6: Saturday February 15: CDSW Session 3 === | |||
As description in the section on technical skills above, I expect everybody who is not comfortable with at least basic programming and data collection to attend the [[Community Data Science Workshops (Winter 2020)]] which I am running concurrently with this class. | |||
This session will run from 9am-3pm. Details on the [[CDSW Winter 2020]] page. | |||
=== Week 7: Tuesday February 18: Consulting Week (i.e., no group meeting) === | |||
During this week, we not meet together. Instead, I will schedule one-on-one in person meetings of an hour with each student individually to catch up with you about your project and to work directly with you to resolve any technical issues you have run into with data collection, etc. | |||
=== Week 8: Tuesday February 25: Consulting Week (i.e., no group meeting) === | |||
=== Week | |||
During this week, we not meet together. Instead, I will schedule one-on-one in person meetings of an hour with each student individually to catch up with you about your project and to work directly with you to resolve any technical issues you have run into with data collect | |||
=== Week 9: Tuesday March 3: (I) Design Research and (II) Digital Trace and Sensor Data === | |||
==== Part I: Design Research ==== | ==== Part I: Design Research ==== | ||
Today we'll have a guest visitor — [http://www.andresmh.com/ Andrés Monroy-Hernández] who is director of HCI research at SNAP and formerly from [http://fuse.microsoft.com/ Microsoft | Today we'll have a guest visitor — [http://www.andresmh.com/ Andrés Monroy-Hernández] who is director of HCI research at SNAP and formerly from [http://fuse.microsoft.com/ Microsoft Resarch's FUSE labs]. Andrés is affiliate faculty in the Department of Communication and Department of Human-Centered Design and Engineering at UW. Monroy-Hernández research involves studying people by designing and building systems. He's built a number of very large and successful socio-technical systems as part of his research. In his graduate work, he build the [http://scratch.mit.edu/ Scratch Online Community] which is now used by more than 10 million people. | ||
I've asked him to come and talk to us about design research as a process. As a result, it will be helpful to read about two projects he has worked on recently that he will talked to us about. Those projects are called NewsPad and Eventful. | I've asked him to come and talk to us about design research as a process. As a result, it will be helpful to read about two projects he has worked on recently that he will talked to us about. Those projects are called NewsPad and Eventful. | ||
Line 586: | Line 560: | ||
* Eagle, Nathan, "[https://canvas.uw.edu/files/36870285/download?download_frd=1 Mobile phones as sensors for social research]," Ch. 22 in HET. | * Eagle, Nathan, "[https://canvas.uw.edu/files/36870285/download?download_frd=1 Mobile phones as sensors for social research]," Ch. 22 in HET. | ||
* Visser, Albertine | * Visser, Albertine and Ingrid Mulder, "[https://canvas.uw.edu/files/36870283/download?download_frd=1 Emergent technologies for assessing social feelings and experiences]," Ch. 16 in HET. | ||
* de Haan, Geert, et. al., "[https://canvas.uw.edu/files/36870284/download?download_frd=1 Bringing the research lab into everyday life: Exploiting sensitive environments to acquire data for social research]," Ch. 23 in HET. | * de Haan, Geert, et. al., "[https://canvas.uw.edu/files/36870284/download?download_frd=1 Bringing the research lab into everyday life: Exploiting sensitive environments to acquire data for social research]," Ch. 23 in HET. | ||
* Fowler, Chris, et. al., "[https://canvas.uw.edu/files/36870282/download?download_frd=1 Living laboratories: Social research applications and evaluations]," Ch. 27 in HET. | * Fowler, Chris, et. al., "[https://canvas.uw.edu/files/36870282/download?download_frd=1 Living laboratories: Social research applications and evaluations]," Ch. 27 in HET. | ||
* Holohan, Anne, et. al., "[https://canvas.uw.edu/files/36870280/download?download_frd=1 The digital home: A new locus of social science research]," Ch. 28 in HET. | * Holohan, Anne, et. al., "[https://canvas.uw.edu/files/36870280/download?download_frd=1 The digital home: A new locus of social science research]," Ch. 28 in HET. | ||
=== Week 10: Tuesday March 10: Final Presentations === | |||
== Administrative Notes == | == Administrative Notes == | ||
=== Your Presence in Class === | === Your Presence in Class === | ||
As detailed in [[#Participation|the section on participation]] and in [[ | As detailed in [[#Participation|the section on participation]] and in [[Teaching Assessment|my page on assessment]], class participation is a critical way that I will assess learning in the class. Obviously, you must be in class in order to participate. If you need to miss class for any reason, please contact me ahead of time (email is best). In the event of an absence, you are responsible for obtaining class notes, handouts, assignments, etc. | ||
=== Office Hours === | === Office Hours === | ||
I will hold office | I will hold office Hours on '''Thursdays 1-2pm''' in [https://uw.edu/maps/?cmu Communications (CMU) 333]. In addition to my scheduled office hours, I am generally in [[Community Data Science Lab (UW)|my lab in CMU 306]]. Feel free to stop by at any time or to contact me to arrange a time to meet. | ||
=== Religious Accommodations === | === Religious Accommodations === | ||
Washington state law requires that UW develop a policy for | Washington state law requires that UW develop a policy for accommodation of student absences or significant hardship due to reasons of faith or conscience, or for organized religious activities. The UW’s policy, including more information about how to request an accommodation, is available at [https://registrar.washington.edu/staffandfaculty/religious-accommodations-policy/ Religious Accommodations Policy]. Accommodations must be requested within the first two weeks of this course using the [https://registrar.washington.edu/students/religious-accommodations-request/ Religious Accommodations Request form]. | ||
=== Student Conduct === | === Student Conduct === | ||
Line 612: | Line 585: | ||
Safety | Safety | ||
Call SafeCampus at 206-685-7233 anytime–no matter where you work or study–to anonymously discuss safety and well-being concerns for yourself or others. SafeCampus’s team of caring professionals will provide individualized support while discussing short- and long-term solutions and connecting you with additional resources when requested. | Call SafeCampus at 206-685-7233 anytime–no matter where you work or study–to anonymously discuss safety and well-being concerns for yourself or others. SafeCampus’s team of caring professionals will provide individualized support, while discussing short- and long-term solutions and connecting you with additional resources when requested. | ||
=== Academic Dishonesty === | === Academic Dishonesty === | ||
Line 620: | Line 593: | ||
=== Disability Resources === | === Disability Resources === | ||
If you have already established accommodations with Disability Resources for Students (DRS), please communicate your approved accommodations to | If you have already established accommodations with Disability Resources for Students (DRS), please communicate your approved accommodations to uw at your earliest convenience so we can discuss your needs in this course. | ||
If you have not yet established services through DRS, but have a temporary health condition or permanent disability that requires accommodations (conditions include but not limited to; mental health, attention-related, learning, vision, hearing, physical or health impacts), you are welcome to contact DRS at 206-543-8924 or uwdrs@uw.edu or disability.uw.edu. DRS offers resources and coordinates reasonable accommodations for students with disabilities and/or temporary health conditions. Reasonable accommodations are established through an interactive process between you, your instructor(s) and DRS. It is the policy and practice of the University of Washington to create inclusive and accessible learning environments consistent with federal and state law. | If you have not yet established services through DRS, but have a temporary health condition or permanent disability that requires accommodations (conditions include but not limited to; mental health, attention-related, learning, vision, hearing, physical or health impacts), you are welcome to contact DRS at 206-543-8924 or uwdrs@uw.edu or disability.uw.edu. DRS offers resources and coordinates reasonable accommodations for students with disabilities and/or temporary health conditions. Reasonable accommodations are established through an interactive process between you, your instructor(s) and DRS. It is the policy and practice of the University of Washington to create inclusive and accessible learning environments consistent with federal and state law. | ||
Line 630: | Line 603: | ||
== Credit and Notes == | == Credit and Notes == | ||
This will be | This will be third time I have taught this course at UW in its current form. This syllabuses draws heavily from previous versions. Syllabuses from earlier classes can be found online at: | ||
* [[Internet Research Methods (Spring 2016)]] | * [[Internet Research Methods (Spring 2016)]] | ||
* [https://mako.cc/teaching/2015/internet_research/ Internet Research Methods (Spring 2015)] | * [https://mako.cc/teaching/2015/internet_research/ Internet Research Methods (Spring 2015)] | ||
This syllabus was inspired by and borrows with permission from, a | This syllabus was inspired by, and borrows with permission from, a syallbus from an earlier version of this class taught by [http://www.com.washington.edu/foot/ Kirsten Foot]. Professor Foot last taught the course in Spring 2014. |