Editing HCDS (Fall 2017)/Schedule

<noinclude>
<div style="font-family:Rockwell,'Courier Bold',Courier,Georgia,'Times New Roman',Times,serif; min-width:10em;">
<div style="float:left; width:100%; margin-right:2%;">
{{Link/Graphic/Main/2
|highlight color= 27666b
|color=460c40
|link=
|image=
|text-align=left
|top font-size= 1.1em
|top color=FFF
|line color=FFF
|top text=This page is a work in progress.
|bottom font-size= 1em
|bottom color= FFF
|bottom text=
|line= none
}}</div></div>
</noinclude>

=== Week 1: September 28 ===
[[HCDS_(Fall_2017)/Day_1_plan|Day 1 plan]]

;Assignments due
* fill out the pre-course survey

;Agenda
{{:HCDS (Fall 2017)/Day 1 plan}}

;Readings assigned
* Watch:  [https://www.hcde.washington.edu/seminar-series/aragon ''Why Humans Should Care About Data Science''] (Cecilia Aragon, 2016 HCDE Seminar Series)
* Read: Aragon, C. et al. (2016). [https://cscw2016hcds.files.wordpress.com/2015/10/cscw_2016_human-centered-data-science_workshop.pdf ''Developing a Research Agenda for Human-Centered Data Science.''] Human Centered Data Science workshop, CSCW 2016.
* Read: Provost, Foster, and Tom Fawcett. [http://online.liebertpub.com/doi/pdf/10.1089/big.2013.1508 ''Data science and its relationship to big data and data-driven decision making.''] Big Data 1.1 (2013): 51-59. 
* Read: Kling, Rob and Star, Susan Leigh. [https://scholarworks.iu.edu/dspace/bitstream/handle/2022/1798/wp97-04B.html ''Human Centered Systems in the Perspective of Organizational and Social Informatics.''] 1997.

;Homework assigned
* Reading reflection

;Resources
* Ideo.org [http://www.designkit.org/ ''The Field Guide to Human-Centered Design.''] 2015.
* Faraway, Julian. [https://farawaystatistics.wordpress.com/2015/11/30/the-decline-and-fall-of-statistics/ ''The Decline and Fall of Statistics.''] Faraway Statistics, 2015.
* Press, Gil. [https://www.forbes.com/sites/gilpress/2013/08/19/data-science-whats-the-half-life-of-a-buzzword/#387161dd7bfd Data Science: What's The Half-Life Of A Buzzword?''] Forbes, 2013.
* Bloor, Robin. [http://insideanalysis.com/2013/08/a-data-science-rant/ ''A Data Science Rant.''] Inside Analysis, 2013.
* Various authors. [https://cscw2016hcds.wordpress.com/papers/ Position papers from 2016 CSCW Human Centered Data Science Workshop.] 2016.
<br/>
<hr/>
<br/>

=== Week 2: October 5 ===
[[HCDS_(Fall_2017)/Day_2_plan|Day 2 plan]]

Ethical considerations in Data Science: privacy, informed consent and user treatment


;Assignments due
*Week 1 reading reflection

;Agenda
{{:HCDS (Fall 2017)/Day 2 plan}}


;Readings assigned
* Read: Markham, Annette and Buchanan, Elizabeth. [https://aoir.org/reports/ethics2.pdf ''Ethical Decision-Making and Internet Researchers.''] Association for Internet Research, 2012.
* Read: Barocas, Solan and Nissenbaum, Helen. ''Big Data's End Run around Anonymity and Consent.'' In ''Privacy, Big Data, and the Public Good''. 2014. (PDF on Canvas)

;Homework assigned
* Reading reflection

;Resources
* Wittkower, D.E. [http://firstmonday.org/article/view/6948/5628 Lurkers, creepers, and virtuous interactivity: From property rights to consent and care as a conceptual basis for privacy concerns and information ethics]
* National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. [https://www.hhs.gov/ohrp/regulations-and-policy/belmont-report/index.html ''The Belmont Report.''] U.S. Department of Health and Human Services, 1979.
* Hill, Kashmir. [https://www.forbes.com/sites/kashmirhill/2014/06/28/facebook-manipulated-689003-users-emotions-for-science/#6a01653e197c ''Facebook Manipulated 689,003 Users' Emotions For Science.''] Forbes, 2014.
* Adam D. I. Kramer, Jamie E. Guillory, and Jeffrey T. [http://www.pnas.org/content/111/24/8788.full ''Hancock Experimental evidence of massive-scale emotional contagion through social networks.''] PNAS 2014 111 (24) 8788-8790; published ahead of print June 2, 2014.
* Barbaro, Michael and Zeller, Tom. [http://query.nytimes.com/gst/abstract.html?res=9E0CE3DD1F3FF93AA3575BC0A9609C8B63&legacy=true ''A Face Is Exposed for AOL Searcher No. 4417749.''] New York Times, 2008.
* Zetter, Kim. [https://www.wired.com/2012/06/wmw-arvind-narayanan/ ''Arvind Narayanan Isn’t Anonymous, and Neither Are You.''] WIRED, 2012.
* Gray, Mary. [http://culturedigitally.org/2014/07/when-science-customer-service-and-human-subjects-research-collide-now-what/ ''When Science, Customer Service, and Human Subjects Research Collide. Now What?''] Culture Digitally, 2014.
* Tene, Omer and Polonetsky, Jules. [https://www.stanfordlawreview.org/online/privacy-paradox-privacy-and-big-data/ ''Privacy in the Age of Big Data.''] Stanford Law Review, 2012.
* Dwork, Cynthia. [https://www.microsoft.com/en-us/research/wp-content/uploads/2008/04/dwork_tamc.pdf ''Differential Privacy: A survey of results'']. Theory and Applications of Models of Computation , 2008.
* Green, Matthew. [https://blog.cryptographyengineering.com/2016/06/15/what-is-differential-privacy/ ''What is Differential Privacy?''] A Few Thoughts on Cryptographic Engineering, 2016.
* Hsu, Danny. [http://blog.datasift.com/2015/04/09/techniques-to-anonymize-human-data/ ''Techniques to Anonymize Human Data.''] Data Sift, 2015.
* Metcalf, Jacob. [http://ethicalresolve.com/twelve-principles-of-data-ethics/ ''Twelve principles of data ethics'']. Ethical Resolve, 2016.
* Poor, Nathaniel and Davidson, Roei. [https://cscw2016hcds.files.wordpress.com/2015/10/poor_hcds20161.pdf ''When The Data You Want Comes From Hackers, Or, Looking A Gift Horse In The Mouth'']. CSCW Human Centered Data Science Workshop, 2016.
<br/>
<hr/>
<br/>

=== Week 3: October 12 ===
[[HCDS_(Fall_2017)/Day_3_plan|Day 3 plan]]

;Data provenance, preparation, and reproducibility: ''data curation, preservation, documentation, and archiving; best practices for open scientific research''

;Assignments due
* Week 2 reading reflection

;Agenda
{{:HCDS (Fall 2017)/Day 3 plan}}

;Readings assigned 
*Read: Chapter 2 [https://www.practicereproducibleresearch.org/core-chapters/2-assessment.html "Assessing Reproducibility"] and Chapter 3 [https://www.practicereproducibleresearch.org/core-chapters/3-basic.html "The Basic Reproducible Workflow Template"] from ''The Practice of Reproducible Research'' University of California Press, 2018. 
* Read: Hickey, Walt. [https://fivethirtyeight.com/features/the-dollar-and-cents-case-against-hollywoods-exclusion-of-women/ ''The Dollars and Cents Case Against Hollywood's Exclusion of Women.''] FiveThirtyEight, 2014. '''AND''' Keegan, Brian. [https://github.com/brianckeegan/Bechdel/blob/master/Bechdel_test.ipynb ''The Need for Openness in Data Journalism.''] 2014.

;Homework assigned
* Reading reflection
* [[HCDS_(Fall_2017)/Assignments#A1:_Data_curation|A1: Data curation]]

;Examples of well-documented open research projects
* Keegan, Brian. [https://github.com/brianckeegan/WeatherCrime ''WeatherCrime'']. GitHub, 2014.
* Geiger, Stuart R. and Halfaker, Aaron. [https://github.com/halfak/are-the-bots-really-fighting ''Operationalizing conflict and cooperation between automated software agents in Wikipedia: A replication and expansion of "Even Good Bots Fight"'']. GitHub, 2017.
* Thain, Nithum; Dixon, Lucas; and Wulczyn, Ellery. [https://figshare.com/articles/Wikipedia_Talk_Labels_Toxicity/4563973 ''Wikipedia Talk Labels: Toxicity'']. Figshare, 2017.
* Narayan, Sneha et al. [https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/6HPRIG ''Replication Data for: The Wikipedia Adventure: Field Evaluation of an Interactive Tutorial for New Users'']. Harvard Dataverse, 2017.

;Examples of not-so-well documented open research projects
* Eclarke. [https://github.com/eclarke/swga_paper SWGA paper]. GitHub, 2016.
* David Lefevre. [https://figshare.com/articles/Lefevre_and_Cox_Delayed_instructional_feedback_may_be_more_effective_but_is_this_contrary_to_learners_preferences_/2061303 ''Lefevre and Cox: Delayed instructional feedback may be more effective, but is this contrary to learners’ preferences?''] Figshare, 2016.
* Alneberg. [https://github.com/BinPro/paper-data ''CONCOCT Paper Data'']. GitHub, 2014.

;Other resources
* Press, Gil. [https://www.forbes.com/sites/gilpress/2016/03/23/data-preparation-most-time-consuming-least-enjoyable-data-science-task-survey-says/#2608257f6f63 ''Cleaning Big Data: Most Time-Consuming, Least Enjoyable Data Science Task, Survey Says.''] Forbes, 2016.
* Christensen, Garret. [https://github.com/garretchristensen/BestPracticesManual/blob/master/Manual.pdf ''Manual of Best Practices in Transparent Social Science Research.''] 2016.
* Hickey, Walt. [https://fivethirtyeight.com/features/the-bechdel-test-checking-our-work/ ''The Bechdel Test: Checking Our Work'']. FiveThirtyEight, 2014. 
* Chapman et al. [ftp://ftp.software.ibm.com/software/analytics/spss/support/Modeler/Documentation/14/UserManual/CRISP-DM.pdf ''Cross Industry Standard Process for Data Mining'']. IBM, 2000.


<br/>
<hr/>
<br/>

=== Week 4: October 19 ===
[[HCDS_(Fall_2017)/Day_4_plan|Day 4 plan]]

;Study design: ''understanding your data; framing research questions; planning your study''


;Assignments due
* Reading reflection
* A1: Data curation

;Agenda
{{:HCDS (Fall 2017)/Day 4 plan}}

;Readings assigned
* Shyong (Tony) K. Lam, Anuradha Uduwage, Zhenhua Dong, Shilad Sen, David R. Musicant, Loren Terveen, and John Riedl. 2011. ''[http://files.grouplens.org/papers/wp-gender-wikisym2011.pdf WP:clubhouse?: an exploration of Wikipedia's gender imbalance.]'' In Proceedings of the 7th International Symposium on Wikis and Open Collaboration (WikiSym '11). ACM, New York, NY, USA, 1-10. DOI=http://dx.doi.org/10.1145/2038558.2038560


;Homework assigned
* Reading reflection
* A2: Bias in data


;Resources
* Aschwanden, Christie. [https://fivethirtyeight.com/features/science-isnt-broken/ ''Science Isn't Broken''] FiveThirtyEight, 2015.
* Halfaker, Aaron et al. ''[https://www-users.cs.umn.edu/~halfak/publications/The_Rise_and_Decline/ The Rise and Decline of an Open Collaboration Community: How Wikipedia's reaction to sudden popularity is causing its decline].'' American Behavioral Scientist, 2012.
* Warnke-Wang, Morten. ''[https://meta.wikimedia.org/wiki/Research:Autoconfirmed_article_creation_trial Autoconfirmed article creation trial].'' Wikimedia, 2017.
* ''[https://www.forbes.com/sites/hbsworkingknowledge/2015/01/20/wikipedia-or-encyclopaedia-britannica-which-has-more-bias/#1a68e6337d4a Wikipedia Or Encyclopædia Britannica: Which Has More Bias?]''. Forbes, 2015. Based on Greenstein, Shane, and Feng Zhu.''[http://www.hbs.edu/faculty/Publication%20Files/15-023_e044cf50-f621-4759-a827-e9a3bf8920c0.pdf Do Experts or Collective Intelligence Write with More Bias? Evidence from Encyclopædia Britannica and Wikipedia]''. Harvard Business School working paper. 
<br/>
<hr/>
<br/>

=== Week 5: October 26 ===
[[HCDS_(Fall_2017)/Day_5_plan|Day 5 plan]]

;Machine learning: ''ethical AI, algorithmic transparency, societal implications of machine learning''

;Assignments due
* Reading reflection

;Agenda
{{:HCDS (Fall 2017)/Day 5 plan}}

;Readings assigned
* Christian Sandvig, Kevin Hamilton, Karrie Karahalios, Cedric Langbort (2014/05/22) ''[http://www-personal.umich.edu/~csandvig/research/Auditing%20Algorithms%20--%20Sandvig%20--%20ICA%202014%20Data%20and%20Discrimination%20Preconference.pdf Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms].'' Paper presented to "Data and Discrimination: Converting Critical Concerns into Productive Inquiry," a preconference at the 64th Annual Meeting of the International Communication Association. May 22, 2014; Seattle, WA, USA. 

;Homework assigned
* Reading reflection
* A3: Final project plan


;Resources
* Bamman, David ''[https://cscw2016hcds.files.wordpress.com/2015/10/bamman_hcds.pdf Interpretability in Human-Centered Data Science].'' 2016 CSCW workshop on Human-Centered Data Science.
* Anderson, Carl. ''[https://medium.com/@leapingllamas/the-role-of-model-interpretability-in-data-science-703918f64330 The role of model interpretability in data science].'' Medium, 2016.
* Hill, Kashmir. ''[https://gizmodo.com/facebook-figured-out-my-family-secrets-and-it-wont-tel-1797696163 Facebook figured out my family secrets, and it won't tell me how].'' Engadget, 2017.
* Blue, Violet. ''[https://www.engadget.com/2017/09/01/google-perspective-comment-ranking-system/ Google’s comment-ranking system will be a hit with the alt-right].'' Engadget, 2017.
* Ingold, David and Soper, Spencer. ''[https://www.bloomberg.com/graphics/2016-amazon-same-day/ Amazon Doesn’t Consider the Race of Its Customers. Should It?].'' Bloomberg, 2016.
* Whitman, Brian. ''[https://notes.variogr.am/2012/12/11/how-music-recommendation-works-and-doesnt-work/ How music recommendation works - and doesn't work].'' Variogram, 2012.
* Lamere, Paul. ''[https://musicmachinery.com/2011/05/14/how-good-is-googles-instant-mix/ How good is Google's Instant Mix?].'' Music Machinery, 2011.
* Mars, Roman. ''[https://99percentinvisible.org/episode/the-age-of-the-algorithm/ The Age of the Algorithm].'' 99% Invisible Podcast, 2017.
* [https://www.perspectiveapi.com/#/ Google's Perspective API]

<br/>
<hr/>
<br/>

=== Week 6: November 2 ===
[[HCDS_(Fall_2017)/Day_6_plan|Day 6 plan]]

;Mixed-methods research: ''Big data vs thick data; qualitative research in data science ''


;Assignments due
* Reading reflection
* A2: Bias in data


;Agenda
{{:HCDS (Fall 2017)/Day 6 plan}}


;Readings assigned
* R. Stuart Geiger and Aaron Halfaker. 2017. ''[https://commons.wikimedia.org/wiki/File:conflict-bots-wp-cscw.pdf Operationalizing conflict and cooperation between automated software agents in Wikipedia: A replication and expansion of Even Good Bots Fight]''. Proceedings of the ACM on Human-Computer Interaction (Nov 2017 issue, CSCW 2018 Online First) 1, 2, Article 49. DOI: https://doi.org/10.1145/3134684

;Homework assigned
* Reading reflection


;Resources
* Maximillian Klein. ''[http://whgi.wmflabs.org/gender-by-language.html Gender by Wikipedia Language]''. Wikidata Human Gender Indicators (WHGI), 2017.
* Benjamin Collier and Julia Bear. ''[https://static1.squarespace.com/static/521c8817e4b0dca2590b4591/t/523745abe4b05150ff027a6e/1379354027662/2012+-+Collier%2C+Bear+-+Conflict%2C+confidence%2C+or+criticism+an+empirical+examination+of+the+gender+gap+in+Wikipedia.pdf Conflict, criticism, or confidence: an empirical examination of the gender gap in wikipedia contributions]''. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (CSCW '12). DOI: https://doi.org/10.1145/2145204.2145265
* Christina Shane-Simpson, Kristen Gillespie-Lynch, Examining potential mechanisms underlying the Wikipedia gender gap through a collaborative editing task, In Computers in Human Behavior, Volume 66, 2017, https://doi.org/10.1016/j.chb.2016.09.043. (PDF on Canvas)
* Amanda Menking and Ingrid Erickson. 2015. ''[https://upload.wikimedia.org/wikipedia/commons/7/77/The_Heart_Work_of_Wikipedia_Gendered,_Emotional_Labor_in_the_World%27s_Largest_Online_Encyclopedia.pdf The Heart Work of Wikipedia: Gendered, Emotional Labor in the World's Largest Online Encyclopedia]''. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). https://doi.org/10.1145/2702123.2702514
* Andrea Forte, Nazanin Andalibi, and Rachel Greenstadt. ''[http://andreaforte.net/ForteCSCW17-Anonymity.pdf Privacy, Anonymity, and Perceived Risk in Open Collaboration: A Study of Tor Users and Wikipedians]''. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). DOI: https://doi.org/10.1145/2998181.2998273
* Wang, Tricia. ''[https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7 Why Big Data Needs Thick Data]''. Ethnography Matters, 2016.

<br/>
<hr/>
<br/>

=== Week 7: November 9 ===
[[HCDS_(Fall_2017)/Day_7_plan|Day 7 plan]]

;Human computation: ''ethics of crowdwork, crowdsourcing methodologies for analysis, design, and evaluation''


;Assignments due
* Reading reflection
* A3: Final project plan


;Agenda
{{:HCDS (Fall 2017)/Day 7 plan}}

;Readings assigned

;Homework assigned
* Reading reflection
* A4: Crowdwork self-ethnography


;Resources
*''go here''

<br/>
<hr/>
<br/>

=== Week 8: November 16 ===
[[HCDS_(Fall_2017)/Day_8_plan|Day 8 plan]]

;User experience and big data: ''prototyping and user testing; benchmarking and iterative evaluation; UI design for data science''


;Assignments due
* Reading reflection

;Agenda
{{:HCDS (Fall 2017)/Day 8 plan}}

;Readings assigned

;Homework assigned
* Reading reflection


;Resources
Snyder, Jaime. ''[https://cscw2016hcds.files.wordpress.com/2015/10/snyder_hcds20162.pdf Values in the Design of Visualizations].'' 2016 CSCW workshop on Human-Centered Data Science.

<br/>
<hr/>
<br/>

=== Week 9: November 23 ===
[[HCDS_(Fall_2017)/Day_8_plan|Day 9 plan]]

;Human-centered data science in the wild: ''community data science; data science for social good''

;Assignments due
* Reading reflection
* A4: Crowdwork self-ethnography

;Agenda
{{:HCDS (Fall 2017)/Day 9 plan}}

;Readings assigned

;Homework assigned
* Reading reflection

;Resources

<br/>
<hr/>
<br/>

=== Week 10: November 30 ===
[[HCDS_(Fall_2017)/Day_10_plan|Day 10 plan]]

;Communicating methods, results, and implications: translating for non-data scientists ''


;Assignments due
* Reading reflection


;Agenda
{{:HCDS (Fall 2017)/Day 10 plan}}

;Readings assigned

;Homework assigned
* Reading reflection
* A5: Final presentation

;Resources
* ''one''

<br/>
<hr/>
<br/>

=== Week 11: December 7 ===
[[HCDS_(Fall_2017)/Day_11_plan|Day 11 plan]]

;Future of human centered data science: ''case studies from research, industry, and policy; final presentations''


;Assignments due
* Reading reflection
* A5: Final presentation


;Agenda
{{:HCDS (Fall 2017)/Day 11 plan}}

;Readings assigned
* none!

;Homework assigned
* none!

;Resources
* ''one''

<br/>
<hr/>
<br/>

=== Week 12: Finals Week ===
* NO CLASS
* A6: FINAL PROJECT REPORT DUE BY 11:59PM on Sunday, December 10
* LATE PROJECT SUBMISSIONS NOT ACCEPTED.


[[Category:HCDS (Fall 2017)]]