Editing Data Into Insights (Spring 2021)

= Course Information =
:'''COM 495/6/7: Turning Data into Insight and Stories'''
:'''Location:'''  ONLINE
:'''Class Hours:''' Tuesdays and Thursdays; 10:30-11:45am

== Instructor ==
:'''Instructor:''' [https://jeremydfoote.com Jeremy Foote] 
:'''Email:''' jdfoote@purdue.edu
:'''Office Hours:''' Fridays 10am-noon and by appointment

<div style="float:right;">__TOC__</div>

= Course Overview and Learning Objectives =

We are increasingly surrounded by data, and those with the technical skills to analyze it are highly sought after. Even more valuable are those who can not only identify insights from data, but can communicate and persuade with those insights. This course will focus on both developing data skills and crafting persuasive data stories.

Students who complete this course will be able to:
# Understand the role of narrative in interpreting and producing data analyses
# Competently import, process, and prepare data for analysis in the [https://www.r-project.org/ R programming language]
# Critically analyze data visualizations and presentations, and recognize poor or misleading visualizations
# Produce beautiful, well-designed data visualizations in R using [https://ggplot2.tidyverse.org/ ggplot2]
# Craft compelling data presentations

= Required resources and texts =

== Laptop ==

This is a data analysis class and you will need access to a decent computer. You will need a machine with at least 2GB of memory. Windows, Mac OS, and Linux are all fine but an iPad or Android tablet won't work.


== Readings ==

* Required texts:
**  '''Data Visualization: A Practical Introduction''' by Kieran Healy. [https://socviz.co/index.html Web version (free!)] or [https://amzn.to/2vfAixM Print version (Amazon)]
** '''R for Data Science''' by Hadley Wickham and Garrett Grolemund. [https://r4ds.had.co.nz/index.html Web version (free!)] or [http://amzn.to/2aHLAQ1 Print version (Amazon)]
** '''Effective Data Storytelling''' by Brent Dykes. [https://purdue-primo-prod.hosted.exlibrisgroup.com/permalink/f/vjfldl/PURDUE_ALMA51860241510001081 Purdue libraries] or [https://smile.amazon.com/dp/1119615712 Print version (Amazon)]

* Other readings: Readings will be linked to from this page. Where necessary, they will be put on Brightspace

= Course logistics =

== Note About This Syllabus ==

This is my first time teaching this course and this syllabus will be a dynamic document. Although the core expectations for this class are fixed, the details of readings and assignments may shift based on how the class goes. As a result, there are three important things to keep in mind:

# Although details on this syllabus will change, I will not change readings or assignments less than one week before they are due. If I don't fill in a "''To Be Determined''" one week before it's due, it is dropped. If you plan to read more than one week ahead, contact me first.
# Closely monitor the class [https://discord.gg/WvzkwY4fDK Discord]. Because this a wiki, you will be able to track every change by clicking the ''history'' button on this page. I will also summarize these changes in an announcement on Discord that should be emailed to everybody in the class.
# I will ask the class for voluntary anonymous feedback frequently. Please let me know what is working and what can be improved.

== Class Sessions ==

This course will follow "flipped" classroom model. I expect you to learn most of the content of the course asynchronously. The goal of our time together is not to tell you new things, but to consolidate knowledge and to clear up misconceptions.

The Tuesday meeting will be a collaborative, discussion-centric session. Typically, about half of each session will be devoted to going over assignments and the other half will be a discussion of the readings and videos from that week.

The Thursday meetings will be more like a lab. Some of these sessions will include synchronous activities but they will often be more of a co-working time, where you can work synchronously on assignments and I can be available to answer questions.

== Getting Help ==

Your first place to look for help should be each other. By asking and answering questions on Discord, you will not only help to build a repository of shared information, but to reinforce our learning community.

I will also hold office hours Friday mornings on Discord ([[JFoote Office Hours|Sign up here]]). If you come with a programming question, I will expect that you have already tried to solve it yourself in multiple ways and that you have discussed it with a classmate (e.g., on Discord). This policy lets me have time to help more students, but it's also a useful strategy. Often [https://en.wikipedia.org/wiki/Rubber_duck_debugging just trying to explain your code] can help you to recognize where you've gone wrong.

I will also keep an eye on Discord during normal business hours. I encourage you to post questions there, and to use it as a space where we can help and instruct each other. In general, you should contact me there. I am also available by email. You can reach me at [mailto:jdfoote@purdue.edu jdfoote@purdue.edu]. I try hard to maintain a boundary between work and home and I typically respond only on weekdays during business hours.

= Assignments =

There will be multiple types of assignments, designed to encourage learning in different ways.

== Participation ==

This will be a very participatory class, and I expect you to be an active member of our class, engaged in helping us all to gain insight and inspritation. This includes paying attention in class, participating in activities, and being actively engaged in learning, thinking about, and trying to understand the material. 

This also includes doing the readings and watching the videos. To make sure that everyone has an opportunity to participate and to encourage you to do the assignments, I will randomly select students to answer discussion questions or to explain portions of homework assignments and labs. I will keep track of the quantity and quality of your responses and I will make that data available to you to help guide our discussion around grades.

== Discussion Questions ==

This course will have two "modes". For much of the class, we will be reading about theories of communication and rhetoric, about principles of data visualization, etc. For these sessions, you will be required to submit 1-2 discussion questions on Discord on Monday by noon. I will then curate some of these questions (and add some of my own) to use to guide our discussion on Tuesday.

Questions should engage with the readings and either connect to other concepts or to the "real world". Here are some good example questions:

* The readings this week talked a lot about how data visualizations can be misleading. How can we tell when visualizations are intentionally trying to mislead versus when they are just poorly designed?
* I was confused by the reading on counterfactuals. We obviously can't really know what would have happened in different conditions, so why even try?
* Imagine if you were asked to create an ad campaign to recruit students to Purdue. What types of appeals would you use and why?

During other weeks, we will be more focused on learning practical skills (mostly data manipulation and visualization in R). On those weeks, discussions will center around identifying places where folks are still confused and students will be randomly selected to share their responses to homework questions.

== Homework/Labs ==

There will be a number of homework assignments. At the beginning of the class, these will be designed to help you to grasp foundational concepts about storytelling, visualization, and data. As the class progresses, more and more of them will be based on learning and developing proficiency in visualizing data in R.

== Exams ==

There will be one in-class exam. It will assess your understanding of core concepts around storytelling and visualization.


== Final Project ==

The main outcome of this course will be your final project, which will be a data presentation, either as a website or a slide deck + presentation. A detailed description of the project is [[{{PAGENAME}}/Final project|at this link]].

There will be a number of intermediate assignments through the semester to help you to identify a dataset, explore the data for insights, and get and give feedback on visualizations and story elements.

= Grades =

This course will follow a "self-assessment" philosophy. I am more interested in helping you to learn things that will be useful to you than in assigning grades. In general, I think that my time is much better spent in providing better feedback and in being available to work through problems together.

The university still requires grades, so you will be leading the evaluation of your work. This will be completed with me in four stages, at the end of weeks 4, 8, 12, and 16. In each stage, you will use [[Self Assessment Reflection|this form]] to reflect on what you have accomplished thus far, how it has met, not met, or exceeded expectations, based both on rubrics and personal goals and objectives. At each of these stages you will receive feedback on your assessments. By the end of the semester, you should have a clear vision of your accomplishments and growth, which you will turn into a grade. As the instructor-of-record, I maintain the right to disagree with your assessment and alter grades as I see fit, but any time that I do this it will be accompanied by an explanation and discussion. These personal assessments, reflecting both honest and meaningful reflection of your work will be the most important factor in final grades.

We will use the following rubric in our assessment:

* 20%: class participation, including attendance and participation in discussions and group work
* 20%: Labs and homework assignments
* 25%: Exam
* 35%: Final Project

The exam will be graded like a normal exam and the score will make up 25% of your grade. For the rest of the assignments (and the other 75% of your grade), I will provide feedback which will inform an ongoing conversation about your work.

My interpretation of grade levels (A, B, C, D/F) is the following:

A: Reflects work the exceeds expectations on multiple fronts and to a great degree. Students reaching this level of achievement will:
* Do what it takes to learn the principles and techniques of data storytelling, including looking to outside sources if necessary.
* Engage thoughtfully with an ambitious final project.
* Take intellectual risks, offering interpretations based on synthesizing material and asking for feedback from peers.
* Share work early allowing extra time for engagement with others.
* Write reflections that grapple meaningfully with lessons learned as well as challenges.
* Complete all or nearly all homework assignments at a high level.

B: Reflects strong work. Work at this level will be of consistently high quality. Students reaching this level of achievement will:
* Be more safe or consistent than the work described above.
* Ask meaningful questions of peers and engage them in fruitful discussion.
* Exceed requirements, but in fairly straightforward ways - e.g., an additional post in discussion every week.
* Compose complete and sufficiently detailed reflections.
* Complete many of the homework assignments.

C: This reflects meeting the minimum expectations of the course. Students reaching this level of achievement
will:
* Turn in and complete the final project on time.
* Be collegial and continue discussion, through asking simple or limited questions.
* Compose reflections with straightforward and easily manageable goals and/or avoid discussions of challenges.
* Not complete homework assignments or turn some in in a hasty or incomplete manner.

D/F: These are reserved for cases in which students do not complete work or participate. Students may also be impeding the ability of others to learn.

== Extra Credit for Participating in Research Studies ==

The Brian Lamb School of Communication uses an online program that expedites the process of recruiting, signing up, and granting extra credit to students for participating in research studies. The program is called the Research Participation System, and it provides an easy online method for you to sign up for research studies, to keep track of the studies you have completed, and to view how many credits you have earned for each study. You can access the system online at any time, from any computer with a standard web browser. By participating in studies done within the Brian Lamb School of Communication, you can learn first hand how a study is conducted, you can contribute to the advancement of the field, and you can improve your grade by earning extra credit.

* You earn a ½ percent credit for every half-hour that you participate in a study. The maximum extra credit that you can earn for this course is 3%, which will be added to your total course points
* If you sign up to participate in a study and fail to show up without canceling your appointment in advance (up to 2 hours before the study), you can be restricted from signing up for any studies for 30 days. You may quickly cancel your appointment online using the Research Participation System.
* Please review the instructions before you sign up for studies; to view the instructions go to https://www.cla.purdue.edu/communication/research/participation/students.html
* You can sign up to participate in studies by logging into http://purdue-comm.sona-systems.com/.

= Schedule =

'''NOTE'''  This section will be modified throughout the course to meet the class's needs. Check back in weekly.


== Week 1: Introduction ==

January 19

'''Assignment Due:''' 
* [[/Discord signup|Sign up for Discord]] and introduce yourself
* Take [https://forms.gle/spJzcKBCsERVLHNSA this very brief survey]

'''Readings (before class):''' 
* None

'''Class Schedule:'''
* Class overview and expectations — We'll walk through this syllabus.


January 21

'''Assignment Due:''' 
* Read the entire syllabus (this document)

== Week 2: Storytelling and Narratives  ==


January 26 

'''Assignment Due:''' 
* [[#Discussion Questions|Discussion questions]]


'''Readings (before class):''' 
* Zak, P. (2013). [https://greatergood.berkeley.edu/article/item/how_stories_change_brain How stories change the brain]
* Langston, C. [https://www.youtube.com/watch?v=3klMM9BkW5o How to use rhetoric to get what you want] (video)
* Leighfield, L. [https://boords.com/ethos-pathos-logos-aristotle-modes-of-persuasion Ethos, Pathos & Logos: Aristotle’s Modes of Persuasion]
* Purdue OWL [https://owl.purdue.edu/owl/general_writing/academic_writing/rhetorical_situation/aristotles_rhetorical_situation.html Aristotle's Rhetorical Situation]
* [http://www.openculture.com/2014/02/kurt-vonnegut-masters-thesis-rejected-by-u-chicago.html Kurt Vonnegut's Shapes of Stories]
* Lafrance, A. [https://www.theatlantic.com/technology/archive/2016/07/the-six-main-arcs-in-storytelling-identified-by-a-computer/490733/ The Six Main Arcs in Storytelling, as Identified by an A.I.]
* (Optional) A Rulebook for Arguments (link on Brightspace)


'''Class Schedule:'''

== Week 3: Data insights and data stories ==


February 2

'''Assignment Due:'''
* [[#Discussion Questions|Discussion questions]]

'''Readings:'''
* Effective Data Storytelling (EDS) Ch. 1--3
* Matei, S. [https://purdue.brightspace.com/d2l/le/content/208726/viewContent/4750659/View What is a (data) story?]
* Levy, J. (2015). [https://www-tandfonline-com.ezproxy.lib.purdue.edu/doi/full/10.1080/09636412.2015.1070602 Counterfactuals, Causal Inference, and Historical Analysis]
* (Optional) [https://towardsdatascience.com/storytelling-for-data-scientists-317c2723aa31 Storytelling for Data Scientists]
* (Optional) [https://towardsdatascience.com/how-to-properly-tell-a-story-with-data-and-common-pitfalls-to-avoid-317d8817e0c9 How to properly tell a story with data — and common pitfalls to avoid] 

'''Class Schedule:'''
* Identifying insights
* Counterfactual thinking
* The role of statistics

== Week 4: The ethics of data stories (Part I) ==


February 9

'''Assignment Due:'''
* Turn in your [[Self Assessment Reflection]] on Brightspace
* Peruse [https://www.reddit.com/r/dataisugly/ r/dataisugly] on Reddit and share a few examples of misleading visualizations on Discord
* [[#Discussion Questions|Discussion questions]]

'''Readings:''' 
* Salganik, M. (2017). [https://www.bitbybitbook.com/en/ethics/ethics-intro/ Chapter 6: Ethics] from ''Bit by Bit''.
* Kassner, M. [https://www.techrepublic.com/article/5-ethics-principles-big-data-analysts-must-follow/ 5 ethics principles big data analysts must follow]
* McNulty, K. (2018). [https://towardsdatascience.com/beware-of-storytelling-with-data-1710fea554b0 Beware of 'storytelling' in data and analytics]
* (Optional) Steinmann, M., Matei, S. A., & Collmann, J. (2016). A Theoretical Framework for Ethical Reflection in Big Data Research. (On Brightspace)


'''Class Schedule:'''
* Ethical frameworks
* What are ethical data stories?
* When do analysts need to make ethical decisions?
* Transparency, respect, beneficence, honesty

== Week 5: Where does data come from? ==


February 16

'''Assignment Due:''' 
* [[#Discussion Questions|Discussion questions]]

'''Readings:'''
* Pelz, W. [https://courses.lumenlearning.com/suny-hccc-research-methods/chapter/chapter-6-measurement-of-constructs/ Measurement of Constructs] in ''Research Methods for the Social Sciences''.
* [https://uxplanet.org/dirty-data-what-is-it-and-how-to-prevent-it-742accad081e Dirty Data article]
* Salganik, M. [https://www.bitbybitbook.com/en/1st-ed/observing-behavior Observing behavior] in ''Bit by Bit''
* EDS Chapter 5
* Perkel, J. [https://www-nature-com.ezproxy.lib.purdue.edu/articles/d41586-018-05990-5 A toolkit for data transparency takes shape]
* (Optional) Tayi, G. K. and Ballou, D. P. (1998). [https://www.researchgate.net/publication/27297579_Examining_Data_Quality Examining Data Quality]

'''Class Schedule:'''
* NYT Covid Dashboard case study

== Week 6: Introduction to R ==


February 23

'''Assignment Due:''' 
* Install R and RStudio
* Open the RMarkdown file
* Complete the exercises


'''Readings:''' 
* [https://source.opennews.org/articles/what-i-learned-recreating-one-chart-using-24-tools/ What I Learned Recreating One Chart Using 24 Tools]. Lisa Charlotte Rost
* [https://r4ds.had.co.nz/introduction.html R4DS Ch. 1]
(Optional)
* [https://rladiessydney.org/courses/ryouwithme/01-basicbasics-0/ Unit 1: Basic Basics (R Ladies Sydney)]
* [https://communitydata.science/~ads/teaching/2020/stats/r_tutorials/w01-R_tutorial.html Intro to R tutorial (Aaron Shaw)]

'''Class Schedule:'''
* Why programming?
* Why R?
* R Markdown
* Functions
* Variables
* Data frames
* Tidyverse

== Week 7: Making figures in R ==

March 2

'''Assignment Due:''' 

'''Readings:''' 
* [https://r4ds.had.co.nz/data-visualisation.html R4DS Chapter 3]
* [https://socviz.co/gettingstarted.html DV Chapter 2]

'''Class Schedule:'''
* ggplot2


== Week 8: Manipulating and Aggregating Data  ==

March 9

'''Assignment Due:'''
* Turn in your [[Self Assessment Reflection]] on Brightspace

'''Readings:'''
* [https://r4ds.had.co.nz/transform.html R4DS Chapter 5]


== Week 9: Visualization Principles ==

March 16

'''Assignment Due:'''
* [[#Discussion Questions|Discussion questions]]


'''Readings:''' 
* EDS Chapter 7
* Healy, K. [https://socviz.co/lookatdata.html Data Visualization Chapter 1]
* Gelman, A. and Unwin, A. (2012). [http://www.stat.columbia.edu/~gelman/research/published/vis14.pdf Infovis and statistical graphics: Differrent goals, different looks].
* (Optional) Williams, R. (2008). [https://purdue-primo-prod.hosted.exlibrisgroup.com/primo-explore/fulldisplay?docid=PURDUE_ALMA51793773920001081&context=L&vid=PURDUE&lang=en_US&search_scope=everything&adaptor=Local%20Search%20Engine&tab=default_tab&query=any,contains,The%20Non-Designer%27s%20Design%20Book&mode=Basic The Non-Designer's Design Book], Chapters 1-6

'''Class Schedule:'''

March 18 - READING DAY

== Week 10: Visualization Principles II and Exploratory Data Analysis ==

March 23

'''Assignment Due:''' 
* [[/Data Source Assignment|Submit the data source for your final project]]
* Submit 2 questions for take-home exam

'''Readings:''' 
* [https://socviz.co/groupfacettx.html#groupfacettx DV Chapter 4: Show the right numbers]
* EDS Chapter 8
* [https://r4ds.had.co.nz/transform.html R4DS Ch 5]
* Hullman, J. [https://www-scientificamerican-com.ezproxy.lib.purdue.edu/article/how-to-get-better-at-embracing-unknowns/ How to get better at embracing unknowns]
* Yau, N. [https://flowingdata.com/2018/01/08/visualizing-the-uncertainty-in-data/ Visualizing the uncertainty in data].

'''Class Schedule:'''


== Week 11: Text as data ==

March 30

'''Assignment Due:'''
* [[#Discussion Questions|Discussion questions]]

'''Readings:'''

'''Class Schedule:'''
* Guest lecture by [https://ryanjgallagher.github.io/ Ryan J. Gallagher]



== Week 12: Advanced visualizations in R ==

April 6

'''Assignment Due:''' 
* [[Self Assessment Reflection]]
* [[/Exam|Take-home Exam]]

'''Readings:''' 
* [https://socviz.co/maps.html#maps DV Chapter 7: Maps]

'''Class Schedule:'''
* Maps
* Networks
* Annotations



== Week 13: Importing and cleaning data ==

April 13

READING DAY 

* Synchronous session moved to April 15

April 15

'''Assignment Due:'''
* [[/Final project proposal|Proposal for final project]]


'''Readings:'''
* [https://r4ds.had.co.nz/data-import.html R4DS Chapters 11--12]

'''Class schedule:'''
* Provide peer feedback on final project proposal


== Week 14: Crafting data stories ==

April 20

'''Assignment Due:''' 
* [[#Discussion Questions|Discussion questions]]
* [[/Final project proposal|New version of final project proposal]] (edited following peer feedback)

'''Readings:'''
* Kim, Y. et al. (2017). [http://users.eecs.northwestern.edu/~jhullman/explaining_the_gap.pdf Explaining the Gap: Visualizing One’s Predictions ImprovesRecall and Comprehension of Data].
* Knaflic, C. N. (1029). [https://purdue.alma.exlibrisgroup.com/view/uresolver/01PURDUE_PUWL/openurl?ctx_enc=info:ofi/enc:UTF-8&ctx_id=10_1&ctx_tim=2020-06-13T12%3A39%3A32IST&ctx_ver=Z39.88-2004&url_ctx_fmt=info:ofi/fmt:kev:mtx:ctx&url_ver=Z39.88-2004&rfr_id=info:sid/primo.exlibrisgroup.com-PURDUE_ALMA&req_id=_c20e3fe9e4a9a31b0162ece2023b8d45&rft_dat=ie=01PURDUE_PUWL:51807454010001081,language=eng,view=PURDUE&svc_dat=viewit&u.ignore_date_coverage=true&req.skin=PUWL&Force_direct=true&is_new_ui=true Storytelling with Data] Chapter 6
* EDS Chapter 9

== Week 15: Ethics of data stories (Part II) ==

April 27

'''Assignment Due:''' 
* [[#Discussion Questions|Discussion questions]]
* [[/Final project rough draft|Final project rough draft]] for peer feedback

'''Readings:'''

'''Topics:'''
* Including uncertainty

April 29

'''Assignment Due:'''
* Peer feedback (via email or Discord)

== Week 16: Finals week  ==


'''Assignment Due:'''
* [[{{PAGENAME}}/Final project|Final Project]] - Due Thursday, May 6
* Turn in your [[Final self reflection]] on Brightspace

= Policies =

== Attendance ==

In general, I expect students to attend our Tuesday meetings and to typically attend our Thursday meetings. It is expected that students communicate well in advance to faculty so that arrangements can be made for making up the work that was missed. It is your responsibility to seek out support from classmates for notes, handouts, and other information.

Only the instructor can excuse a student from a course requirement or responsibility. When conflicts can be anticipated, such as for many University-sponsored activities and religious observations, the student should inform the instructor of the situation as far in advance as possible. For unanticipated or emergency conflicts, when advance notification to an instructor is not possible, the student should contact me as soon as possible on Discord or by email. In cases of bereavement, quarantine, or isolation, the student or the student’s representative should contact the Office of the Dean of Students via email or phone at 765-494-1747. Our course Brightspace includes a link to the Dean of Students under 'Campus Resources.'

== Classroom Discussions and Peer Feedback ==

Throughout the course, you may receive, read, collaborate, and/or comment on classmates’ work. These assignments are for class use only. You may not share them with anybody outside of class without explicit written permission from the document’s author and pertaining to the specific piece.

It is essential to the success of this class that all participants feel comfortable discussing questions, thoughts, ideas, fears, reservations, apprehensions and confusion. Therefore, you may not create any audio or video recordings during class time nor share verbatim comments with those not in class linked to people’s identities unless you get clear and explicit permission. If you want to share general impressions or specifics of in-class discussions with those not in class, please do so without disclosing personal identities or details.


== Academic Integrity ==
 
While I encourage collaboration, I expect that any work that you submit is your own. Basic guidelines for Purdue students are outlined [https://www.purdue.edu/odos/osrr/academic-integrity/index.html here] but I expect you to be exemplary members of the academic community. Please get in touch if you have any questions or concerns.


== Nondiscrimination ==

I strongly support Purdue's policy of nondiscrimination (below). If you feel like any member of our classroom--including me--is not living up to these principles, then please come and talk to me about it.

Purdue University is committed to maintaining a community which recognizes and values the inherent worth and dignity of every person; fosters tolerance, sensitivity, understanding, and mutual respect among its members; and encourages each individual to strive to reach his or her own potential. In pursuit of its goal of academic excellence, the University seeks to develop and nurture diversity. The University believes that diversity among its many members strengthens the institution, stimulates creativity, promotes the exchange of ideas, and enriches campus life.


== Accessibility ==

Purdue University strives to make learning experiences as accessible as possible. If you anticipate or experience physical or academic barriers based on disability, you are welcome to let me know so that we can discuss options. You are also encouraged to contact the Disability Resource Center at: drc@purdue.edu or by phone: 765-494-1247.


== Emergency Preparation ==

In the event of a major campus emergency, I will update the requirements and deadlines as needed.


== Mental Health ==

If you or someone you know is feeling overwhelmed, depressed, and/or in need of mental health support, services are available. For help, such individuals should contact Counseling and Psychological Services (CAPS) at 765-494-6995 during and after hours, on weekends and holidays, or by going to the CAPS office of the second floor of the Purdue University Student Health Center (PUSH) during business hours.


== Incompletes ==

A grade of incomplete (I) will be given only in unusual circumstances. The request must describe the circumstances, along with a proposed timeline for completing the course work. Submitting a request does not ensure that an incomplete grade will be granted. If granted, you will be required to fill out and sign an “Incomplete Contract” form that will be turned in with the course grades. Any requests made after the course is completed will not be considered for an incomplete grade.


== Additional Policies ==

Links to additional Purdue policies are on our Brightspace page. If you have questions about policies please get in touch.