Editing Designing Internet Research (Spring 2025) (section)

=== Thursday April 10: Content Analysis and Sentiment Analysis ===

'''Required Readings:'''

This is a short encyclopedia article that defines content analysis. If you are at all unfamiliar with content analysis, please read this first, up until the section "Content Analysis Applications to Political Communication:

* Neuendorf, Kimberly A., and Anup Kumar. 2016. “Content Analysis.” In ''The International Encyclopedia of Political Communication'', 1–10. John Wiley & Sons, Ltd. https://doi.org/10.1002/9781118541555.wbiepc065. {{avail-uw|https://doi.org/10.1002/9781118541555.wbiepc065}}

Then proceed to read these pieces:

* Zamith, Rodrigo, and Seth C. Lewis. 2015. “Content Analysis and the Algorithmic Coder: What Computational Social Science Means for Traditional Modes of Media Analysis.” ''The Annals of the American Academy of Political and Social Science'' 659 (1): 307–18. https://doi.org/10.1177/0002716215570576. {{avail-uw|https://doi.org/10.1177/0002716215570576}}
* Grimmer, Justin, and Brandon M. Stewart. 2013. “Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts.” ''Political Analysis'', January, mps028. https://doi.org/10.1093/pan/mps028. {{avail-uw|https://doi.org/10.1093/pan/mps028}}
* Wankhade, Mayur, Annavarapu Chandra Sekhara Rao, and Chaitanya Kulkarni. 2022. “A Survey on Sentiment Analysis Methods, Applications, and Challenges.” ''Artificial Intelligence Review'' 55 (7): 5731–80. https://doi.org/10.1007/s10462-022-10144-1. {{avail-uw|https://doi.org/10.1007/s10462-022-10144-1}}
* Fan, Jia, Ai Yushi, Xiaofan Liu, Yilin Deng, and Yongning Li. 2024. “Coding Latent Concepts: A Human and LLM-Coordinated Content Analysis Procedure.” ''Communication Research Reports'' 41 (5): 324–34. https://doi.org/10.1080/08824096.2024.2410263. {{avail-uw|https://doi.org/10.1080/08824096.2024.2410263}}.
* Törnberg, Petter. 2023. “How to Use LLMs for Text Analysis.” ''arXiv''. https://doi.org/10.48550/arXiv.2307.13106. {{avail-free|https://doi.org/10.48550/arXiv.2307.13106}}
* '''[Example]''' Kramer, Adam D. I., Jamie E. Guillory, and Jeffrey T. Hancock. 2014. “Experimental Evidence of Massive-Scale Emotional Contagion through Social Networks.” ''Proceedings of the National Academy of Sciences'' 111 (24): 8788–90. https://doi.org/10.1073/pnas.1320040111. {{avail-uw|https://doi.org/10.1073/pnas.1320040111}}

'''Optional Readings:'''

* McMillan, Sally J. 2000. “The Microscope and the Moving Target: The Challenge of Applying Content Analysis to the World Wide Web.” ''Journalism & Mass Communication Quarterly'' 77 (1): 80–98. https://doi.org/10.1177/107769900007700107. {{avail-uw|https://doi.org/10.1177/107769900007700107}}
* Herring, Susan C. 2010. “Web Content Analysis: Expanding the Paradigm.” In ''International Handbook of Internet Research'', edited by Jeremy Hunsinger, Lisbeth Klastrup, and Matthew Allen, 233–49. Dordrecht: Springer Netherlands. https://doi.org/10.1007/978-1-4020-9789-8_14. {{avail-uw|https://doi.org/10.1007/978-1-4020-9789-8_14}}
* Trilling, Damian, and Jeroen G. F. Jonkman. 2018. “Scaling up Content Analysis.” ''Communication Methods and Measures'' 12 (2–3): 158–74. https://doi.org/10.1080/19312458.2018.1447655. {{avail-uw|https://doi.org/10.1080/19312458.2018.1447655.}}
* Grimmer, Justin, Margaret E. Roberts, and Brandon M. Stewart. 2022. ''Text as Data: A New Framework for Machine Learning and the Social Sciences''. Princeton University Press. ''[Available from Instructor]''
* Törnberg, Petter. “Large Language Models Outperform Expert Coders and Supervised Classifiers at Annotating Political Social Media Messages.” ''Social Science Computer Review'', September, 08944393241286471. https://doi.org/10.1177/08944393241286471. {{avail-uw|https://doi.org/10.1177/08944393241286471}}
* TeBlunthuis, Nathan, Valerie Hase, and Chung-Hong Chan. 2024. “Misclassification in Automated Content Analysis Causes Bias in Regression. Can We Fix It? Yes We Can!” ''Communication Methods and Measures'' 18 (3): 278–99. https://doi.org/10.1080/19312458.2023.2293713.

I'm assuming you have at least a rough familiarity with content analysis as a methodology. These help provide more of a background into content analysis in general:

* Neuendorf, Kimberly A. 2017. ''The Content Analysis Guidebook''. 2nd ed. Thousand Oaks, CA: SAGE. ''[Available from Instructor]''
* Krippendorff, Klaus. 2018. ''Content Analysis: An Introduction to Its Methodology''. 4th ed. SAGE Publications. ''[Available from Instructor]''