From Diaries to Digital: The Role of AI in Web-Mediated Documentary Analysis

This paper explores how artificial intelligence (AI) can support social researchers in utilizing web-mediated documents for research purposes. It extends traditional documentary analysis to include digital artifacts such as blogs, forums, emails and online archives. The discussion highlights the role of AI in different stages of the research process, including question generation, sample and design definition, ethical considerations, data analysis, and results dissemination, emphasizing how AI can automate complex tasks and enhance research design. The paper also reports on practical experiences using AI tools, specifically ChatGPT-4, in conducting web-mediated documentary analysis and shares some ideas for the integration of AI in social research.

Arosio, L. (2010). Personal documents on the Internet: What’s new and what’s old. Journal of Comparative Research in Anthropology and Sociology, 1/2, 1-16.

Arosio, L. (2022). What people leave behind online: Digital traces and web-mediated documents for social research. In F. Comunello, F. Martire, and L. Sabetta (Eds.), What people leave behind: Marks, traces, footprints and their relevance to knowledge society (pp. 311-323). Springer Nature.

Banker, S., Chatterjee, P., Mishra, H., & Mishra, A. (2023). Machine-assisted social psychology hypothesis generation. PsyArXiv.

Chen, T.-J. (2023). ChatGPT and other artificial intelligence applications speed up scientific writing. Journal of the Chinese Medical Association, 86(4), 351-353.

Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., … Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642.

Grossmann, I., Feinberg, M., Parker, D., Christakis, N., Tetlock, P., & Cunningham, W. (2023). AI and the transformation of social science research. Science, 380(6650), 1108-1109.

McCulloch, G. (2004). Documentary research: In education, history and the social sciences. London and New York: Routledge.

McGee, R. W. (2023). Using ChatGPT to conduct literature searches: A case study. Journal of Business Ethics, 95(2), 165-178.

OpenAI. (2024). Prompt engineering guidelines. Retrieved from https://platform.openai.com/docs/guides/prompt-engineering

Park, Y. J., Kaplan, D., Ren, Z., Hsu, C.-W., Li, C., Xu, H., … Li, J. (2024). Can ChatGPT be used to generate scientific hypotheses? Journal of Materiomics, 10(3), 578-584.

Plummer, K. (1983). Documents of life. London: Allen & Unwin.

Prior, L. (2003). Using documents in social research. SAGE Publications.

Scott, J. (1990). A matter of record: Documentary sources in social research. Polity Press.

Xu, R., Sun, Y., Ren, M., Guo, S., Pan, R., Lin, H., … Han, X. (2024). AI for social science and social science of AI: A survey. Information Processing & Management, 61(3), 103665.

Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2023). Can large language models transform computational social science? arXiv:2305.03514.