Using network analysis for rapid, transparent, and rigorous thematic analysis

Using network analysis for rapid, transparent, and rigorous thematic analysis: A case study of online distance learning

Yosep Dwi Kristanto, Universitas Sanata Dharma, Indonesia
Russasmita Sri Padmi, SEAMEO QITEP in Mathematics, Yogyakarta, Indonesia


In thematic analysis, themes construction can be performed manually by the researcher or automatically by a computer. Both methods have strengths and weaknesses. This article introduces a strategy that involves the role of both researcher and computer to construct themes from qualitative data in a rapid, transparent, and rigorous manner. The strategy uses network analysis and is demonstrated by employing a case study on students’ perceptions of online distance learning they experienced during the COVID-19 pandemic. The themes-construction strategy consists of four systematic phases, namely (1) determining unit of analysis and coding; (2) constructing the code co-occurrence matrix; (3) conducting network analysis; and (4) generating, reviewing, and reporting the themes. The strategy is successfully demonstrated in generating themes from the data with modularity value Q = 0.34. The application of network analysis in this strategy allows researchers to automatically generate themes from qualitative data using mathematical algorithms, represent these themes visually using network graph, and interpret the themes to answer the research questions.


qualitative data analysis; thematic analysis; network analysis; online distance learning; covid-19

Full Text:



Aguinis, H., & Solarino, A. M. (2019). Transparency and replicability in qualitative research: The case of interviews with elite informants. Strategic Management Journal, 40, 1291–1315.

Attride-Stirling, J. (2001). Thematic networks: An analytic tool for qualitative research. Qualitative Research, 1(3), 385–405.

Bastian, M., Heymann, S., & Jacomy, M. (2009). Gephi: An open source software for exploring and manipulating networks. International AAAI Conference on Weblogs and Social Media.

Blondel, V. D., Guillaume, J.-L., Lambiotte, R., & Lefebvre, E. (2008). Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment, 2008(10), P10008.

Brandes, U., Delling, D., Gaertler, M., Gorke, R., Hoefer, M., Nikoloski, Z., & Wagner, D. (2008). On modularity clustering. IEEE Transactions on Knowledge and Data Engineering, 20(2), 172–188.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.

Braun, V., & Clarke, V. (2012). Thematic analysis. In H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. (pp. 57–71). American Psychological Association.

Brennan, L., Cusack, T., Delahunt, E., Kuznesof, S., & Donnelly, S. (2019). Academics’ conceptualisations of the research-teaching nexus in a research-intensive Irish university: A dynamic framework for growth & development. Learning and Instruction, 60, 301–309.

Bringer, J. D., Johnston, L. H., & Brackenridge, C. H. (2006). Using computer-assisted qualitative data analysis software to develop a grounded theory project. Field Methods, 18(3), 245–266.

Burgess-Allen, J., & Owen-Smith, V. (2010). Using mind mapping techniques for rapid qualitative data analysis in public participation processes. Health Expectations, 13(4), 406–415.

Burns, S., & Schubotz, D. (2009). Demonstrating the merits of the peer research process: A Northern Ireland case study. Field Methods, 21(3), 309–326.

Chandra, Y., & Shang, L. (2019). An overview of R and RQDA: An open-source CAQDAS platform. In Qualitative research using R: A systematic approach (pp. 47–51). Springer Singapore.

Chen, K., Zhang, Y., & Fu, X. (2019). International research collaboration: An emerging domain of innovation studies? Research Policy, 48(1), 149–168.

Clarke, V., & Braun, V. (2013). Teaching thematic analysis: Overcoming challenges and developing strategies for effective learning. The Psychologist, 26(2), 120–123.

Drijvers, P., Grauwin, S., & Trouche, L. (2020). When bibliometrics met mathematics education research: the case of instrumental orchestration. ZDM.

Farrell, O., & Seery, A. (2019). “I am not simply learning and regurgitating information, I am also learning about myself”: learning portfolio practice and online distance students. Distance Education, 40(1), 76–97.

Fielding, N. G., & Lee, R. M. (2002). New patterns in the adoption and use of qualitative software. Field Methods, 14(2), 197–216.

Frandsen, T. (2017). Evolution of modularity literature: A 25-year bibliometric analysis. International Journal of Operations & Production Management, 37(6), 703–747.

Galdas, P. (2017). Revisiting bias in qualitative research. International Journal of Qualitative Methods, 16(1), 160940691774899.

Good, B. H., de Montjoye, Y.-A., & Clauset, A. (2010). Performance of modularity maximization in practical contexts. Physical Review E, 81(4), 046106.

Hannes, K., & Macaitis, K. (2012). A move to more systematic and transparent approaches in qualitative evidence synthesis: Update on a review of published papers. Qualitative Research, 12(4), 402–442.

Harary, F. (2018). Graph theory. CRC Press.

Haskins Lisle, A., Merenda, C., & Gabbard, J. (2020). Using affinity diagramming to generate a codebook: a case study on young military veterans and community reintegration. Qualitative Research, 20(4), 396–413.

Holloway, I., & Todres, L. (2003). The status of method: Flexibility, consistency and coherence. Qualitative Research, 3(3), 345–357.

Jackson, K., & Bazeley, P. (2019). Qualitative data analysis with NVivo. SAGE.

Jackson, K. M., & Trochim, W. M. K. (2002). Concept mapping as an alternative approach for the analysis of open-ended survey responses. Organizational Research Methods, 5(4), 307–336.

Jamieson, S. (2016). Analyse qualitative data. Education for Primary Care, 27(5), 398–402.

John, W. S., & Johnson, P. (2000). The pros and cons of data analysis software for qualitative research. Journal of Nursing Scholarship, 32(4), 393–397.

Kessler, M. M. (1963). Bibliographic coupling between scientific papers. American Documentation, 14(1), 10–25.

Kiger, M. E., & Varpio, L. (2020). Thematic analysis of qualitative data: AMEE Guide No. 131. Medical Teacher, 1–9.

King, A. (2010). ‘Membership matters’: Applying membership categorisation analysis (MCA) to qualitative data using computer‐assisted qualitative data analysis (CAQDAS) software. International Journal of Social Research Methodology, 13(1), 1–16.

King, N., & Brooks, J. (2018). Thematic analysis in organisational research. In C. Cassell, A. L. Cunliffe, & G. Grandy (Eds.), The SAGE handbook of qualitative business and management research methods: Methods and challenges (pp. 219–236). SAGE Publications Ltd.

Kristanto, Y. D., & Santoso, E. B. (2020). Towards a mathematics textbook for supporting 21st century learning: The student perspective. Journal of Physics: Conference Series, 1657, 012037.

Kristanto, Y. D. (2018). Technology-enhanced pre-instructional peer assessment: Exploring students’ perceptions in a Statistical Methods course. REiD (Research and Evaluation in Education), 4(2), 105–116.

Kristanto, Y. D., Utomo, B., & Sulistyani, N. (2020). Towards instructional design principles for online distance learning.

LeCompte, M. D., & Schensul, J. J. (1999). Analyzing & interpreting ethnographic data. AltaMira Press.

Lee, V., Coombe, L., Mahoney, R., Allen, C., & Robinson, P. (2018). Incorporating indigenous and non-indigenous worldviews through innovative text analysis: An evaluation of indigenous public health curricula. International Journal of Qualitative Methods, 17(1), 160940691881937.

Littenberg-Tobias, J., & Reich, J. (2020). Evaluating access, quality, and equity in online learning: A case study of a MOOC-based blended professional degree program. The Internet and Higher Education, 47, 100759.

Lund, K., Chen, B., & Grauwin, S. (2018). The potential of interdisciplinary in MOOC research. Proceedings of the Fifth Annual ACM Conference on Learning at Scale, 1–10.

McCain, K. W. (1990). Mapping authors in intellectual space: A technical overview. Journal of the American Society for Information Science, 41(6), 433–443.<433::AID-ASI11>3.0.CO;2-Q

Newman, M. E. J. (2004). Analysis of weighted networks. Physical Review E, 70(5), 056131.

Newman, M. E. J. (2006). Modularity and community structure in networks. Proceedings of the National Academy of Sciences, 103(23), 8577–8582.

Newman, M. E. J. (2010). Networks: An introduction. Oxford University Press.

Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1), 1–13.

Opsahl, T., Agneessens, F., & Skvoretz, J. (2010). Node centrality in weighted networks: Generalizing degree and shortest paths. Social Networks, 32(3), 245–251.

Pokorny, J. J., Norman, A., Zanesco, A. P., Bauer-Wu, S., Sahdra, B. K., & Saron, C. D. (2018). Network analysis for the visualization and analysis of qualitative data. Psychological Methods, 23(1), 169–183.

Rose, J., & Johnson, C. W. (2020). Contextualizing reliability and validity in qualitative research: toward more rigorous and trustworthy qualitative social science in leisure research. Journal of Leisure Research, 51(4), 432–451.

Ryan, G. W., & Bernard, H. R. (2003). Techniques to identify themes. Field Methods, 15(1), 85–109.

Salmona, M., Lieber, E., & Kaczynski, D. (2019). Qualitative and mixed methods data analysis using Dedoose: A practical approach for research across the social sciences. SAGE.

Scott, J., & Carrington, P. (2014). The SAGE handbook of social network analysis. SAGE Publications Ltd.

Small, H. (1973). Co-citation in the scientific literature: A new measure of the relationship between two documents. Journal of the American Society for Information Science, 24(4), 265–269.

Stopar, K., & Bartol, T. (2019). Digital competences, computer skills and information literacy in secondary education: mapping and visualization of trends and concepts. Scientometrics, 118(2), 479–498.

Thompson, R. (2002). Reporting the results of computer-assisted analysis of qualitative research data. Forum: Qualitative Social Research, 3(2), Art. 25.

Tuval-Mashiach, R. (2017). Raising the curtain: The importance of transparency in qualitative research. Qualitative Psychology, 4(2), 126–138.

Watkins, D. C. (2017). Rapid and rigorous qualitative data analysis. International Journal of Qualitative Methods, 16(1), 160940691771213.

Zhao, D., & Logan, E. (2002). Citation analysis using scientific publications on the web as data source: A case study in the XML research area. Scientometrics, 54(3), 449–472.



Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Find Jurnal Penelitian dan Evaluasi Pendidikan on:


ISSN 2338-6061 (online)    ||    ISSN 2685-7111 (print)

View Journal Penelitian dan Evaluasi Pendidikan Visitor Statistics