A smart and effective method for undertaking literature reviews particularly for research students and others new to a discipline.

Narrative methods that are commonly used in many research theses, rely on the expertise and experience of the author, making them challenging for novices. In contrast, the method we use and recommend involves systematically searching the literature using online database and other sources to find all relevant papers that fit specific criteria (systematically identifying the literature), entering information about each study into a personal database, then compiling tables that summarise the current status of the literature (quantifying the literature). The results are reliable, quantifiable and reproducible.

Using this method, it’s also possible to determine if there are suitable datasets for meta-analysis. By mapping the literature we can not only identify what is known, but also, but where there are gaps: a critical issue in advancing research and designing PhD research programs.

Reliable, quantifiable and reproducible

The method works well for specific topics, but also for summarising diverse inter-disciplinary research. Using this method many of our students and others have gone on to publish their reviews. Importantly for PhD students, the database can be updated during the PhD thesis allowing them to easily identify relevant papers and produce their final thesis without having to re-read all the literature.

  1. Ansong, M. and Pickering, C.M. (2013). A global review of weeds that can germinate from horse dung. Ecological Management and Restoration. 14: 216-223
  2. Ansong, M. and Pickering. C.M.  (2013). Are weeds hitchhiking a ride on your car? A systematic review of seed dispersal on cars. PlosOne. 8:e80275
  3. Ansong, M. and Pickering. C.M. (2014). Weed seed on clothing: A global review. Journal of Environmental Management. 144: 203-211
  4. Ballantyne, M. and Pickering, C.M. (2013). Tourism and recreation: A common threat to IUCN red-listed vascular plants in Europe. Biodiversity and Conservation. 22: 3027-3044. DOI 10.1007/s10531-013-0569-2
  5. Ballantyne, M. and Pickering C.M. (2015). The impacts of trail infrastructure on vegetation and soils: current literature and future directions. Journal of Environmental Management. 164: 53-64. 10.1016/j.jenvman.2015.08.032
  6. Bartesaghi Koc, C., Osmond, P. and Peters, A. (2016). Towards a comprehensive green infrastructure typology: a systematic review of approaches, methods and typologies. Urban Ecosystems. 20: 15-35. doi:10.1007/s11252-016-0578-5
  7. Barros, A., Monz, C. and Pickering, C.M. (2015). Is tourism damaging ecosystems in the Andes? Current knowledge and an agenda for future research. Ambio. 44:82–98. DOI 10.1007/s13280-014-0550-7
  8. Bergstrom, J., van Winsen, R. and Henriqson, E. (2015). Reliability engineering and system safety. Reliability of Engineering and System Safety. 141:131-141
  9. Botzat, A., Fisher, L.K. and Kowarik, I. (2016). Unexploited opportunities in understanding liveability and biodiverse cities. A review of urban biodiversity perception and valuation. Global Environmental Change. 39: 220-233
  10. Boulton, C., Byrne, J. and Dedekorkut-Howes, A., (2015). The role of political and financial factors in the provision of parks: The case of Logan City, Queensland. Sate of Australian Cities Conference.
  11. Byrne, J. and Portanger, C. (2014). Climate change, energy policy and justice: A systematic Review. Analyse & Kritik. 36:315-418
  12. Chaousis, S., Leusch, F.D.L. and van der Merwe, J.P. (2018). Charting a path towards non-destructive biomarkers in threatened wildlife: A systematic quantitative literature review. Environmental Pollution. 234: 59-70.
  13. Chester, P., Ehrlich, C., Warburton, L., Baker, D., Kendall, E. and Crompton, D. (2016). What is the work of recovery orientated practice? A systematic literature review. International Journal of Mental Health Nursing. 25: 270-285
  14. Cheng, M., Edwards, D., Darcy, S. and Redfern, K. (2016). A tri-method approach to a review of adventure tourism literature: Bibliometric analysis, content analysis and a quantitative systematic literature review. Journal of Hospitality and Tourism Research. 1-24.
  15. Cheng, W., Appolloni, A., D’Amato, A. and Zhu, Q. (2018). Green public procurement, missing concepts and future trends – A critical review. Journal of Cleaner Production. 176: 770-784.
  16. Clark, N.J., Clegg, S.M. and Lima, M.R. (2014). A review of global diversity in avian haemosporidians (Plasmodium and Haemoproteus: Haemosporida): new insights from molecular data. International Journal of Parasitology. 44: 329-338
  17. Crisp B. (2015) Systematic reviews: A social work perspective, Australian Social Work. 68: 284-295, DOI: 10.1080/0312407X.2015.1024266
  18. Davenport, R., Hewat, S., Ferguson, A., McAllister, S. and Lincoln, M. (2017). Struggle and failure on clinical placement: A critical narrative review. International Journal of Language and Communication Disorders. 10.1111/1460-6984.12356
  19. Davis N.E., Bennett A., Forsyth, D.M., Bowman D.M.J.S., Lefroy E.D., Wood S.W., Woolnough A.P., West, P., Jordan O., Hampton, J.O. and Johnson C.N. (2016). A systematic review of the impacts and management of introduced deer (family Cervidae) in Australia. Wildlife Research. 43: 515-532. http://dx.doi.org/10.1071/WR16148
  20. Davis, I. and Hay, S. (2017). Primary masculinities: How male teachers are regarded as employees within primary education - a global systematic literature review. Sex Education. https://doi.org/10.1080/14681811.2017.1400963
  21. De Brito, M.M and Evers, M. (2015). Review article: Multi-criteria decision making for flood risk management: a survey of the current state-of-the-art. Natural Hazards and Earth Sciences. 3: 6689-6726.
  22. Dedekorkut-Howes, A. and Vickers, J. (2017). Coastal climate adaptation at the local level: A policy analysis of the Gold Coast. In Climate Change Adaptation in Pacific Countries. Springer, London pp. 401-415
  23. Evans, N., Stevenson, R.B., Lasen, M., Ferreira, J. and Davis, J. (2017). Approaches to embedding sustainability in teaching education: A synthesis of the literature. Teaching and Teacher Education. 63: 405-417
  24. Emam, H., Farrell, P. and Abdelaal, M.A. (2014). Causes of delay in GCC construction projects: a Critical Review. Paper published in the 1st Int’l Conference on Smart, Sustainable and Healthy Cities. Abu Dhabi, UAE. pp 607-621
  25. Falkenberg, L.J. and Tubb, A. (2017). Economic effects of ocean acidification: Publication patterns and directions for future research. Ambio. 46: 543-553. doi:10.1007/s13280-017-0895-9
  26. Filho, M.F., Liao, Y., Loures, E.R and Canciglieri Junior, O. (2017). Self-aware smart products: A Systematic literature review, conceptual design and prototype implementation. Procedia Manufacturing. 11: 1471-1480
  27. Finlayson, K.A., Leusch, F.D.L. and van der Merwe, J.P. (2016). The current state and future directions of marine turtle toxicology research. Environmental International. 94: 113-123
  28. Griffin, K., Gambley, C., Brown, P. and Li, Y. (2017). Copper-tolerance in Pseudomonas syringae p. tomato and Xanthomonas spp. And the control of diseases associated with these pathogens in tomato and pepper. A systematic literature review. Crop Protection. 96: 144-150
  29. Grogan, L.F., Ellis, w., Jones, D., Hero, J., Kerlin, D.H., and McCallum, H. (2017). Current trends and future research directions in Koala chlamydial disease research. Biological Conservation. 215: 179-188.
  30. Gstaettner, A.M.,  Lee, D. and Rodger, K. (2016). The concept of risk in nature-based tourism and recreation – a systematic literature review. Current Issues in Tourism. pp 1-26
  31. Guitart, D., Pickering, C.M., Byrne, J. (2012). Past results and future directions in urban community gardens research. Urban Forestry and Urban Greening. 11: 364-373
  32. Hains-Wesson, R., Tytler, R. (2015). A perspective on supporting STEM academics with blended learning at an Australian university. Issues In Educational Research. 25: 460-479
  33. Hegetschweiler, K.T., de Vries, S., Arnberger, A., Bell, S., Brennan, M., Siter, N., Olafsson, A.S., Voigt, A. and Hunziker, M. (2017). Linking demand and supply factors in identifying cultural ecosystem services of urban green infrastructures: A review of European studies. Urban Forestry & Urban Greening. 21: 48-59
  34. Herington, M.J., van de Fliertb, E., Smarta, S., Greiga, C. and Lanta P.A. (2017). Rural energy planning remains out-of-step with contemporary paradigms of energy access and development. Renewable and Sustainable Energy Reviews, 67: 1412–1419.
  35. Hirsch, P.E., N’Guyen, A., Adrian-Kalchhauser, I. and Burkhardt-holm, P. (2015). What do we really know about the impacts of one of the 100 worst invaders in Europe? A reality check. Ambio. 45; 267. DOI 10.1007/s13280-015-0718-9
  36. Hoque, M.A., Phinn, S. and Roelfsema, C. (2017). A systematic review of tropical cyclone disaster management research using remote sensing and spatial analysis. Ocean and Coastal Management. 146: 109-120
  37. Howes, M., Wortley, L., Potts, R., Dedekorkut-Howes, A., Serrao-Neumann, S., Davidsone, J. Smith, T. and Nunn. T. (2017). Environmental sustainability: A case of policy implementation failure? Sustainability. 9: 165. doi: 10.3390/su9020165.
  38. Jasinski, D., Meredith, J., and Kirwan, K. (2015). A comprehensive review of full cost accounting methods and their applicability to the automotive industry. Journal of Cleaner Production. 108: 1123–1139
  39. Kim, E. and Cuskelly, G. (2017). A systematic quantitative review of volunteer management in events. Event Management. 21: 83-100
  40. Kim, E. (2017). A systematic review of motivation of sport event volunteers. World Leisure Journal. DOI: 10.1080/16078055.2017.1373696
  41. Koc, C.B., Osmond, P. and Peters, A. (2017). Towards a comprehensive green infrastructure typology: a systematic review of approaches, methods and typologies. Urban Ecosystems. 20: 15-35.
  42. Khoo-Lattimore, C., Mura, P. and Yung, R. (2017). The time has come: a systematic literature review of mixed methods research in tourism. Current Issues in Tourism. DOI: 10.1080/13683500.2017.1406900
  43. Khoshbakht, M., Gou, Z. and Dupre, K. (2018). Energy use characteristics and benchmarking for higher education buildings. Energy and Buildings. 164: 61-76.
  44. Kollmann, J., Myer, S.T., Bateman, R., et al. (2016). Integrating ecosystem functions into restoration ecology – recent advances and future directions. Restoration Ecology. 24; 722-730. 10.1111/rec.12422.
  45. Kuester, S., Konya-Baumbach, E. and Schuhmacher, M.C. (2018). Get the show on the road: Go-to-market strategies for e-innovations of start-ups. Journal of Business Research. 83: 65-81.
  46. Lai, M.Y., Khoo-Lattimore, C. and Wang, Y. (2017). Food and cuisine image in destination branding: Toward a conceptual model. Tourism and Hospitality Research. DOI: 10.1177/1467358417740763
  47. Lebeau, P., Verlinde, S., Macharis, C. and Van Mierlo, J. (2017). How can authorities support urban consolidation centres? A review of the accompanying measures. Journal of Urbanism: International Research on Placemaking and Urban Sustainability. 10: 468-486 doi.org.libraryproxy.griffith.edu.au/10.1080/17549175.2017.1310747.
  48. Leung, J., Ferrari, A., Baxter, A., Schoultz, M., Beattie, M. and Harris M. (2017). Systematic reviews: inducting research students into scholarly conversations? Higher Education Research & Development. 36: 217-220.
  49. Liao, Y., Deschamps, F., de Freitas Rocha Loures, E. and Ramos, L.F.P. (2017). Past, present and future of Industry 4.0- a systematic literature review and research agenda proposal. International Journal of Production Research. 55: 3609-3629.
  50. Liao, Y., Panetto, H., Simao, J.M. and Stadzisz, P.C. (2017). Ontology-based model-driven patterns for notification-oriented data-intensive enterprise information systems. 7th International Conference on Information Society and Technology ICIS, Kopaonik, Serbia. pp. 148-153
  51. Liao, Y., Ramos, L.F.P, Saturno, M., Deschams, F., Loures, E.D.R and Szejka, A.J. (2017). The role of interoperability in the fourth industrial revolution era. IFAC_PapersOnLine 50: 12434-12439.
  52. McAnulty, T., Jeswiet, J. and Doolan, M. (2016). Formability in single point incremental forming: A comparative analysis of the state of the art. CIRP Journal of Manufacturing Science and Technology. 16:43-54.
  53. N’Guyen, A., Hirsch, P.E., Adrian-Kalchhauser, I. and Burkhardt-Holm, P. (2015). Improving invasive species management by integrating priorities and contributions of scientists and decision makers. Ambio. 45: 280. DOI 10.1007/s13280-015-0723-z
  54. Nicolosi, E. and Corbett, J.B. (2018). Engagement with climate change and the environment: a review of the role of relationships to place. Local Environment. 23: 77-99
  55. Patroni, J., Simpson, G. and Newsome, D. (2018). Feeding wild fish for tourism – A systematic quantitative literature review of impacts and management. International Journal of Tourism Research. DOI: 10.1002/jtr.2180.
  56. Papadonikolaki, E., Koutamanis, A. and Wamelink, J.W.F. H. (2013). Attaining performance and building information modelling: A systematic literature review of product and process modelling in AEC. Building Information Modelling. Volume 2. Computation and Performance eCAADe31 475-483
  57. Phan, T.D., Smart, J.C.R., Capon, S.J. and Hadwen, W.L. (2016). Applications of Bayesian belief networks in water resource management: A Systematic Review. Environmental Modelling and Software. 85: 98-111
  58. Pickering, C.M., Rossi, S.D., Hernando, A. and Barros, A. (2018). Current knowledge and future research directions for the Monitoring and Management of Visitors in Recreational and Protected Areas Journal of Outdoor Recreation and Tourism. 21: 10-18
  59. Prater, J. Kirytopoulos, K. and Ma, T. (2017). Optimism bias within the project management context: A systematic quantitative literature review. International Journal of Managing Projects in Business. 10: 370-385
  60. Prayag, G. and Ozanne, L. (2018). A systematic review of peer-to-peer (p2p) accommodation sharing research from 2010 to 2016: progress and prospects from the multi-level perspective. Journal of Hospitality Marketing and Management.https://doi.org/10.1080/14681811.2017.1400963
  61. Riebe, L., Girardi, A. and Whitsed, C. (2016). A systematic literature review of teamwork pedagogy in higher education. Small Group Research. 47: 619-664.
  62. Riebe, L., Girardi, A. and Whitsed, C. (2017). Teaching teamwork skills in Australian higher education business disciplines: Evidence from a systematic literature review. Issues in Educational Research. 27: 134
  63. Roche, S. (2017). Child protection and maltreatment in the Philippines: A systematic review of the literature. Asian and the Pacific Policy Studies. 4: 104-128. 10.1002/app5.167
  64. Roy, S., Pickering, C. and Byrne, J. (2012). A systematic quantitative review of urban tree benefits, costs, and assessment methods across cities in different climatic zones. Urban Forestry and Urban Greening. 11: 351– 363
  65. Rupprecht, C.D.D., Byrne, J.A., Garden, J.G. and Hero, J. (2015). Informal urban green space: A trilingual systematic review of its role for biodiversity and trends in the literature. Urban Forestry and Urban Greening. 14: 883-908
  66. Sato, C.F., Wood, J.T. and Lindenmayer, D.B. (2013) The effects of winter recreation on alpine and subalpine fauna: A systematic review and meta-analysis. PlosOne. 8:e64282.
  67. Schoenberg, G., Cuskelly, G. and Auld, C. (2016). The role of intragroup dynamics in non-profit governance models: a systematic quantitative literature review. Managing Sport and Leisure. 21: 1-22. DOI:10.1080/23750472.2016.1169212
  68. Scott, N., Zhang, R., Le, D. and Moyle, B. (2017). A review of eye-tracking research in tourism. Current Issues in Tourism. DOI: 10.1080/13683500.2017.1367367
  69. Spasojevic, B., Lohmann, G. and Scott, N. (2016). Systematic literature review on air transport and tourism: Analysis from 54 journals during the period 2000-2014. CAUTHE 2016: The Changing Landscape of Tourism and Hospitality: The Impact of Emerging Markets and Emerging Destinations. Sydney: Blue Mountains International Hotel Management School, 2016: 293-313
  70. Steven, R., Pickering, C.M. and Castley, G. (2011). A review of the impacts of nature based recreation on birds. Journal of Environmental Management. 92: 2287-2294
  71. Steven, R., Morrison, C. and Castley, J.G. (2014). Birdwatching and avitourism: A global review of research into its participant markets, distribution and impacts, highlighting future research priorities to inform sustainable avitourism management. Journal of Sustainable Tourism: 23: 1257-1276. DOI:10.1080/09669582.2014.924955
  72. Stevenson, R.B., Lasen, M., Ferreira, J.A. and Davis, J. (2017). Approaches to embedding sustainability in teacher education: a synthesis of the literature. Teaching and Teacher Education 63: 405-417
  73. Sullivan, K., Thomas, S. and Rosano, M. (2018). Using industrial ecology and strategic management concepts to pursue the sustainable development goals. Journal of Cleaner Production. 174: 237-246.
  74. Suzuki, M., Pai, C. and Islam, M.J. (2018). Systematic quantitative literature review of criminological theories in Asia. Asian Criminology. doi: 10.1007/s11417-017-9262-9
  75. Tarne, P., Traverso, M. and Finkbeiner, M. (2017). Review of life cycle sustainability assessment and potential for its adoption at an automotive company. Sustainability 9: 670. doi:10.3390/su9040670
  76. Tilbury, C. and Ramsay, S. (2018). A systematic scoping review of parental satisfaction with child protection services. Evaluation and Program Planning. 66: 141-146.
  77. Trembath, D., Westerveld, M. and Shellshear, L. (2016). Assessing spoken language outcomes in children with ASD: A systematic review. Current Development Disorders Reports. 3: 33-45
  78. Thomas, S. (2014). Blue carbon: Knowledge gaps, critical issues and novel approaches. Ecological Economics. 107: 22-38
  79. Turner, J.A., Babcock, R.C., Hovey, R. and Kendrick, G.A. (2017). Deep thinking: a systematic review of mesophotic coral ecosystems. ICES Journal of Marine Science 74: 2309-2320.  https://doi.org/10.1093/icesjms/fsx085
  80. Ward, A., Dargusch, P., Thomas, S., Liu, Y., Fulton, E.A. (2014). A global estimate of carbon stored in the world’s mountain grasslands and shrublands and implications for climate policy. Global Environmental Change. 28: 14-24
  81. Ward, A., Dargusch, P., Grussu, G. and Romeo, R. (2016).Using carbon finance to support climate policy objectives in high mountain ecosystems. Climate Policy. 16: 732-751. DOI:10.1080/14693062.2015.1046413
  82. Wolf, I.B., Ainsworth, G.B., and Crowley, J. (2017). Transformative travel as a sustainable market niche for protected areas: a new development, marketing and conservation model. Journal of Sustainable Tourism 25: 1650-1673.  http://dx.doi.org/10.1080/09669582.2017.1302454
  83. Wortley, L., Hero, J. and Howes, M. (2013). Evaluating ecological restoration success: A review of the literature. Restoration Ecology. 21: 537-543
  84. Yang, E.C.L., Khoo-Lattimore, C. and Arcodia, C. (2017). A systematic literature review of risk and gender research in tourism. Tourism Management. 58: 89-100
  85. Yung, R. and Khoo-Lattimore, C. (2017). New realities: a systematic literature review of virtual reality and augmented reality in tourism research. Current Issues in Tourism. DOI: 10.1080/13683500.2017.1417359

Article in The Conversation:

Important reference for how to report on how you systematically searched for papers that may be required by journals:

  • Boote, B.N. and Beile P. (2005). Scholars before researchers: On the centrality of the dissertation literature review in research preparation. Educational Researcher. 34: 3-15.
  • Crisp, B.R. (2015) Systematic reviews: A social work perspective. Australian Social Work, 68:3, 284-295.
  • Murray, R. (2011). How to Write a Thesis. McGraw Hill Open University Press. Maidenhead, England (Chapter on writing a literature reviews).
  • Petticrew, M. and Roberts, H. (2006). Systematic Reviews in the Social Sciences: A Practical Guide. Blackwell Publishing, Oxford, England.
  • Randolph J.J. (2009). A guide to writing the dissertation literature review. Practical Assessment, Research and Evaluation. 14: 1-13.

Connect with us

If you would like to work, study or collaborate with us, get in touch