







Strength of Evidence Transferability Editor's Comments |
This guide is designed to help you to:
This MESHGuide draws on a range of key literature in the field of social science research. Also its design has been informed by lessons learned from personal research, which has focussed on the following areas:
Bryman, A. (2008) Social Research Methods, 3rd edn. Oxford: Oxford University Press.
Cresswell, J.W. (2011) Planning, Conducting, and Evaluating Qualitative Research, 4th edn, London: Pearson.
Newby, P. (2014) Research Methods for Education, 2nd edn. Harlow: Pearson Education Ltd.
O'Leary, Z. (2010) The Essential Guide to Doing Your Research Project. London: Sage.
Patterson, E.W. (2011) Initial teacher development in science: the impact of constructivist-informed practice on learning, Teacher Development, 15(1), pp69-86.
Punch, K. (2009) Introduction to Research Methods in Education. London: Sage.
Walliman, N. (2009) Your Research Project: A step-by-step guide for the first-time researcher, 2nd edn. London: Sage.
Winter, G. (2000) A comparative discussion of the notion of 'validity' in qualitative and quantitative research. The Qualitative Report, 4 (3-4), March. www.nova.edu/sss/QR/QR4-3/winter.html. Retrieved 10/7/15]
Useful books
Cohen, L., Manion, L. and Morrison, K. (2007) Research Methods in Education, 6th edn. London: Routledge.
Langdridge, D. and Hagger-Johnson, G. (2009) Introduction to Research Methods and Data Analysis in Psychology, 2nd edn. Harlow: Pearson Education Ltd.
Newby, P. (2014) Research Methods for Education, 2nd edn. Harlow: Pearson Education Ltd.
Orna, E. and Stevens, G. (2009) Managing Information for Research: Practical Help in Researching, Writing and Designing Dissertations. Buckingham: Open University Press. This book provides useful guidance on how to go about writing your literature review.
Pears, R. and Shields, G. (2008) Cite Them Right: The Essential Referencing Guide, 2nd edn. Wickham: Pear Tree Books. This book provides extremely useful and comprehensive guidance on how to set out your references.
Ridley, D. (2012) The Literature Review: A Step-by-Step Guide for Students, 2nd edn. London: Sage.
Rumsey,S. (2008) How to Find Information: A Guide for Researchers, 2nd edn. Maidenhead: Open University Press. This book provides useful guidance on how to conduct electronic searches.
Web-based resources
British Education Research Association (BERA) publications
National Foundation for Education Research (NFER) research reports and guides
How to conduct an effective and valid literature search (Nursingtimes.net)
Guide to Harvard Referencing (University of Southampton)
How to conduct a systematic or evidence based literature review: Margaret Adolphus
Methods for conducting systematic reviews: EPPI
Creating a literature map: UWE
Using a concept map to organise a literature review using VUE
Institute of Education / UCL EPrints repository
Department for Education (DfE) research publications
Evidence for Policy and Practice Information and Coordinating Centre (EPPI-Centre) database of education research
Office for Standards in Education (Ofsted) Survey and Thematic reports
https://www.gov.uk/government/collections/ofsted-schools-survey-reports#documents
Oxfam research publications
http://policy-practice.oxfam.org.uk/publications
American Educational Research Association:
Review of Educational Research:
Review of Research in Education
The most basic purpose for carrying out a literature review is to enable you to develop your understanding of the key theoretical perspectives, research findings and issues within the area being reviewed. This will involve engaging with sources such as journal articles, books and other documents in a critical and reflective way. The process of engaging with the literature should be an on-going process throughout your research project.
When writing your literature review it is important to be aware of the functions that your literature review could serve, as this will provide a clear focus to your writing. The literature review enables you to set your proposed research in context. For some projects it will be important to explore the historical context, for example significant events within education in a period of history; key government papers and policies; or exploration of significant research projects and how they influenced the development of thinking in your particular area of research. For all projects the current context in the field of study needs to be considered, for example exploration of current educational debates.
Another important function of your literature review is the exploration of theoretical perspectives relevant to your area of research. Within your proposed area of research there will exist established theories. These theories will have emerged from the research that has been carried out in the past and can be used to inform future research. It is likely that alternative and sometimes conflicting ideas may exist and it is important to consider these in the literature review. In order for you to be able to make effective use of theoretical perspectives in your work, it is essential that you gain a clear understanding of the concepts associated with these and the terminology used to describe these concepts. It is important to explain these concepts and provide clear definitions of terminology within your literature review.
The main focus of your literature review will be to explore the research findings from projects that are related to your research focus. The scope and direction that this review of the research literature takes will be directed by your research questions or aims. Engaging with other research will help you to develop and refine your research questions or aims and to establish a rationale for the significance of your research, for example through identifying a gap in existing research.
Carrying out a literature review provides direction for your research by:
Further reading
How to conduct an effective and valid literature search (Nursingtimes.net)
http://www.nursingtimes.net/Journals/2013/02/12/h/m/o/071106ResSearch.pdf
A systematic review of the literature investigates a particular issue by analysing the key findings of existing research. This type of literature review will also be framed around a research issue and research questions or aims, but the source of the data is secondary. In a project that involves the collection of primary data, decisions need to be made regarding how to carry out the research in practice, whereas in a systematic literature review the approach that will be used in critically reviewing the literature needs to be considered. In the field of education a commonly used approach is narrative synthesis, which involves drawing together and analysing the key findings of research.
Further reading:
How to conduct a systematic or evidence based literature review: Margaret Adolphus
http://www.emeraldgrouppublishing.com/authors/guides/write/evidence_based.htm?part=1
When carrying out electronic searches it is important to try out different synonyms or related terms, therefore one of the first things that you need to do is to establish the key terms to use. Once you have found some journal articles relevant to your study, these often include lists of key words and you can then use some of these to develop your search. An example of how key terms can be identified is included here:
Area of focus: Constructivism in science teaching
Suggested steps to follow:
Think of key terms that relate to the focus area.
Enter these terms into Google Scholar and identify some relevant journal articles.
Use these articles to help you identify further search terms
If your search does not come up with any useful sources consider using alternative terms.
Possible key words and phrases you could search for:
Possible key terms |
Alternative terms you could try |
you could tryconstructivism science teaching (the three terms above would be entered together as a search string) |
constructivist; constructivist learning; discovery learning; problem-based learning; inquiry learning experiential learning |
“constructivist-informed practice” |
“constructivist-informed teaching” |
learning |
“socially mediated learning” |
Boolean operators: the words AND, NOT, and OR can be used to combine words in a search string to allow you to:
The search can also be broadened by locating different search terms and by putting ~ in front of a word, which will facilitate related words being found e.g. ~foreign students will also find international and overseas students.
Truncation symbols such as * (most common) or ? or $ can be attached to the suffix of a word to allow you to search for different suffixes e.g. ‘manage*’ would enable you to retrieve the terms manager, managing, manages and management.
Wildcards such as ? or # can be used to represent letters that may vary e.g. behave? would retrieve behaviour and behavior.
Google Scholar is a useful search engine which allows searches to be carried out using key word, subject or author. This can be found at: http://www.scholar.google.com/
If you want to search using a particular phrase keeping the words in the same order, put them in double quotation marks, for example “constructivist informed practice”
Google Scholar will give you the references for the sources and in some cases where articles or conference proceedings etc. are freely available it will give you a link to the article. When you want to access a journal article that you have found via Google Scholar, write down or copy and paste the reference and then use the journal section of your University library catalogue to locate and download the article. It may be the case that the library does not subscribe to that journal, in which case if the article is particularly relevant you could consider ordering an inter library loan or alternatively there is the option to pay for it via the publisher website (but this could work out expensive and should only be used if you know the article is useful and there is no other way to access it).
Some benefits of using Google Scholar are that it gives you the following useful information in the form of links under each of the search results:
The Advanced Search facility of Google Scholar is also useful to help you narrow down your search. For example it is possible to enter the journals you want to search in Publication: Return articles published in... If you want to search all journals, but filter out other sources, just enter journal into this box.
Google Books is another search engine that will allow you to focus just on books in your search, however often most of these will also be found in a Google Scholar search. If you use Google Books, you may need to be more specific in your use of search terms.
If your search comes up with too many results and you find that a lot of these are not directly relevant to the focus of your enquiry, then the search parameters are too broad and need to be narrowed. This can be achieved by limiting the population or narrowing the focus. For example if the following search terms had been used:
behaviour management
The search could be made more specific by:
Also the NOT operator can be used to make the search more precise by screening out a particular subset of results if you are findings that a particular unwanted theme is appearing in the search results.
Alternatively you may find that your search is not coming up with any information. In this case you could try using different search facilities, or broaden your search by including new related search terms. The choice of search terms is usually the problem when a search does not yield many results and you need to try out alternatives.
In addition to using Google Scholar, you may consider accessing education databases. Some examples of useful education databases are:
BEI – the British Education Index is another free database that searches journal articles and papers, and provides a useful summary (www.leeds.ac.uk/bei)
BERTiE - a semantic search environment which is currently being developed by Bath Spa Institute for Education . This will enable researchers not only to find information quickly and effectively but also to find connections and links between data. (http://www.bathspa.ac.uk/bertie)
EBSCO, INGENTA, JSTOR and ERA – these are databases of journal articles which if you are working with a University you may be able to get access to through their subscription and are usually accessed via the library portal.
EDNA - Education Network Australia is also a free database, including a range of different types of sources (https://www.nla.gov.au/pathways/jnls/newsite/view/456.html)
ERIC – this is a free database developed by the US government, which searches journal articles and reports, also it provides useful summaries of the sources located (www.eric.ed.gov)
Zetoc - a comprehensive research database that can be used to set up email alerts when a new article is published containing particular keywords or published by certain authors. If your University subscribes to Zetoc it can be accessed using your Athens username and password and is located at: http://zetoc.mimas.ac.uk/
At an early stage in the development of your research question it is essential to explore the literature to find out what kind of research has already been carried out and to identify relevant theoretical perspectives. This early reading will help you to develop and refine the focus for your research and to frame your research question. Once this is established, your research question then needs to provide a focus to direct your reading.
It is necessary to be selective about what you choose to include in the literature review, and it is useful to think about how you will limit the scope of the literature you identify as you search. Points to consider to help you in limiting the scope of your literature are:
Also it is important to critically evaluate the literature to identify whether a source is of high quality. Below are some criteria to help you to evaluate the quality of a piece of research published in a journal, or a research study accessed online:
(Adapted from Walliman, 2009)
When you are searching the literature, it is important that you have established in your mind what you are looking for and this is achieved by having a clear focus for your research. An electronic search will identify a range of sources, some of which will be directly relevant to your work, and others which will be of limited or no use. To evaluate how useful a source is it is necessary to be able to read quickly, using for example the following techniques:
When you have found an article that is particularly useful (especially if it is quite recent), go through the reference list and use this to identify other sources that look interesting. In the case of academic books, when you have identified book titles from an electronic search to help you decide how useful a book may be, look through the contents first to find chapter headings that might be of interest and then speed read excerpts from a chapter. Another way to help you find relevant books is to make use of annotated bibliographies in books you have already used and found relevant to identify new sources.
Questions to help you identify themes in your literature review
The following questions are very useful to help you identify key themes that you might want to explore in your literature review:
(Adapted from Langdridge and Hagger-Johnson (2009); Bryman (2008); and Hart, cited in Punch, 2009)
The key to effective organisation of the literature is to identify emerging themes (see section ‘Constructing a literature map’) and then using these themes as the basis for organising the sources you have collected.
Organising sources electronically
Download electronic copies of journal articles and research reports and save these in labelled folders relating to the key areas identified in your literature map. Create Word documents for each of the key themes you generate and copy and paste in relevant excerpts from electronic sources into these. Ensure you include all the necessary reference information you need to be able to locate the source again quickly at a later date and in particular note the page number for excerpts that you may use as direct quotes.
Guidelines for managing files, references and emails:
https://www.data.cam.ac.uk/data-management-guide/organising-your-data
Organising paper copy sources
For journal articles and excerpts from books that are particularly relevant to your study, it is useful to print paper copies of these and to use colour coding to organise information. The basis of this is your literature map which you will have developed from your initial reading identifying the areas for discussion which will be explored in your literature review. Each of the areas on the literature map can be colour coded and this can then be used as a key for the colour coding you carry out as you read. Different colour marker pens can be used for this purpose. Also coloured post-it notes are useful to help you locate the information again quickly. Annotations can also be useful, where you write ideas for how you will use a particular highlighted section or indicating how you will make links to other points in your literature review or listing other sources that have interesting contributions on this theme. These annotations indicating the key points in a particular source are useful to facilitate identifying key themes which can then be organised into a map, which would then serve as a plan for the literature review.
The purpose of taking notes is to record the key ideas from sources, possibly also direct quotations that are of particular relevance. When taking notes it is very important to ensure full and accurate referencing. Notes can either be recorded in a paper based form, such as on index cards or else electronically. Electronic note taking is useful because it allows you to easily search your notes for key terms and also you can copy and paste your notes directly into your literature review.
A tabular format could be used to support note taking and engagement with journal articles. Download a Word document of this table here.
Reference of the journal article: (author(s), date of publication, title of article, journal, issue, page numbers)
Research focus of the article:
Sections of the article |
Details |
Your evaluation / ideas |
Research questions |
Are the questions clearly focussed? |
|
Research approach
|
Does the research approach fit with the questions being researched? |
|
Research methods |
Have appropriate methods been chosen to answer the research questions? |
|
Details of how the research was implemented:
|
Consider impact of the research design on credibility and applicability of the data. |
|
Key findings |
What insights does this research give you? How do the findings of this research relate to your experience / findings from other related research? |
|
Implications for practice |
What is the potential impact of this research:
How could the findings of this study be used in your setting? |
In order to develop the sections in your literature review you will need to be able to draw out the key themes from your reading. The following questions are designed to help you achieve this:
(Adapted from Langdridge and Hagger-Johnson (2009); Bryman (2008); and Hart, cited in Punch, 2009)
The research of Golden-Biddle and Locke (1997, cited in Bryman, 2008) identified that the most effective research articles ‘tell a story’ that engages the reader. Thomas (2009) explores the approach adopted by Jerome Bruner to structuring writing as a story as establishing the ‘trouble’ in a story. This concept of ‘trouble’ refers to identifying an interesting issue around which to build the discussion. This issue will then form the basis of the rationale for doing your research and your dissertation will focus on exploring the issue further. It is therefore important for you to write your research from the viewpoint of developing a story, and your writing should be structured with this aim in mind. Thomas (2009) identifies a principle identified by Bruner that the ‘trouble’ in the story needs to be established, in other words alternative viewpoints that need to be explored further. I have found this to be particularly significant and useful in my own writing. The excerpt below establishes the ‘trouble’ in a story about the role of a constructivist approach in supporting learning.
Make critical comments as you read and this will help you develop critical analysis. For paper copies these could take the form of post-it notes and for electronic documents you could use margin notes. Critical comments on a journal article could focus on:
(Adapted from O’Leary, 2010 and Punch, 2009)
It is important to have a plan of the areas to be discussed, using this to indicated how these will link together. In the overall structure of the literature review, there should be a logical flow of ideas and within each paragraph there should be a clear theme, around which related ideas are explored and developed. A literature map can be useful for this purpose as it enables you to create a visual representation of the themes and how they could relate to one another.
A literature map (Cresswell, 2011) is a two dimensional diagrammatic representation of information where links are made between concepts by drawing arrows (which could be annotated to define the nature of these links). Constructing a literature map helps you to:
Your map can then be used as a plan for your literature review.
As well has helping you to organise the literature for your review, a literature map can be used to help you analyse the information in a particular journal article, supporting the exploration of strengths and weaknesses of the methodology and the resultant findings and enabling you to explore how key themes and concepts in the article link together.
It is important to represent the different views and any conflicting research findings that exist in the literature (Newby, 2014). There is a danger of selective referencing, only including literature that supports your own beliefs and findings, disregarding alternative views. This should be avoided as it is based on the assumption that your views are the correct ones, and it is possible that you could miss key ideas and findings that could take your research in new and exciting directions.
Creating a literature map: UWE
Using a concept map to organise a literature review using VUE
https://www.youtube.com/watch?v=Lt9ht4pYP5c
VUE software download
Construct a literature map for the area of education that you are interested in researching.
Guidelines for helping you to construct a literature map:
Read the excerpt below from a journal article and identify the ‘trouble’ in this story i.e. establish what the key issue is and the alternative viewpoints:
Kirschner, Sweller, and Clark (2006) identified a range of terms that have been used synonymously with constructivist learning, namely discovery learning, problem-based learning, inquiry learning and experiential learning. At the opposite extreme is direct instruction, also termed didactic teaching, which involves transmission of ‘facts’ or overt instruction (Macleod and Golby 2003). Kirschner, Sweller, and Clark (2006) call into question the effectiveness of a constructivist approach for facilitating learning, citing research which shows higher levels of attainment gained where learning takes place within the context of direct instruction as opposed to a constructivist context. They propose that this apparent failure of constructivist approaches is a consequence of limited or complete lack of guidance associated with this approach. Each example of constructivist practice studied in Kirschner, Sweller, and Clark’s review was based on the assumption that a constructivist approach is inextricably linked to minimal guidance or complete absence of guidance. Similarly Mayer (2004) reviews evidence that clearly points to the ineffectiveness of what he terms ‘pure discovery learning’, however he concludes that a constructivist approach is still a valid approach for facilitating learning when it incorporates elements of guided discovery or direct instruction.
(Patterson, 2011: 70)
Analysis:
The key issue here is that researchers are calling into question the effectiveness of a constructivist approach in facilitating learning. However Mayer (2004) proposes that if inquiry is combined with guidance or instruction then the process of learning through within a constructivist framework becomes effective. The research carried out in response to this issue explored students’ perceptions of the impact of a constructivist approach in supporting their learning in science in the context of undergraduate initial teacher education.
The most commonly used system for referencing is the Harvard referencing system. The key features of this system are:
Jones (2009) states that…or put at the end of the sentence referring to their work, where the whole reference would be inserted in brackets.
If the author is put at the start of a sentence it is important to select carefully the word or phrase used so that it describe how the contribution of the author(s) fit in with the surrounding text in your writing. Some examples of words or phrases that could be used include:
states,
asserts,
proposes,
argues,
agrees with…,
challenges this view…
A common mistake that is made in an attempt to use a variety of words that demonstrate an academic style of writing is to select a word or phrase without considering how this contributes to the overall meaning.
Your University with have guidelines on exactly how to set out the Harvard referencing and often a useful guide is published by the library to help you with this. It is important to refer to your University’s guidelines as variations exist in the possible layout of Harvard referencing and if you find out how to set out your references and to get this right early in the project this will save you a lot of time later on. Bibliographic software such as endnote exists that can help you organise your references, however you need to think about whether the research project you are involved with (or your future plans for further study) will generate sufficient sources to merit learning to use the software.
When citing the literature there are four categories of citation:
Further reading
Guide to Harvard Referencing (University of Southampton)
http://library.soton.ac.uk/ld.php?content_id=4660789
Style of writing
It is important to write clearly and not to over complicate the ideas being presented. However the writing needs to adopt an academic style. The best way to develop this is to do lots of reading of a range of different academic work. A useful exercise when looking at developing your style of writing is to make a list of useful words and phrases that you could adopt in your writing, for example:
How to review of the literature critically
First it is necessary to establish what a critical review of the literature means in practice. Critical evaluation goes beyond summarising the key ideas from the literature, it also involves synthesis and analysis. The meaning of these concepts will be explored, as they are key concepts that underpin reflective and analytical writing, however how they can actually be implemented in practice is often not well understood by beginning researchers.
Synthesis
This process of synthesising ideas can take the form of:
In order for synthesis of ideas to be effective, it is necessary to make use of appropriate words to introduce ideas at the start of paragraphs and sentences and those that link the ideas together within sentences. For example in order to signpost that you are about to present ideas or findings that support one another, begin paragraphs or sentences with words or phrases like similarly, also or in addition.
Critical analysis
Critical analysis within your literature review could take the form of:
As in the case of synthesis, the choice of words to link ideas together is important for signpost critical analysis. For example words that could be used to start sentences or paragraphs include: Alternatively…; Alternative views are presented by…; However
Critical analysis of a particular research study could involve:
(adapted from Langdridge and Hagger-Johnson, 2009).
Useful questions to support critical evaluation of a research study:
Is the research focus clear and does the research answer the questions set out at the start of the article?
Has the analysis of the data been well developed?
Are the conclusion supported by the data presented?