Students and researchers have an abundance of materials and sources available to them via the internet for use in their projects. However, there is little practical guidance available on the fundamentals of performing qualitative research with documents.
This valuable book enables readers to undertake high-quality, robust research using documents as data. Encouraging critical consideration of research design, the book guides readers step-by-step through the process of planning and undertaking a research project based on documentary analysis. It covers selecting a research topic and sample through to analysing and writing up the data.
The book includes:
• a wealth of case studies demonstrating how lessons can be applied in practice;
• summary boxes and suggestions for further reading in each chapter to guide learning;
• helpful online resources to facilitate designing your own research.
Accessible and comprehensive, this book will be invaluable for both students and researchers alike who are new to documentary analysis.
All the resources included in this book are available to download on the book’s webpage at https://policy.bristoluniversitypress.co.uk/doing-your-research-project-with-documents/online-resources. Look for the Online Resources logo throughout the book.
This article presents empirical findings from part of a larger study on welfare reform conducted between 2007 and 2009. Semi-structured in-depth interviews occurred with eight Incapacity Benefit personal advisers, and Work Focused Interviews conducted by advisers with Incapacity Benefit claimants were observed. Two areas of advisers’ experience will be discussed. First, how advisers were subjected to the need to comply with directives, and how their performance was monitored via targets. Second, the article will examine advisers’ attitudes and behaviours towards sanctions, which were primarily used against those who did not attend compulsory Work Focused Interviews (DWP, 2002).
This book is designed to support students who are undertaking dissertation projects which use documents as data, and researchers who are new to documentary analysis. If you are a second- or third-year undergraduate, this book is likely to give you a solid enough grounding in documentary analysis to get you through all stages of your research project. Of course, you are likely to benefit from the use of some additional book chapters or journal articles recommended in each of the chapters of this book, and discipline-specific texts as advised by your supervisor. If you are a master’s or doctoral student or a researcher who is new to documentary analysis, I would say that this book is a good starting point. A decent skim of this book will give you a solid knowledge base, and you should then supplement your reading with reference to other core documentary analysis texts, which will be signposted for advanced readers at the end of each chapter.
In this book, each chapter will take you through the process of doing one part of your research project and will guide you to write notes that will contribute to your dissertation or report. The book is structured chronologically in three parts. First, Getting going describes being clear on your research approach, planning your time, maintaining good supervisory relationships, and good scholarship in the form of ethical research and reflexivity. These lessons are valuable to you throughout your project. Second, Making decisions describes the process of searching for literature, documents and a methodology (analysis strategy and theory) and how to combine these into a research question.
The time available to develop dissertations and other research projects is almost always less than ideal. Thinking has to be done quickly, and dead ends may be encountered before finding suitable data. For this reason, it may be inconvenient to consider the ethical issues in using data that are available to be collected. However, we really must make time for this, not only because of the importance of ethics themselves but also because your examiners will be assessing your research design and conduct based on this.
Research with pre-existing documents is often seen as ethically uncomplicated. If the documents are in the public domain, it can be argued, they are ‘fair game’ for researchers. Similarly, if documents are in an archive, the fact that the researcher can access them may lead to a sense of security in relation to ethics. However, this is false. We now have robust rules and ethical procedures for undertaking observations in public spaces. This is a far cry from invasive observations of the past, such as Humphreys’ (1970) Tearoom Trade, where the PhD student purposely observed gay sexual encounters in public toilets, at a time when homosexuality was illegal. The unethical acts further included keeping car registration numbers, which could have incriminated the men who were unknowingly under study. These days, that sort of study would not get through ethical review. However, if a similar study looked at, for example, an online community associated with illegal but consensual sexual acts (such as sadomasochistic sex in England and Wales, at the time of writing) and the data they mined contained IP addresses, a similar ethical breach will have occurred.
We all have ideas about what our research paradigm is, but we don’t always put this into words, and we can be in danger of assuming that what we think is the correct way of doing things is the only way. This is where disciplinary backgrounds, such as sociology, psychology, medicine and geography, are important. In addition to this, you may have heard words that sometimes terrify students (and even experienced researchers), such as epistemology and ontology. These terms refer to how we understand the construction of knowledge and how it is interpreted in research. Those ideas may seem abstract if you haven’t studied any social theory, and you may want to skip ahead to a chapter that feels less painful, but try not to be concerned. This chapter aims to give you enough information to have relevant conversations with your supervisor, if applicable, or to help you discount approaches that you feel don’t suit you, so that the amount you need to read from other sources is smaller.
When we think about research paradigms, what we are really thinking about is the nature of the research approach, which is a combination of ontology and epistemology. In Box 2.1, traditional approaches to research paradigms are described through three layers: ontology, epistemology and research design. If these approaches do not feel suited to you, Helen Kara (2017) provides a more complete, but still highly accessible, exploration of ‘methodologies, approaches and theories’, including ‘transformative methodologies’ (p 46), such as feminist, participatory and decolonising methodologies.
While it is likely most dissertation students will have heard of ethics and ethical review, some of you will be unfamiliar with the terms positionality and reflexivity. I imagine that few readers will feel fully confident to consider their position in the research process and document it for their dissertation. Increasingly, assessments of reflexivity are a standard part of the methods chapter of social science dissertations, and they are sometimes expected in the strengths and limitations section of the discussion chapter.
When I was first introduced to these concepts, I believed that they were much more complicated – and frightening – than they really are. To be reflexive, to be aware of your demographics and the privileges they bring, spend time considering your views and experiences in relation to the topic of your research, and do this throughout the research process. Within this chapter, I will introduce you to tools to help you consider your own positionality. Undertaking research on sensitive topics or becoming more aware of social injustice can be emotionally demanding. For this reason, at the end of the chapter you will find self-care strategies that you can apply to yourself, but also to friends and peers.
Over the past 30 years, there has been increasing recognition that researchers should be reflexive. What this means in practice is that researchers should be aware of, and declare, their epistemology and ontology: that is, the basis on which they draw their understanding of the world. This includes the research paradigm (e.g. interpretivist vs. positivist) that you subscribe to, and any theory that you are using to frame your research.
One area where many dissertation students feel ‘stuck’ is undertaking a review of relevant literature. It is not that the students are not clever, or that they lack the skills: it is that they are worried about not getting it right. Fears include missing out a single highly influential source, which would lead to embarrassment and potentially invalidate the entire project, or missing out a body of work in a related discipline. In this chapter, I hope to convey that these fears are rarely well-founded. In academia at large, there is now so much literature that it is not possible for even eminent scholars to engage in detail with all of it; therefore, we certainly would not expect undergraduate or master’s students to achieve this impossible feat. Furthermore, often students will have the opportunity to have their planned literature informally assessed by their supervisor through discussions in supervision and reviewing a draft of the literature review chapter, usually at a relatively early stage. This means that any omissions that need to be addressed can be identified before the work is formally assessed. If you feel unsure or worried about what to include in your literature review, Box 7.1 provides a guide to the purpose of literature review chapters, which you can return to and ask yourself whether you are responding to this requirement. You may choose to use it in line with Resource 7.3 at the end of the chapter.
I’m going to say that again: research questions are really, really important. You can think of your research question as the ball in any ball-game: without it you have lots of skilled people and a pitch, but no way to play or win the game. Let’s think about this in relation to the chapters of your dissertation (Box 10.1). As always, please do write notes in your research diary as you read through this chapter – those little flashes of inspiration are really important, especially when writing your research question, which needs to be small but mighty.
Box 10.1: Does your research question fit with the content in your dissertation chapters?
Consider your draft research question in relation to its fit with each of your chapters:
1.Introduction: why your research question is important.
2.Literature review: should point to your research question as almost like an arrow highlighting a group of interesting phenomena being brought together (or a funnel: see Chapter 7 for a refresher) to which the only logical conclusion is your research question.
3.Methods: your population, sample (including size) and analysis methods are clearly designed to enable the research question to be answered. The research question should fit the methods exactly.
4.Results: describe your findings in a way that explicitly shows your new contribution to knowledge in relation to the research question.
5.Discussion: compares the literature in your literature review chapter, which led you to the research question in the first place, and provides a space to identify similarities and differences between your findings and the literature.
6.Conclusion: disentangles the importance of the topic area, the methods, research question and new findings to say, with confidence, that your research question and research were important.
My plan for this section is to help you get words on paper (or screen); editing comes later. This is often the most difficult part for students, who can find a lot of innovative ways to procrastinate! They have enthusiasm when it comes to collecting data and can excitedly tell me what they have found during their analysis. If you feel like this, all the information that needs to be written down is already in your head. I hope this is a relief, although I imagine some of you are thinking ‘but you really don’t know how bad I am at writing’. Like many things in life, writing is a skill that improves with time; you are not expected to be experts at writing at your career stage. So, it is important to do something about getting words on the page. I like the approach of having to stay at my desk for a certain amount of time writing something; even if that something is that I don’t know anything about a topic. That just means that when I come back to review my notes, I know that I need to do some reading. In Box 13.1, I include my top tips for getting words on the page quickly.
Box 13.1: How to quickly get words on the page – Aimee’s approach
Wear comfortable clothes.
Go to the toilet, get a drink, eat a snack if you are hungry (but do not procrastinate cooking elaborate food).
Put your phone on silent and tell anybody at home not to disturb you unless it’s very important.