There are countless videos online showing you how to use AI to write your literature review. All of them make it look easy, but all of the ones I’ve seen get fundamental things wrong. And the problem, as with a lot of bad advice, is that it will seem to work at first, but cause major, or even irreparable damage later.
The danger is that AI can help you produce something that looks like a literature review, on a topic you don’t understand. To the uninformed reader it might look impressive, but there won’t be any real insight into the topic. It will probably also contain serious mistakes that you might not notice if you don’t have the expertise.
As I’ve said before, anything you submit as your own work, you have to be able to defend. If you have a lazy examiner who doesn’t read your thesis you might be OK, but a good examiner will quite quickly figure out that you’ve used AI. They will find the parts where you don’t understand what you’ve submitted as your work, and they will, quite rightly, give you a very hard time. And if they discover that you didn’t write major sections of your own thesis, you will fail.
Can AI be used ethically and effectively? Yes, probably, but if you use it, don’t be dependent on it. You should treat it like an enthusiastic but slightly incompetent intern1, in that you can get it to do some work, but you need to check everything it’s done. And while it might make suggestions, never let it make decisions for you.
And if you don’t know enough about a topic to judge what AI is doing, you’ve got to fix that.
I started my PhD in 2003, which means I’m closer to the generation that searched the literature by going to the library2 and reading physical, printed copies of journals than I am to the current generation with all the AI tools. But despite the advances in technology over the last 21 years, the fundamentals have not changed; you still need a good knowledge and understanding of the literature to be able to write about it.
And isn’t that the point? Surely you want to develop your expertise. You want to know the literature and have some insight of your own, rather than following a chatGPT-generated template. And surely you want to develop your own skills, so you can write with confidence without being dependent on an AI platform.
So here’s how to write a literature review without using AI. It might be slower, especially in the beginning, but you’ll be much stronger for having done the heavy lifting yourself.
For now, I’m going to assume that you have some idea what you want to study, but if you want to know how to find, or rather develop, a research topic then leave a comment below and I’ll cover it in a separate video.
So I’m going to start with a fundamental rule, and that is to never write anything that you don’t understand yourself.
Some people will tell you to take each paper you read and write a summary paragraph, then edit all those paragraphs together, but this is a terrible idea. It’s a terrible idea because when you first start reading, you don’t know how an individual paper fits into the broader context and there might be concepts that you don’t yet understand. You also might not be able to tell if the paper is any good, because not all published papers are.
This is one of the many basic, basic things that the AI advocates fail to acknowledge: a lot of published papers are just bad. So even if you trust the AI platform, which you shouldn’t, you can’t always trust the literature that it’s summarizing.
And if you follow the standard advice of writing these summary paragraphs, or taking key points and then paraphrasing them, without understanding them, you’ll fill pages with content that looks like a literature review, but you will know that you don’t understand what you’re writing about. iAnd if you have any kind of impostor syndrome, this approach is just going to make it worse.
So we have to build some knowledge and understanding of the literature before we can write about it with any confidence. This means forgetting about writing, at least initially, and taking some time to just read.
I can’t give you an exact, step by step process here., because it will vary depending on your situation, your current level of knowledge, the state of your field and what you need to find out. If you want a process that you can just follow from start to finish without thinking or using your own judgement, it doesn’t exist (whether you use AI or not).
But there are general principles you can follow and adapt as your needs change over time. Generally speaking, there are different levels of knowledge you need to develop.
Let’s start with the broad picture: This is an understanding of the trends and debates and the kinds of problems people are working on. So we’re not too worried about the details of individual papers here, because initially we’re just getting a low-resolution picture of the field.
And you can usually do this fairly quickly. If you take a handful of recent papers on a specific topic and just read the introductions, you’ll probably notice that they all say similar things about the current state of the field. They will mention the same problems or ongoing debates, they’ll mention many of the same concepts, and they’ll refer to the same key papers.
For example, one of my projects involved looking at silicon nanoparticle luminescence. Basically getting silicon to give off light. Every single paper said the same thing in the introduction; that there had been a surprise result, others had reproduced it but nobody knew the underlying mechanism, and if we could figure it out then there was huge technological potential. There was a lot of heavy technical detail behind it and there were many different experiments and proposed theoretical explanations, but the basic story is easy to understand.
The key paper that everybody referenced was by Canham3, a name I still remember two decades later, even though I haven’t looked at the topic since. I don’t remember all the others, but I remember that one. This brings us to the next key point.
Not all the literature is of equal value. Most papers have very little impact on the field, but there will be a few that have a disproportionate impact, perhaps because they made some major discovery or invented a new technique or developed a new theory. These get cited far more than anything else.
If everybody else is referring to these people, you need to know who they are and what they did that was so important. And this brings us to the next rule.
Always go back to the original source and check what they actually did and said, because when somebody else summarizes a paper, unless they quote directly, there’s always a subtle change.
In some cases, the secondary source explains the concept better, but I’ve seen so many instances where they get it wrong and then other people have cited the secondary source.
So it’s always a good idea to go back to those key original sources and try to understand;
Although it’s important to take some time to try to understand these sources, you maybe don’t need to get too lost in the detail, because you can always come back to these sources multiple times throughout your PhD. And if you come back to a paper a few months or years later, after reading a lot more, after conducting some of your own research, you might have a very different understanding of it.
A quick side-note here: Years ago, I saw a professor on twitter saying that they “only ever read anything once”. I wish I had saved it because it was such a perfect example of the kind of misleading bullshit you see online, from people who really should know better. Any professor who says they only ever read anything once is either a genius, is lying, or is really bad at their job. You can and should come back to the most important sources and read them multiple times, because your perspective on them will change as your expertise grows.
As you build this initial picture of the field, the general trends and debates and the key influential figures, you will, inevitably, come across concepts, theories and techniques that you don’t understand. It’s worth taking some time to try to understand some of these.
You need to be selective and prioritize here to avoid getting overwhelmed. Part of this is accepting that you can’t know everything and there will always be gaps in your knowledge. This can be a little scary as you’ve probably come through an education system where you’re graded based on how much of the syllabus you know, but at PhD level we have to let go of that way of thinking because the amount of literature and knowledge is endless.
You’ll never know everything, but you can identify some key concepts that you need to understand for your project.
One of the most important aspects here, that’s often overlooked, is developing an understanding of common research and analytical techniques. This is crucial, not only for your own research, but to understand and assess the literature you read.
So many videos I’ve seen about literature reviews just take what the paper says without any critical thought. But you need be able to look at how they conducted their research and reached their conclusions…
It takes time to build this knowledge, so again it’s important to be selective, either based on the kind of research you want to do, or the most common techniques used in the field.
It might be worth finding good, authoritative sources on specific techniques. So if you’re doing IPA, for example, get a copy of the book by Smith, Flowers and Larkin. Again, you don’t need get lost in all the detail, but you can get an initial understanding of the basic principles, and then keep going back to that source whenever you need to.
Investing time in that kind of basic understanding will then make it possible to understand the papers that use them.
And then, finally, we have specific papers that are highly relevant to your own study. These might be papers that look at the same problem, but from a different perspective, or perhaps serve as a foundation for part of your research. There will probably be a relatively small number of these, but you’ll need to know them really well.
To recap, as a foundation, you need
And for all of these, you should build up a collection of key, high quality sources that you can go back to whenever you need.
The key word here is quality, because it’s not about the number of papers in your bibliography, but the standard of the sources you rely upon. If you understand even a handful of important papers, it’s far better than having extensive notes or summaries of hundreds of papers that you don’t understand.
With that strong foundation, you can start to look in more detail at the literature around specific issues of interest, depending on what you need at any given time.
The way you should approach this depends on what you’re trying to do. If need to do a systematic review, then maybe you need to follow PRISMA guidelines. But maybe you’re looking for a solution to a specific problem, or different methods that have been used to measure something, or for the latest, cutting edge results.
To find these, you might need to follow a more organic process, trying out different keyword searches or chasing up references in the bibliographies of papers, or just talking to people, because universities are full of people with useful expertise.
However you approach it, there will be dead ends and you will have to sort through a lot of papers that aren’t useful to you (or maybe aren’t useful to you right now), but that’s the nature of academic research.
You might be able to supplement this process using AI, but you cannot delegate the process to AI. You need the ability and the patience to search and filter the literature yourself. It is a fundamental skill that you must have. It’s slow and sometimes frustrating, especially at the start, but you’ll get better and better at filtering through the literature to find the best and most relevant sources as your knowledge grows.
In part 2 I’ll talk about how to turn your knowledge of the literature into a written literature review. But if you have any questions about this video please leave a comment below, because I have skipped over some points quite quickly, and if you’d like to know when I publish part 2, please subscribe to email updates so I can let you know directly when it’s available.
And if you’ve found this video useful, please take a moment to share it with somebody who needs it.
The best literature review the world has ever seen
This video on the same topic by Writer Science
PhD: an uncommon guide to research, writing & PhD life is your essential guide to the basic principles every PhD student needs to know.
Applicable to virtually any field of study, it covers everything from finding a research topic, getting to grips with the literature, planning and executing research and coping with the inevitable problems that arise, through to writing, submitting and successfully defending your thesis.
All the text on this site (and every word of every video script) is written by me, personally, because I enjoy writing. I enjoy the challenges of thinking deeply and finding the right words to express my ideas. I do not advocate for the use of AI in academic research and writing, except for very limited use cases.
See also: