The Keyword Research Guide

1. What keyword research actually is

Keyword research is the process of finding the words and phrases real people type into a search engine, then working out which of them are worth targeting with a page. That’s it. Everything else — volume, difficulty, intent, clustering — is just a way of answering two questions: is anyone searching for this? and can I realistically rank for it?

The reason it matters is simple. Search demand already exists; you’re not creating it, you’re discovering it. If you guess at topics instead of researching them, you’ll pour effort into pages nobody wants and miss the ones people are quietly searching for every day. Good research means every page you publish has a job.

2. Search intent — the thing that matters most

Before volume, before difficulty, before anything else: why is someone searching this? Get intent wrong and it doesn’t matter how clever your page is — Google won’t rank it, because it doesn’t match what searchers want. Intent falls into four broad buckets:

• Informational — they want to learn something (“how to do keyword research”, “what is a long-tail keyword”). They want an article, not a sales page.
• Navigational — they’re looking for a specific site or brand (“youtube login”, “keywordnumbers”). You rarely win these unless it’s your brand.
• Commercial investigation — they’re comparing before buying (“best free keyword tool”, “ahrefs vs semrush”). They want comparisons, reviews, pros and cons.
• Transactional — they’re ready to act (“buy keyword tool”, “keyword tool free trial”). They want a product or signup page.

The fastest way to read intent is to actually search the phrase and look at what already ranks. If page one is all listicles, Google has decided that’s an informational query — a product page won’t crack it. Our search intent analysis tool will classify any phrase for you and tell you what kind of page to build.

3. Head, body and long-tail keywords

Keywords sit on a spectrum from broad to specific, and where a phrase sits changes everything about how you should treat it.

Newcomers chase head terms because the volume looks exciting. That’s a trap. Head terms are dominated by huge, established sites, the intent is muddy, and the traffic — if you ever got it — would convert poorly. Long-tail keywords are where smaller sites win. Individually they’re small, but there are thousands of them, they’re far easier to rank for, and the intent is so specific that they convert brilliantly.

A good strategy stacks long-tail pages under a broader “pillar” page. Expand a seed idea into hundreds of specific variations with the keyword mixer or the AI keyword generator, then map each cluster to its own page.

4. How to find keywords — for free

You don’t need an expensive subscription to build a strong keyword list. Here are the free sources that professionals actually use, in the order we’d work through them:

1. 1Google autocomplete — start typing your topic and note every suggestion. These are real, popular queries ranked by demand.
2. 2“People also ask” and “related searches” — the boxes on the results page are a goldmine of adjacent phrases and questions.
3. 3Your own site search and analytics — what people already type into your site, and which queries already bring you impressions, are the warmest leads you have.
4. 4Competitors’ pages — the headings and subheadings on ranking pages reveal the sub-topics Google expects to see covered.
5. 5Question tools — our question finder surfaces the who/what/why/how phrasings around any topic in seconds.
6. 6AI expansion — the AI keyword generator brainstorms angles you’d never think of, which you then validate for real demand.

5. Reading search volume and difficulty

Search volume is the estimated number of times a phrase is searched per month. It tells you whether a topic is worth the effort. But treat every free (and paid) volume figure as a directional estimate, not gospel — no tool outside Google has the exact number, and even Google’s own figures are rounded and bucketed.

What matters is relative demand: is phrase A bigger than phrase B, and is it rising or fading? A keyword with modest but growing, laser-focused demand beats a bigger one that’s in decline or hopelessly competitive.

Keyword difficulty estimates how hard it is to rank on page one, based on how strong the current top results are. Use our keyword difficulty checker to score a phrase, then be honest about your own site’s strength. A new site should target the low-difficulty, high-intent long-tail and earn the right to compete for bigger terms later.

6. Clustering and mapping keywords

Once you have a list, resist the urge to make one page per keyword. Many phrases are the same search wearing different clothes — “how to do keyword research”, “keyword research tutorial” and “keyword research step by step” all want the same page. Grouping phrases that share intent into a single target is keyword clustering.

Clustering does two things: it stops you writing five thin pages that compete with each other, and it tells you how comprehensive each page needs to be. Run your list through the keyword clustering tool to group them automatically, then assign one page per cluster — this is your keyword map.

A keyword map is simply a list of your target pages, each with its primary phrase and the cluster of secondary phrases it should also cover. It becomes your content plan and your defence against accidentally targeting the same term twice.

7. Competitor gap analysis

Your competitors have already done expensive research — you can learn from it for free. Gap analysis means finding the keywords your rivals rank for that you don’t. Those gaps are proven, gettable topics: someone in your niche is already winning traffic from them.

Line up two or three genuine competitors, pull the terms they rank for, and subtract the ones you already cover. What’s left is your shortlist. The keyword gap analysis tool does exactly this comparison and scores each gap so you can prioritise.

8. Read the SERP before you commit

The search results page (SERP) is the answer key. Before you write anything, search your target phrase and study page one:

• Format — are the top results listicles, how-to guides, product pages, videos? Match the dominant format or don’t bother.
• Depth — how thorough are they? You need to be at least as complete, ideally more useful.
• SERP features — featured snippets, “people also ask”, image or video packs all change how much clickable space is left.
• Freshness — if every result is from this year, it’s a topic that rewards being current.

If a keyword’s results are all owned by household-name sites with hugely detailed pages, that’s Google telling you it’s not your fight yet. Spend that effort on a phrase where the current page one is beatable.

9. Questions, voice and AI search

Search is no longer just typed keywords. People ask full questions, speak to assistants, and increasingly get answers from AI overviews. That changes the phrases worth targeting.

• Question keywords win featured snippets and “people also ask” slots. Find them with the question finder.
• Voice search is conversational and local — longer, more natural phrasing. Our voice search keyword research tool surfaces these spoken-style queries.
• AI overviews pull from pages that answer clearly and concisely. Structured, direct answers near the top of your page are more likely to be cited.

The common thread: clear, specific, genuinely helpful answers. That’s what wins snippets, voice results and AI citations alike — and it’s exactly what long-tail research points you towards.

10. Seasonality and trends

Some demand is steady all year; some spikes hard and briefly. “Keyword research” is roughly flat; “gift ideas” explodes before the holidays and vanishes in January. Miss the timing and you publish your best page the week after everyone stopped searching.

Check the twelve-month trend for any phrase before you plan around it, and publish seasonal content weeks ahead so it’s indexed and ranking by the time demand peaks. A rising trend is worth more than a bigger but declining one — you’re investing in where demand is going, not where it’s been.

11. Common mistakes to avoid

• Chasing volume over intent. A big keyword you can’t rank for, or that doesn’t match your page, is worthless.
• One page per keyword. You’ll create thin, cannibalising pages. Cluster first — and check for overlaps with the keyword cannibalisation checker.
• Ignoring the SERP. Guessing the format instead of checking it is the number-one reason good content doesn’t rank.
• Targeting terms that are too hard. New sites should earn authority on the long-tail first.
• Researching once and never again. Demand shifts; revisit your map every few months.

12. A repeatable workflow

Put it all together and keyword research becomes a simple, repeatable loop:

1. 1Seed — list your core topics and expand them with autocomplete, questions and AI.
2. 2Validate — check volume, trend and difficulty; drop anything with no demand or no chance.
3. 3Read intent — classify each survivor and confirm the SERP format you’d need to match.
4. 4Cluster — group phrases that share intent into single targets.
5. 5Map — assign one page per cluster with a primary and secondary phrases.
6. 6Fill gaps — add proven keywords your competitors rank for and you don’t.
7. 7Publish and track — ship the pages, then watch rankings and impressions and refine.

Frequently asked questions