What Keyword Research Is Actually For
Keyword research is not about finding words to stuff into your content. It is about understanding the specific questions, problems, and desires your ideal customers express through search — and then creating content that serves those needs better than your competitors do. Traffic from keywords that attract people who will never become customers is worthless. Traffic from keywords that attract people in the process of evaluating exactly what you sell is invaluable.
This distinction — business value versus raw search volume — is the most important concept in keyword strategy, and the one most commonly ignored by people focused on chasing the biggest search volume numbers. The keyword "what is SEO" gets enormous search volume. Almost none of those searchers are about to hire an SEO consultant. The keyword "hire SEO expert India" gets a fraction of that volume, but every single searcher is a potential client. The right strategy builds content for both — but it knows the difference and allocates effort accordingly.
Understanding Search Intent
Search intent describes the underlying goal behind a search query. Google's entire ranking system is built on matching content to intent — serving a page that satisfies what the searcher actually wanted, not just a page that contains the searched words. Understanding intent is therefore understanding what Google will reward.
Informational intent: The searcher wants to learn something. "How does SEO work," "what is a backlink," "why is my website not ranking." The appropriate content format is educational — guides, explainers, tutorials, FAQs. Commercial intent is low (these people are early in the awareness phase), but informational content builds authority and creates awareness among future buyers.
Commercial investigation intent: The searcher is evaluating options before making a decision. "Best SEO tools 2025," "Semrush vs Ahrefs," "SEO agency reviews India." Content for this intent should be genuinely evaluative and helpful — comparison articles, reviews, roundups. This is where you capture people close to a decision but still comparing options.
Transactional intent: The searcher is ready to take action. "Hire SEO expert," "buy Semrush," "book SEO consultation." Content for transactional intent should be your service pages and landing pages — clear value propositions, social proof, and conversion optimisation. These keywords tend to have the highest conversion rates and the highest competition.
Navigational intent: The searcher is looking for a specific website or page. "Mani Pathak SEO," "manipathak.com." Navigational searches are almost always brand-specific and require simply ensuring your website appears prominently for your own brand terms — which good technical SEO and Google Business Profile setup handles.
The critical application of intent analysis is ensuring your content matches the intent behind its target keyword. A transactional service page attempting to rank for an informational keyword is misaligned — Google will not trust a sales page to be the best educational resource. Build the right content type for each intent, and map them strategically across your site.
Building Your Seed Keyword List
Seed keywords are the core terms that describe your business, services, or content topics — the starting point from which you expand into a full keyword universe. Building a strong seed list requires thinking about your business from multiple angles simultaneously.
Start with the obvious: what are the primary services or products you offer? What problems do you solve? What categories does your business operate in? For an SEO consultant, seeds might include "SEO," "search engine optimisation," "keyword research," "link building," "technical SEO," and "local SEO."
Then expand from the customer's perspective: how do your customers describe their problems and needs when they are not using your industry vocabulary? Clients rarely search for "technical SEO audit" — they search for "why is my website not ranking" or "my website doesn't appear in Google." These problem-focused keywords are often less competitive and more commercially valuable than their technical equivalents.
Tools to expand your seed list: Semrush Keyword Magic Tool (start with a broad seed and drill into subcategories), Ahrefs Keywords Explorer (excellent for related keyword suggestions), Google's own autocomplete and People Also Ask (shows exactly how real users phrase queries), Google Search Console (shows what your site already ranks for — a goldmine of seed ideas), and your competitors' top-ranking pages (what are they ranking for that you are not?).
Competitive Keyword Gap Analysis
One of the fastest ways to build a valuable keyword list is identifying keywords your competitors rank for that you do not. These are keywords the market has already validated as worth ranking for, in your space, with an established traffic pattern — and a specific competitive target already winning them.
Both Semrush and Ahrefs have dedicated keyword gap tools. Enter your domain and up to four competitor domains, and the tool will show all keywords where competitors rank but you do not — sortable by search volume, keyword difficulty, and competitor ranking position. This report frequently surfaces dozens of relevant, achievable keyword targets that might not have been on your radar.
The most valuable gap opportunities are keywords where multiple competitors rank in the top 10, your domain does not rank at all, and the search volume and intent alignment with your business are both strong. A competitor appearing at Position 3 means there is demonstrable demand for this content; your absence means your site is not capturing it; and multiple competitors ranking means it is not an anomaly but a consistent SERP.
Topic Cluster Mapping
Individual keyword targeting is a 2010 strategy. In 2025, the approach that consistently wins is topic cluster architecture — organising your content around broad subject areas (pillars) supported by comprehensive coverage of related subtopics (clusters).
A topic cluster for an SEO consultant might look like this: a pillar page on "SEO Services" providing comprehensive coverage of what SEO involves, supported by cluster pages covering "Technical SEO," "Content SEO," "Link Building," "Local SEO," "SEO Audit," and "AI SEO." Each cluster page goes deep on its specific topic. Each links back to the pillar. The pillar links to all clusters. The result is a content architecture that signals comprehensive topical authority to Google across the entire subject area.
When building clusters, the goal is coverage — making sure there is no commonly searched question within your topic area that your site does not address. Use People Also Ask, related searches, and answer tools to map all the questions within each topic cluster. Build content to answer each one. Over time, this systematic coverage is what builds the topical authority that allows you to rank for increasingly competitive terms.
Prioritisation: What to Target First
After building a comprehensive keyword list, you will have more targets than you can pursue simultaneously. Intelligent prioritisation is what separates efficient keyword strategies from chaotic ones. I use a scoring framework that considers four factors.
Business value: How directly does a searcher using this keyword represent a potential customer? High business value keywords (transactional and commercial intent, strong product-service alignment) are worth pursuing even at lower search volumes. Low business value keywords (informational with low conversion probability) need high volumes to justify content investment.
Search volume: Monthly search volume is the commonly used metric, but it needs context. A keyword with 50 monthly searches and high business value from buyers with budgets of ₹1–5 lakhs per month is worth more than a keyword with 5,000 monthly searches from early-stage researchers. Do not chase volume divorced from business value.
Keyword difficulty and your domain's competitive position: A new domain targeting high-difficulty keywords it has no realistic chance of ranking for is wasting content investment. Honest competitive assessment — comparing your domain's authority and content depth to what is currently ranking — should guide which difficulty tiers are achievable in your current 6–12 month window.
Current ranking position: Keywords where your domain already ranks on pages 2–3 are typically the highest-ROI optimisation targets. The gap from position 11–20 to positions 1–10 often requires less work than building a ranking from scratch, and the traffic difference between page 2 and page 1 is enormous. Always start by optimising pages close to the first page before creating entirely new content.
Best Keyword Research Tools 2025
Semrush Keyword Magic Tool: The largest keyword database available and my primary research tool. Excellent for bulk keyword research, intent filtering, and the AI-powered topic cluster suggestions added in recent updates. Essential for any serious SEO operation.
Ahrefs Keywords Explorer: Best-in-class keyword data quality and the strongest Parent Topic feature — which identifies the main keyword for a cluster, preventing you from creating multiple pages competing against each other for the same intent. The traffic potential metric (total traffic of top-ranking page across all its keywords) is more useful than raw search volume for estimating real ranking opportunity.
Google Search Console: Free and essential. Shows exactly what searches are already driving impressions and clicks to your site, including keywords you rank for but may not be aware of. The Queries report sorted by impressions identifies keywords where you are visible but not ranking high enough to generate clicks — prime optimisation targets.
Google Keyword Planner: Free via Google Ads. Not the most granular data, but useful for getting Google's own search volume estimates for terms you are considering. Worth cross-referencing against paid tool data for important target keywords.
Answer the Public / AlsoAsked: Question-focused keyword tools that map the question landscape around any topic. Invaluable for building FAQ content, identifying blog post topics, and ensuring comprehensive topic coverage across your content strategy.
The Most Costly Keyword Research Mistakes
Targeting keywords too competitive for your domain: Choosing keywords based solely on search volume without accounting for your domain's current authority relative to the competition is the most common reason keyword strategies fail. If the top 10 results for a keyword are all high-authority, high-DA domains with 10+ years of backlink history, a new domain targeting that keyword is not going to rank regardless of how good the content is. Target difficulty tiers appropriate to your current competitive position and build up.
Ignoring search intent in content format: Ranking a service page for an informational keyword, or a blog post for a transactional keyword, violates search intent and results in poor rankings or high bounce rates even when rankings are achieved. Match content format to intent, always.
Keyword cannibalisation: Creating multiple pages targeting the same or very similar keywords splits your site's authority signals across competing pages rather than concentrating them on one strong page. Use Ahrefs' Parent Topic feature and Semrush's keyword position tracking to identify cannibalisation issues and consolidate where needed.
Treating keyword research as a one-time activity: Search trends evolve, new topics emerge, and competitive landscapes shift. Keyword strategy should be reviewed quarterly at minimum — updating for new opportunities surfaced in Search Console, adjusting for competitive changes identified in Ahrefs and Semrush, and responding to shifts in your industry's search landscape.
Keyword research done well is the most valuable input into your entire SEO strategy. Get it right and every subsequent activity — content production, technical optimisation, link building — is directed at targets worth winning. If you want help building a keyword strategy specific to your business and competitive environment, book a free strategy consultation or take a look at my done-for-you SEO service.
Mani Pathak has built keyword strategies for 500+ businesses across industries. He writes about SEO, AI tools, and digital marketing at manipathak.com.