My guess is that you are on a mission. And the goal of that mission is: To find the best keyword research tool on the market.
First of all: Congratulations!
You recognized the immense potential to generate traffic through a thorough keyword research.
We at SEOintheSUN have been using at least 5 different keyword research tools in the last 7 years but we were always unsure about our choice.
Now in 2018, there are more tools than ever on the market. So we started a new journey trying to figure out which is the right fit for ourselves and our clients.
First, we thought how to do this. Then we took a pragmatic approach: Test them all! And we let them compete against each other and compiled the results in an academic research.
We had many questions and those were our disciplines right there:
- Keyword Suggestions: How many does each tool give us?
- Search Volume: Which tool gives us the highest total amount?
- Relevance: Are the suggestions relevant to the search intent?
- Uniqueness: Did the keywords pop up in several tools or just one?
- Data Sources: Where does keyword data come from and how credible is it?
- Reports and Settings: What are our options in each tool?
- Time: How long does the keyword research process take?
On top, we had two major criteria when looking into each tool. They don’t affect everybody but are interesting for those of you who need to attract international clients.
1) “Can the tool show us aggregated numbers on a global level across all territories and languages?”
Why do we care? Because we get visitors from around the world. Many search in English and we want to target all of them with one single blog post.
2) “How does the tool perform in other countries and languages in general.”
We care because we don’t just operate in one country and need to know what people are searching for in many languages. Especially in our three main ones: English, German and Spanish.
They are also the main pillars of this study as we translated our seed keyword “learn german” into German (“deutsch lernen”) and Spanish (“aprender aleman”).
Actually, SEOintheSUN is a digital marketing school and agency and part of the FU International Academy, a company based in Tenerife (Spain) with a couple of different offers for international clients.
Our global mindset made us take a look at the tools from such an international perspective. But after long hours of research, we still had too many questions unanswered. The content out there just didn’t fully fit our situation.
So we decided to do our own investigation of the topic. What you’re reading right now is the result.
We tell you all about the process we went through to decide which is the best keyword research tool for ourselves. And how to create the right service packages for the different needs of our clients.
Along the way, you’ll get some interesting insights into the tools and their data sources. But for now, let’s get the ball rolling and find you your personal best keyword research tool!
Outline and TL-DR
This post includes affiliate links to tools and products we use and love. If you buy something through those links, we might get some extra coffee money (at no extra cost for you!) which helps us create more awesome posts like this!
By the way.
We know that you’re all busy people and have no time (or interest) to digest an 11,000+ words study for breakfast. Still, we thought it makes sense to give you the full picture with the option to read it all. Or to skip it all. Whatever it takes to find your best keyword research tool.
If you want the get the gist of the matter at once skip to our Too Long – Didn’t Read part. It summarises everything in a 1,800 words conclusion.
Then again, if you’re in it for the long haul, take a look at the rest of our outline. You might notice that we took the good ol’ academic approach.
Don’t worry, you can rest assured that we won’t bore you with any more academic slang. You don’t care about the literature review? No problem, skip to the results or any section you’re interested in most.
In any way, one of our main goals here is to be transparent about our decision-making. Because let’s face it: We’re not almighty and always want to improve our processes. But to do so, we first have to show you how we work.
Along the way, you’ll understand how we designed our SEOintheSUN keyword research services. Or we might also help you to cut through the clutter and choose the right tool for yourself.
Still on board? Great.
If you want, take a brief look at the terms in our glossary, buckle up and let’s do this! Figure out your best keyword research tool!
Glossary: Terms and Metrics
To make your life easier, we put together a little glossary.
Here you find all the terms and abbreviations that you’ll encounter later on.
SV – Search Volume
The number of monthly searches for a certain keyword averaged over the past 12 months.
KW – Keyword
What this study is all about. We are looking for keywords to see which terms people put into Google. The trick is to understand what they actually intend to find with those terms.
SKW – Seed Keyword
The main keyword that you put into a tool to generate further ideas or keyword suggestions. Our seed keywords in this study are rather broad with: “learn german”, “deutsch lernen” and “aprender aleman”.
SERPs – Search Engine Results Pages
The results pages that show up in response to a Google search with a specific keyword. The first SERP includes the pages on the top 10 positions.
TKR – Traditional Keyword Research
A keyword research process that generates new keyword suggestions based on a seed keyword. Suggestions can come from different data sources as e.g. the Google AdWords API.
CKR – Competitive Keyword Research
A keyword research process that generates new keyword suggestions based on the keywords that competitor sites already rank for. Keywords are scraped from the SERP top 10 sites for a specific seed keyword.
API – Application Programming Interface
It basically serves as the intersection of two different software programs and helps them to interact. For example: Some keyword tools interact with Google to source their data.
Google AdWords API
An API that keyword tools can get in order to access Google Keyword Planner data.
It’s a Pay Per Click advertising service by Google and its main revenue source. It lets you display ads on top of the organic search results.
The ad price is determined via a bidding process.
It’s basically the opposite of paid advertising via Google AdWords.
You optimize your content in order to rank naturally in the Top SERP positions.
PPC – Pay Per Click
A payment model for online advertising services. The marketer only pays for successful ads. In essence, those that visitors clicked on to get to the landing page.
Close variants of a keyword usually have the same search intention but expressed with slightly different terms, e.g. SEO vs. Search Engine Optimisation.
The Google Keyword Planner combines or “groups” the search volumes of close variants in their metrics.
This way it’s impossible to break down how much search volume comes from which exact term. That’s hassle in content marketing when choosing the focus keyword.
It is usually used in the context of keyword metrics. This means for example that search volumes are not combined for close variants but only shown for the exactly the term that was entered into Google.
Paid keyword research tools like KWFinder disentangle this and show exact match data.
Clickstream data basically is all about which websites people visit on the internet and where they click. Tools like Ahrefs and Moz are using it in their models to predict keyword search volume data.
Total KWs – Total Keywords
The number of keywords that are exported from each tool. It’s the direct output without any filters.
RKWs – Repeated Keywords
Keyword suggestions that several tools provide, i.e. those that show up in more than one tool.
UKWs – Unique Keywords
Keywords that are uniquely found in a certain tool, i.e. keywords that only this one tool shows.
Rel. UKWs – Relevant Unique Keywords
Keywords that were left after we filtered the unique keywords for their relevance, i.e. if they actually fit the search intent of the seed keyword “learn german”.
KWs SV < 10 – Keywords with Search Volume below 10
The keywords that have a search volume below 10 in their tool. This metric includes many keywords with no search volume or no available data.
KWs with SKW – Keywords with Seed Keyword Phrase
Keywords that contain the seed keyword phrase. This metric shows if the tools simply add more phrases around the seed keyword or if they find alternative suggestions.
The latter may have the same search intent even if the seed keyword is not included.
Standardised Search Volumes
Each tool provided us with different search volume numbers. To assess the quality of each tool’s suggestions, we imported them to KWFinder and compared this standardized data.
USP – Unique Selling Point
It is the feature or characteristic of a product/service that makes it unique and sets it apart from all competitors. We defined the relevant unique keywords as USP of keyword research tools.
Okay, on to the next part – the literature review.
What does a literature review usually contain? It tells you what’s out there and which analyses other researchers did in the past.
To be honest, good and transparent studies in the SEO field seem to be a rarity. Only the big players appear to have the resources to invest the necessary time and effort. On top, they certainly won’t release everything they’ve got.
And why would they?
Let’s face it: In the end, all keyword research tools are selling a similar software. Why should they reveal valuable insights that they can use to outpace their competitors?
So all that’s left to do for us is to say:
Our Dream of a Knowledge Base in SEO
The competition between keyword research tools makes it hard to build a lasting knowledge base as e.g. in academia.
But there are even more obstacles in the way.
Which? Well think about this: As soon as marketers get close to getting a grasp of Google’s algorithm, a shiny new update changes the game.
Ergo: Some previous studies may become irrelevant faster than you think. But they still will linger around the web (it is content after all…) and that makes it hard to be confident about their accuracy.
Another thing to consider:
It might even go against the interests of some SEO providers to be transparent. Publically learning from your mistakes entails admitting them first. So our impression is that SEO studies are often a beauty contest of success stories at best.
Take a look at some of SEMrush’s case studies and you’ll see what we are talking about. Sure, they’re all interesting to read but also often built according to the same schema:
“See how we managed to increase [insert desired KPI] by XY % in XY time!”
Because in the end, even the best keyword research tool needs to keep the marketing engine going. This guest post in the Ahrefs blog sums up the dilemma quite well.
Up next, we tried to gather the ‘State of the Art’ of other interesting articles in keyword research. One major issue here is lacking transparency.
It’s quite hard to find out, how the different tools actually come up with the numbers that they throw at you. We gave it our best shot in the section on the Data Sources of Different Tools. Finally, we’ll introduce you to our Lineup of Competitors and their basic info.
Previous Studies about Keyword Research
There’ve been different kinds of research done in the SEO field so far.
On a macro level, you have the heavyweights like Moz and Ahrefs or SEMrush. They even conduct statistical correlation studies to figure out the most important ranking factors in Google. Or this case study here from the team of Moz which actually shows you well how SEO should be done in 2018.
But since we don’t want to overload you with information, we’ll stick to what our study is all about. Keyword research.
Of course, we didn’t reinvent the wheel here.
We’re not the first ones who thought about comparing the options to find the best keyword research tool. Have a look at some examples of what’s out there on the topic so far.
Firstly, their well-organized overview of SEO Tools was a great starting point. Especially when we tested different free keyword research options.
Beyond that, they even published a guide to keyword research. It includes a review of four of the tools that we also feature: SEMrush, SECockpit, Moz and Ahrefs. It’s a nice comparison to get an overview of their basic functionalities.
SEMrush also took a closer look at some of the tools in our comparison – of course including their own. Fair enough but what’s again missing is a quantitative analysis. What keywords do these tools actually cough up? Are they relevant to your niche?
Check out Authority Hacker by all means.
They did a great job at explaining all the features that keyword research tools offer. Including five of those in our comparison. So if you want to see what exact functions await you in the tools, read through their extensive reviews.
Following Authority Hacker, we also split our analysis in traditional keyword research and competitive keyword research.
“When should you take which keyword research approach?”
The traditional approach only gives you suggestions based on your seed keyword. Ideally, you’re looking for a keyword with solid search volume which is still not targeted by your competition.
This approach is in so far risky as you have no guarantee that those keywords work. But it certainly is the right pick for you if you’re a market pioneer and need to stay ahead of the competition. Or are you a casual/low-frequency blogger? Then it might not make sense to invest money into a competitive keyword research tool.
The competitive approach has the advantage that you spy on the keywords which work for your closest competitors! Based on your seed keyword, the tools check the first results page of Google and its top 10 domains. Then they scrape all the keywords that those domains are ranking for in addition to your seed keyword.
Do you have the same content quality and domain authority (or even better)? Then that’s a solid sign that you should be able to target and rank for those keywords as well.
Finding our perfect combination of keyword research tools. This blog post goes into that direction. It recounts how SEO practitioners actually are using the tools available at their agency.
The main takeaway: There is not THE one best tool. The safest bet is to combine suggestions found in different tools.
Having read these articles, we were still pondering. Which tool should we use for our services on a long-term basis?
Trying to make a choice, it hit us. A mere list of functions and screenshots won’t help us to decide that.
We were still missing something…
DATA and STATS to back our decision!
And that’s what we try to deliver ourselves right here, right now.
So we dove headfirst into the pool of keywords that the tools spit out and tried to tame them with Excel and Google Spreadsheets.
Now. When we speak about data of different keyword research tools, it gets tricky. Looking at keyword metrics, you probably already asked yourself at one point:
Data Sources of Keyword Research Tools
First things first.
Before we go any further, it’s time to level the playing field.
We need to clarify some basic distinctions in how and where each tool gets its data. Seriously, for us, the data sources were also the main source of confusion.
All right. Aiming to clear this up, we navigated through the world wide web for information and wrote to all of the companies.
To the best of our knowledge and research skills, there are two main groups of keyword research tools:
To get the difference, you need to be aware of the latest developments with Google Keyword Planner.
To put it in a nutshell:
Once upon a time in a land far far away, the Google Keyword Planner was the best option to source search volume data. This made the life of SEOs extremely easy. But that’s already where the fairy tale ends.
Because Google decided to turn the tables on all of us. They tied the access to this data to the amount of money spent on paid advertising in AdWords. Makes sense for Google but sucks for SEOs.
If you have no paid campaigns running, you’ll see only broad data ranges. In essence, they have little value for your keyword selection process.
Let’s face it: After all, it makes a difference if your target keyword has 11,000 or 99,000 searches!
But that’s the only range that Google will show you.
As a matter of fact, that’s why we don’t use Google Keyword Planner and didn’t include it in our comparison. We simply wanted to spend our time and energy on finding its best alternative!
Now. Some tools (KWFinder, SECockpit, KeywordsEverywhere) still have access to the specific search volumes via the Google AdWords API. Yet, that comes with A LOT of requirements that the tools must follow. Take a look for yourself here.
Some users of this API say that this forces tools to be geared more towards Pay Per Click instead of organic SEO.
That of course – again – especially entails one thing: More business and money for Google.
And even if tools put all the requirements in place, they are still at the mercy of Google. If they change the rules of the game, there’s nothing much you can do.
Fancy an example?
There are many Dirty Secrets of Google Keyword Planner. But why do we even care about numbers the Keyword Planner shows if we don’t even use it in the comparison?
Remember that its AdWords API is the principal data source for tools like KWFinder. So you should understand that it could also source potential problems along with it!
Especially one gave us headaches. The grouped search volume of similar keywords (or ‘close variants’).
Grouped search volumes mean for you: More noise in the numbers. You’ll, for example, see two similar keywords like “SEO” & “Search Engine Optimization” with the same search volume (100 K – 1 M). That’s not just a coincidence!
Chances are that Keyword Planner merged their search volumes. In essence, it shows the total volume sum of both keywords plus any other ‘close variants’. But you’re lacking information on which keywords are included in this data range and what their precise volume is.
Confusing? Yep! Intransparent? Exactly.
That’s the case because the Google AdWords search volumes are for Pay Per Click marketers. When they bid on keywords, their ads will also show for all close variants. So it makes sense that they see the merged search volumes when setting up campaigns.
In SEO however, each close variant keyword will show different SERPs. Thus it would be useful to have the ‘exact match’ search volumes for each term.
Lucky us. Why? Because KWFinder provides this exact data. This way, we were able to check the quality of the suggestions from different tools. We simply ran them through KWFinder to standardize and compare their search volumes.
To avoid inflated numbers, we made sure to clean all cases when we still suspected combined data. We simply took any merged volumes that showed up more than once out of the equation.
On top, we decided not to count the search volume of keywords with typos. Unlike for paid ads, it doesn’t make sense to optimize for typos since, usually, you end up with the same SERP anyway due to Google Autocorrect.
For us, it’s not surprising that the big players want to be independent of these kinds of shenanigans. Moz and Ahrefs rather calculate their data independently. They claim to take Google’s numbers as a basis only to improve it with third-party clickstream data from providers like Jumpshot.
But that’s already getting deep into the statistics jungle. So we’ll leave it at that for now.
If you’re keen on decoding the topic even further, look at this article for more insights on how to set up Google’s API. And guess what – even on Reddit you can learn more about keyword research. In this post, the team members from different tools joined a discussion about data accuracy.
For everybody else, it’s time to meet the contenders of our little contest!
Introduction to Competitors
Here we go: The playing field is leveled.
Now we have an idea of what goes on behind the scenes of each tool and a standardized way to compare the performance.
Time to introduce the players themselves!
In this study, we compare five paid keyword research tools as well as one combination of free tools.
Like we mentioned before: We focus on keyword outputs. Many of the tools have a wide-range of other functionalities. If you want a full review of those, don’t forget to check out Authority Hacker!
First up is SEMrush, a tool that we’ve already been working with for a while in the past. Now it was time to ask the question:
Is it worth the subscription when comparing the outputs with other tools?
SEMrush works with national databases, so results are on a country-specific level.
According to them, their keywords are publically available (first 100 Google search results). Also they say to collect the data similarly to Google Keyword Planner.
We got in touch with them about where the data for their search volumes comes from. The final answer that we got was sadly vague. But we were positively surprised by the fast correspondence back and forth with the SEMrush team:
“The volume is also estimated using our algorithm. Sadly, this is as much as I can reveal :)”
High volume keywords get a more frequent (daily) update than low volume keywords (monthly). Further, they admit lacking local keywords since they collect data on a national level.
Since SEMrush works with national databases, you can only search on a country level. Besides, you can select between desktop and mobile databases.
One main metric in our case study is search volume. SEMrush defines it like this:
“Volume”: “The average number of times users have searched for a given keyword per month. We calculate this value over the last 12 months.”
What options does SEMrush offer for your keyword research?
It actually gives you three reports for traditional keyword research:
(1) Phrase Match Report, (2) Related Keywords Report, (3) Keyword Magic Tool. (Update: The three tools have been consolidated within the Keyword Magic Tool).
We used them all and removed any overlapping keywords.
You can also do competitive keyword research. With the Organic URL Research of SEMrush, you’re extracting keywords that your competitors rank for.
SECockpit was our second tool choice before starting this comparison.
It’s cloud-based and scrapes its data live from several sources, including e.g. Amazon or Youtube. It claims that it does so faster than other tools and with a better keyword difficulty score. Take a look at the developer’s comment to this post for some insights.
Unlike SEMrush, SECockpit has no own databases. They scrape all data live from APIs like from Google AdWords. Differences in the numbers with e.g. Google Keyword Planner can occur since the data is cached for 30 days.
SECockpit prides itself on delivering unique metrics for all sorts of SEO strategies. It’s true that you can choose from an immense list of metrics.
One thing that’s highly important for us, is the option to look for those metrics on an aggregated global level. This is only possible with half of the tools in that we were looking into. SECockpit is one of them.
Their definition of search volume also is straightforward:
“Monthly Searches”: “Monthly Searches based on the data from Google Keyword Planner.”
What options does SECockpit offer for your keyword research?
You basically get two types of keyword reports:
A traditional (1) “Keyword Phrase” report based on a Seed Keyword. And a (2) ”Website” report where you can scrape keywords from (your competitors’) URLs.
Your results can always be easily extended via the “expand list option”.
When conducting the competitive analysis for the SERP top 10 it took us quite a while, around 30 minutes. So it goes without saying that SECockpit doesn’t operate at the warp speed that it advertises with.
KWFinder is one of the newer players on the market and convinces with its simplicity. It has a well-arranged user interface that shows the most important metrics in one go.
It clearly has the potential to play in the big leagues soon if it keeps going at the same pace.
KWFinder uses the Google AdWords API and claims to display precise search volumes. Without merging close variants. It definitely is a smooth alternative to Google Keyword Planner.
KWFinder strikes the perfect balance for us:
Exactly the right settings we need with no information overload.
You can search on a global level and will get a nice overview of metrics as well as a SERP analysis – all on one screen. Their definition of search volume is:
“Search”: “Average monthly search volume (exact match) in the last 12 months.”
What options does KWFinder offer for your keyword research?
You get three types of keyword reports from KWFinder’s Google AdWords API: a general (1) “Suggestions” report, (2) an “Autocomplete” report and a (3) “Questions” report.
On top, we heavily used the “Import” function where you can upload up to 700 keywords (200 with the Basic Plan). It was crucial for us to check all keywords in one and the same tool. This way we were able to standardize the search volumes of the suggestions that all the tools spit out.
Next up one of the big players in the business: Moz and its Keyword Explorer.
They stepped up to their reputation in the industry and came out with it in the middle of 2016. So it’s a quite new tool.
To be honest, we were really intrigued by it and excited to give it a go. Just take a look at the introductory blog post and the pitch deck. And you’ll definitely understand where our high expectations were coming from.
As touched upon, Moz is merging Google search volumes with clickstream data. With their own algorithm, they transform the grouped Google data buckets into more realistic data.
But. (Of course, there is a but.)
The output that you get as user again comes in ranges. They may be statistically more accurate than those of the Google Keyword Planner and solve the ‘close variants’ issue.
But still: They’re unhandy to work with. At least in our humble opinion.
In addition, many of the suggestions show no search volume data yet.
And besides this, the most important drawback from our point of view: It only works well for keyword research in the United States.
Read for yourself:
“Thus, while the tool can search any Google domain in any country, the volume numbers will always be for US-volume. In the future, we hope to add volume data for other geos as well.”
The settings are on a country-level but remember: While you get international suggestions, the numbers will always be from US data. Their search volume definition:
“Monthly Volume”: “Volume ranges show you (with 95% or more accuracy) how often a term or phrase is searched for in Google each month.”
What options does Moz offer for your keyword research?
The tool offers seven types of reports that…
- “include a mix of sources”
- “only include keywords with all of the query terms”
- “exclude your query terms to get broader ideas”
- “are based on closely related topics”
- “are based on closely related topics and synonyms”
- “are related to keywords with similar results pages”
- “are questions”
We already knew upfront that the data for German and Spanish queries won’t be accurate. So we saved ourselves some trouble and only extracted the first report for “deutsch lernen” and “aprender aleman”.
For the English seed keyword “learn german” we, of course, downloaded all seven available reports.
Ahrefs is the other heavyweight in the world of SEO tools besides Moz and SEMrush.
But we have to say that it *spoiler alert* has a more advanced keyword research tool. At least speaking of data availability and user experience.
What impressed us most is, that it’s basically a one-stop-shop: If you search for a keyword, you can download all available reports in an already aggregated list. Including a SERP top 10 competitive analysis! Remember that in SECockpit and SEMrush it takes you about 30 minutes to do that.
Ahrefs and Moz seem to be the only tools in our comparison that actually improve Google volumes with clickstream data. The difference: Ahrefs does so with a database that supports 100+ countries. So since it does not use US search volumes for international queries: Ahrefs scores again!
Like SEMrush and Moz, Ahrefs operates on a national database level.
This again means that the limited search settings – one country per search only. They define search volume like this:
“Volume”: “search volume shows how often a target keyword is searched per month in a given country (average for last 12 months). We calculate this metric with exceptional accuracy by processing large amounts of clickstream data.”
What options does Ahrefs offer for your keyword research?
The aggregated “All” report is a combination of four single report types:
For the traditional keyword research, we got the (1) “Phrase match”, (2) “Having same terms” and (3) “Search suggestions”. For the competitive keyword research, we downloaded the (4) “Also rank for” report.
Free Tools… sounds promising, right? Because let’s be honest:
Why should you pay a fortune to use those paid tools that we introduced if you can get the job done for free?
The same question intrigued us.
So we tested all the suggestions for free keyword tools from backlinko.com. At first sight, there seem to be many fishes in the sea. But then we checked the search volumes for their suggestions in KWFinder. Only to find out that most of them were next to nothing.
In the end, we decided to go with a three-step approach to our free keyword research: Generate suggestions in
(1) www.keywordtool.io plus (2) www.answerthepublic.com and import to
(3) www.keywordseverywhere.com to get the search volumes.
The search volumes that you can extract from Keywordseverywhere.com also seem to come from a Google AdWords API.
A major disadvantage is – again – a huge bias towards English keywords. Try importing keywords with Spanish/German characters like “ñ|é|ä|ü|ö”. Keywordseverywhere.com will give up and not provide any data whatsoever.
In Keywordseverywhere.com you actually have the possibility to do a worldwide search for keyword volume data. On a country basis, you can only choose from different English speaking countries.
There is no specific definition of their search volume metrics. But we assume that it’s the regular monthly average over the past 12 months.
Keywordtool.io actually allows you to copy any suggestions to your clipboard. This way you can easily import it into the Keywordseverywhere.com extension. For Answerthepublic.com suggestions you will need to download the excel outputs first.
Okay. So all the tools had their chance to shine. We have all their reports.
What’s next? How did we actually organize and analyze it?
That’s what this section is all about. We’ll tell you which assumptions we took and how we conducted our analysis based on them.
All in all, we wanted to take the most structured approach possible to find our best keyword research tool.
Assumptions and Limitations
Judging the quality of keyword tools with one quantitative study is complicated. After all, one thing is clear: You choose your final target keywords depending on your niche and business.
It’s you who hand-picks the most relevant keyword for your content needs. How can we possibly analyze that on a larger quantitative scale?
We dropped the gloves and gave it our best shot. To do so we made three main assumptions about our:
(1) Seed Keywords | (2) Unique Keywords | (3) Relevant Keywords
We wanted to stay in the language school niche but not serve a ready-made analysis to our Spanish school competitors.
So we decided to go with the seed keyword “learn german”. A convenient choice as the Germans in our team easily could check the relevance later on. Translated into German and Spanish we get: “deutsch lernen” as well as “aprender aleman”.
By the way. We took this keyword although 720 people worldwide clearly have the opinion that learning German isn’t relevant at all…
Anyway. Let’s be serious again.
In fact, those seed keywords are quite a heavy assumption to make. Odds are that a more narrow keyword might be a game changer when looking at the results of this comparison!
But let’s not get ahead of ourselves. We’ll look into that in our next study.
Here’s a term that you should remember by for the next few minutes: relevant unique keywords
For us, it’s reasonable to assume that the unique selling point of each keyword tool is their unique keywords.
Because let’s face it: You can get the basic keyword suggestions from most of the tools. But can they also suggest you that one unique keyword that gives you a competitive edge?
That’s why we decided to filter the outputs and focus our analysis on those unique keywords:
- How many does each tool provide?
- Are they relevant to in relation to our seed keyword (“relevant unique keywords”)?
- And how high is the search volume of those relevant unique keywords?
You might disagree with this approach. But for us, it’s the best proxy to analyze and compare the value of keyword suggestions on a larger scale.
While checking the relevance of our unique keywords, we quickly realized one thing. Quantity isn’t everything. At least not the number of the initial keyword outputs.
Full disclosure – again:
We were quite generous in judging whether keywords are relevant or not. As long as they remotely had to do something with learning German, we included them. Here’s an example from SEMrush: relevant = “speaking german” | not relevant = “how to speak efficiently”. And another one from Moz: relevant = “german dictionary” | not relevant = “google translate”.
Going through ~25,000 unique keywords was quite an extensive undertaking. So there may be some keywords that we judged relevantly and you wouldn’t have. But those individual cases shouldn’t distort the general trend of our data overview.
In any way, our ‘relevance check’ focused on selecting a pool of keywords related to the topic of learning German. In the end, each business is different and targets different search intentions. This means that they will also choose entirely different keywords.
Still, think about it: It doesn’t hurt to have a big pool of potentially relevant keywords at your fingertips to select from!
Wouldn’t you agree? And that’s exactly what our quantitative analysis focused on.
Like our set of assumptions, our analysis process had three steps:
1) Total Output: Analyse ‘raw data’ of keyword suggestions.
2) Tools’ USP: Analyse only unique keywords with standardized search volumes.
3) Keyword Quality: Analyse only relevant unique keywords with standardized search volumes.
One thing we can say: It’s interesting to separate the wheat from the chaff and see how the performance of each tool changes.
To be honest: Keyword data is a mess.
And from what we’ve read, that’s the common stance across the industry. So it seems like mission impossible to make a quantitative comparison between tools.
Still, we think we made it.
Data Collection: Report Guidelines
Our first step to make the data as comparable as possible was to give ourselves clear guidelines. Which data from which reports would we like to compare?
First, we always did choose the following settings (language & country) where possible.
- learn german: English & United States
- deutsch lernen: German & Germany
- aprender aleman: Spanish & Spain
- Device (where possible): desktop
Then we gave each tool its own “chance to shine”.
We extracted keyword suggestions from all the reports we could get our hands on. Of course, if there were overlaps between the reports, we removed all duplicate keyword suggestions in Excel or Google Docs.
In the end, each tool entered the ring with its own list of distinct keyword phrases.
Following the approach of Authority Hacker, we split our analysis into two main categories:
(1) traditional keyword research and (2) competitive keyword research.
The reason is straightforward:
Tools without competitor based reports would be at a huge disadvantage. The sheer quantity of keyword outputs alone would’ve distorted the results.
Especially when you consider that any and all keywords are scraped from the competitor sites – relevant or not to the search intention behind the Seed Keyword.
Data Analysis: Filter and Metrics
Let’s dive into the data. How did we organize it?
To find our best keyword research tool, we decided against statistical software like SPSS because we were only looking to do a descriptive analysis (no correlations or the likes). Excel and Google Sheets are perfectly fine for that purpose. Besides the formulae and formatting options made it easier to keep an overview over all the data.
With the end in mind, here are the metrics that we came up with to compare the tools. We applied them to both, the traditional and the competitive process.
To put the graphic into words…
In the 1st layer of analysis, we just looked at the superficial outputs of all tools: their total keywords.
- How many do they suggest?
- What’s the total search volume along with that?
- Of the total keywords, how many are unique in one tool and how many are repeated in several tools?
- Are there many suggestions without or little data (search volume below 10)?
- Or do they merely expand the Seed Keyword (“learn german” → “learn german fast”)?
It’s basically the first impression that you’ll have after plunging in your seed keyword or its corresponding SERP top 10 URLs. The only problem: You probably agree from experience that first impressions often are deceiving. Of course, we didn’t settle for that.
In our 2nd layer of analysis, we singled out the USP of each tool: its unique keywords.
- How many does each tool suggest?
- What’s their total search volume?
- How high is their standardized search volume, i.e. after we import the unique suggestions to KWFinder and clean for merged data?
Now we know how creative tools are in coming up with keywords with a competitive edge.
Now the final step. It’s like the World Cup trophy in football or the Olympic gold medal in athletics. It’s the holy grail of keyword research: relevance.
The 3rd layer of analysis was there to dissect the unique suggestions even further and check if they are relevant.
- How many Relevant Unique Keywords does each tool suggest?
- Going back to the top: How many % of Total Keywords do they represent?
- How is their final (Standardised) search volume?
Remember: In our opinion, relevant unique keywords metrics are the best proxy to compare the quality of each tool’s output objectively on a larger scale.
But now without further ado, we’ll proudly present the one and only:
Alright. Tensions are rising.
Now we’ll walk you through the most striking results of our little competition. And yes, we’re talking about…
Quantitative Results with DATA and STATS
Remember to take a good look at the legend next to the data visuals:
- The 1st block of metrics refers to the total keyword output without any filtering.
- The 2nd block is all about the unique keywords with standardized search volumes.
- The 3rd block only shows metrics for the relevant unique keywords.
As mentioned, we split our analysis into traditional keyword research and competitive keyword research following the lead of Authority Hacker.
Traditional Keyword Research Results
Here come the results of our traditional keyword research analysis. You can slide from country to country or zoom in on each by clicking on the thumbnails below. When we refer to data from the images, we always report it the same way:
(Metric of Tool – USA: value | Germany: value | Spain: value)