1. Home
  2. Overheard
  3. Research
  4. Ask six AIs the same question and you'll…

OverheardResearch

Ask six AIs the same question and you'll rarely get the same top pick

We put 45 buyer questions to ChatGPT, Gemini, Perplexity, Google's AI Overviews and AI Mode, and Claude. On only 9 of the 42 questions that at least three of them answered with a brand did they all name the same one first.

  • Searchistry team
  • 8 minute read
The short answer

Which AI your buyer asks changes which brand they hear first. In our first look at 252 real answers, the AIs named the same brand first on 21% of questions. Treat each AI platform as its own channel, and track each one.

Agreement was the exception

We asked each AI the questions buyers ask, with no brand in the question, and noted which of the five leading brands in that industry it named first. Then, question by question, we checked whether the AIs agreed.

Questions where every AI named the same brand first, by industry
  • CRM40%
  • Project management13%
  • Running shoes8%

Out of the questions at least three AIs answered with a brand: 6 of 15 in CRM, 2 of 15 in project management, 1 of 12 in running shoes.

CRM agreed most often, and mostly on one name: HubSpot was the shared pick on 4 of the 6 CRM questions they agreed on. In running shoes, the AIs agreed on just 1 question.

Every question, every AI

Here is the whole set. Each row is a question, each square the brand an AI named first. Filter to the questions where the AIs split, or open one to see the full line-up.

QuestionChatGPTGeminiPerplexityAI OverviewsAI Mode
What is a CRM and does a small business need one?SHPerplexity: none of the fiveZAI Mode: none of the five3 picks
  • ChatGPTSalesforce
  • GeminiHubSpot
  • PerplexityNone of the five
  • AI OverviewsZoho CRM
  • AI ModeNone of the five
How do I choose a CRM for my sales team?SGemini: none of the fivePerplexity: none of the fiveHP3 picks
  • ChatGPTSalesforce
  • GeminiNone of the five
  • PerplexityNone of the five
  • AI OverviewsHubSpot
  • AI ModePipedrive
What features matter most in a CRM?SHPerplexity: none of the fiveAI Overviews: none of the fiveS2 picks
  • ChatGPTSalesforce
  • GeminiHubSpot
  • PerplexityNone of the five
  • AI OverviewsNone of the five
  • AI ModeSalesforce
What is the best CRM for small businesses?HHZHH2 picks
  • ChatGPTHubSpot
  • GeminiHubSpot
  • PerplexityZoho CRM
  • AI OverviewsHubSpot
  • AI ModeHubSpot
Best CRM for startupsHHHHS2 picks
  • ChatGPTHubSpot
  • GeminiHubSpot
  • PerplexityHubSpot
  • AI OverviewsHubSpot
  • AI ModeSalesforce
Best CRM for B2B sales teamsHHHHHAll agree
  • ChatGPTHubSpot
  • GeminiHubSpot
  • PerplexityHubSpot
  • AI OverviewsHubSpot
  • AI ModeHubSpot
Which CRM is easiest to use?HHHPP2 picks
  • ChatGPTHubSpot
  • GeminiHubSpot
  • PerplexityHubSpot
  • AI OverviewsPipedrive
  • AI ModePipedrive
Best CRM with built-in email marketingHHHHHAll agree
  • ChatGPTHubSpot
  • GeminiHubSpot
  • PerplexityHubSpot
  • AI OverviewsHubSpot
  • AI ModeHubSpot
Best CRM for real estate agentsHGemini: none of the fiveHAI Overviews: none of the fiveP2 picks
  • ChatGPTHubSpot
  • GeminiNone of the five
  • PerplexityHubSpot
  • AI OverviewsNone of the five
  • AI ModePipedrive
Best free CRM softwareHHHHHAll agree
  • ChatGPTHubSpot
  • GeminiHubSpot
  • PerplexityHubSpot
  • AI OverviewsHubSpot
  • AI ModeHubSpot
Best CRM for enterprise companiesSSSSSAll agree
  • ChatGPTSalesforce
  • GeminiSalesforce
  • PerplexitySalesforce
  • AI OverviewsSalesforce
  • AI ModeSalesforce
Which CRM integrates best with Gmail and Outlook?HHHHHAll agree
  • ChatGPTHubSpot
  • GeminiHubSpot
  • PerplexityHubSpot
  • AI OverviewsHubSpot
  • AI ModeHubSpot
How much does a CRM cost per user?SHPerplexity: none of the fiveZS3 picks
  • ChatGPTSalesforce
  • GeminiHubSpot
  • PerplexityNone of the five
  • AI OverviewsZoho CRM
  • AI ModeSalesforce
Which CRM has the best customer support?HHSSZ3 picks
  • ChatGPTHubSpot
  • GeminiHubSpot
  • PerplexitySalesforce
  • AI OverviewsSalesforce
  • AI ModeZoho CRM
What is the most affordable CRM for a 10-person team?ZZZZZAll agree
  • ChatGPTZoho CRM
  • GeminiZoho CRM
  • PerplexityZoho CRM
  • AI OverviewsZoho CRM
  • AI ModeZoho CRM

HubSpotSalesforceMonday CRMZoho CRMPipedriveNone of the five

Each square is the brand an AI named first, out of the five tracked in that industry. Columns, left to right: ChatGPT, Gemini, Perplexity, Google AI Overviews, Google AI Mode and Claude (not asked about CRM). Open a question for the full line-up.

They agreed on specific questions, and split on broad ones

Look at the questions every AI agreed on and a pattern shows. They are narrow, with one obvious answer:

  • Best CRM for enterprise companiesSalesforce, from all 5 AIs
  • Best project management software for software developmentJira, from all 6 AIs
  • Best running shoes for wide feetNew Balance, from all 6 AIs

The broad questions split. “Best project management software for small teams” got 4 different first picks from 6 AIs. Broad questions leave room for judgment, and each AI judges differently.

Being the clear answer to a specific need looks like the one place a brand gets named first across the board. In this set it's a pattern worth testing on your own questions, not a rule.

One question, six answers, in their own words

Here is how each AI answered “Best project management software for small teams”. These lines are copied from the answers we collected, next to the brand each one put first:

  • ChatGPTMy recommendation: ClickUp for teams wanting an all-in-one solution.ClickUp
  • GeminiBest for Visual Task Tracking: monday.comMonday.com
  • PerplexityFor most small teams, Asana is the best all-around choiceAsana
  • AI OverviewsTrello (Best for Visual Kanban Boards)Trello
  • AI ModeIf your team wants a digital version of sticky notes on a whiteboard, Trello is the top choice.Trello
  • Claudebest overall for most small teams.Asana
Short extracts from each AI's answer, word for word. The brand on the right is the first of the five tracked brands it named.

Four of the six opened by saying the right choice depends on the team. Every one of them still put a brand first, and that's the name a buyer skimming the answer meets first. Gemini and Google's AI Overviews didn't crown a winner at all. They sorted tools by what each is best for, and the order of that list still did the choosing.

“It depends” answers still have a first name in them. That spot is the one worth tracking.

The earlier the question, the less the AIs agreed

We grouped the questions by where a buyer is: learning about the category, comparing options, or choosing. Agreement was rare at every stage, and rarest at the start.

Questions where every AI named the same brand first, by buying stage
  • Learning0%
  • Comparing26%
  • Choosing17%

Learning: 0 of 5, Comparing: 8 of 31, Choosing: 1 of 6. Only questions that at least three AIs answered with a brand count.

Learning questions, like “What is project management software?”, named fewer brands: 2.0 per answer on average, against 3.3 for comparing questions. Only 5 of the 7 learning questions qualified, and none of those 5 got the same first pick from every AI. Comparing questions, the “best X for Y” kind, agreed on 8 of 31.

The numbers here are small, so read them as a direction, not a measurement. The direction matters, though: the first time a buyer asks an AI about your category, which brand they hear about depends heavily on which AI they asked.

Each AI has its own favourites

Count how often each AI named each brand first and every platform turns out to lean its own way. This is the brand each one named first most often:

Questions where it was the first of the five tracked brands named, out of all the questions in that industry.
AI platformCRMProject managementRunning shoes
ChatGPTHubSpot, 9 of 15ClickUp, 6 of 15Brooks and Asics, 5 of 15
GeminiHubSpot, 11 of 15Monday.com, 5 of 15Asics, 5 of 15
PerplexityHubSpot, 7 of 15Asana, 7 of 15Brooks, 5 of 15
AI OverviewsHubSpot, 7 of 15ClickUp, 6 of 15Brooks, 5 of 15
AI ModeHubSpot, 5 of 15Monday.com, 5 of 15Brooks, 5 of 15
ClaudeNot askedClickUp, 6 of 15Brooks, 7 of 15

Some leanings are strong. Read across a row and you can see an AI's taste; read down a column and you can see how little the AIs share it.

ChatGPT went with the crowd. Gemini went its own way

On 34 questions, one brand was named first by more AIs than any other. We checked how often each AI's first pick was that brand:

How often each AI's first pick matched the most common first pick
  • ChatGPT94%
  • Perplexity77%
  • AI Overviews76%
  • Claude73%
  • AI Mode67%
  • Gemini61%

Out of the 34 questions with a clear most common first pick that each AI answered with a brand.

ChatGPT's first pick matched the most common one 94% of the time. Gemini's matched 61% of the time, the lowest of the six, with Google AI Mode next at 67%.

Matching the crowd isn't the same as being right. It does mean that a brand which wins on ChatGPT is likely to be winning on several other AIs too, while a brand that wins on Gemini may be winning there alone.

Even Google disagrees with Google

AI Overviews is the summary at the top of a Google search. AI Mode is the separate, chat-style mode in Google Search (Google's description of both). Google says both draw on its core Search ranking and quality systems (Google). Yet on nearly half the questions they put a different brand first.

So “ranking in Google's AI” is two jobs, not one. A buyer who reads the summary at the top of the results and a buyer who opens AI Mode can walk away with different names. Our guide to showing up in AI Overviews and AI Mode covers both.

What this means for your brand

The first name in an AI answer carries more weight than a first link used to. In a Pew Research Center study of 900 US adults' browsing in March 2025, people clicked a result link on 8% of visits that showed an AI summary, against 15% of visits without one. Fewer clicks means the answer itself does more of the deciding.

  1. 1

    Track each AI platform on its own

    One AI's answer isn't “what AI says” about you. You can be the first pick on ChatGPT and missing on Gemini for the same question.

  2. 2

    Find out which AI your buyers use

    If most of them use Google, AI Overviews and AI Mode matter more than the rest. Ask your customers, and check where your AI visitors come from in Google Analytics.

  3. 3

    Own a specific need

    The questions every AI agreed on were narrow ones. Pages that answer one specific need clearly, for one kind of buyer, give every AI the same easy answer.

  4. 4

    Check again next week

    This is one day of answers. AI answers change from day to day, so a single check is a snapshot, not a standing.

Our guide on how to track AI visibility covers how to set this up, by hand or with a tool. To see where you stand today, the free AI check asks ChatGPT, Gemini and Google's AI the questions your buyers ask, in about a minute.

Questions people ask

Do ChatGPT, Gemini and Google's AI recommend the same brands?

Often not. In our 252 answers, every AI that named a brand first named the same one on only 21% of questions (9 of 42). On most questions, at least one AI put a different brand first.

Which AI platform should my brand focus on?

The ones your buyers use. Ask your customers which assistant they use, and check which AI platforms send you visitors in Google Analytics. Then track each one on its own: Gemini's first pick matched the most common first pick on only 61% of questions, so one AI says little about the others.

Why do different AIs give different answers?

Each AI searches and reads its own mix of sites before it answers. In the same answers, Google AI Overviews took a large share of its citations from Reddit, YouTube and forums, while ChatGPT leaned most on brands' own websites. Different sources make different picks likely. More on what AI reads.

Do AI answers change from day to day?

This post looks at one day of answers, so it can't show change over time. AI answers do vary with the wording of the question, the location and what the AI's search finds, which is why tracking tools ask the same questions every day.

About this data

Sources

  1. Google Search Central: AI features and your website
  2. Google Search Central: optimizing for AI features in Google Search
  3. Pew Research Center: Google users are less likely to click on links when an AI summary appears in the results (July 22, 2025)

Every other number in this post is counted from our own collected answers. How we collected them is in About this data, above.

See what AI says about you

The free AI check asks ChatGPT, Gemini and Google's AI the questions your buyers ask, and shows who they name. About a minute, no sign-up.