Free AI check

Home/Do AI assistants agree?

Research

Do AI assistants agree on who to recommend? Not often.

On 21 October 2026 we put the same UAE buyer questions to two different AI assistants, to two Gemini models, and to the same Gemini model twice. Here is how often they agreed, where they did, and why one check on one tool tells you very little.

Rarely. On the 421 questions where both named at least one business, Claude with live search and Gemini from memory shared even one name on 69 (16.4%): 25.6% in English and 6.8% in Arabic. They put the same business first on just 9 (2.1%).

One model does not even agree with itself. Asked the same 19 questions twice, minutes apart, Gemini Flash-Lite put the same business first only 4 times, though it shared at least one name on 14. A bigger Gemini model and Flash-Lite agreed on the first name on 1 of 10 dental questions. The two Gemini checks are small, but they point the same way: one screenshot from one tool is not a position.

16.4%of 421 questions where Claude and Gemini named even one business in common
9 of 421questions where they put the same business first
4 of 19questions where Gemini, asked twice, put the same business first (small sample)
1 of 10dental questions where Gemini 3.8 Flash and Flash-Lite agreed on the first name (small sample)

What did we compare?

Three things, all on 21 October 2026, with the questions sent word for word. The method is in the main study.

ComparisonQuestions comparedSame first businessAt least one business in common
Claude with live search vs Gemini Flash-Lite from memory4219 (2.1%)69 (16.4%)
Gemini Flash-Lite asked the same question twice19 (small sample)414
Gemini 3.8 Flash vs Gemini Flash-Lite, both from memory10 English dental questions (small sample)14 of the 9 both answered

The first row is the main study. The other two are small checks that show a direction, not a precise rate. Names were matched with simple rules (lowercase, common words like "clinic" or "LLC" removed), so the same business spelled two ways, or once in Arabic and once in Latin script, can be missed. Every agreement figure here is a lower bound.

How often do Claude and Gemini agree?

Seldom, and almost never on the top pick. Of the 421 questions, 352 had no business in common, 50 had one, 15 had two and 4 had three or four. Across these questions Gemini gave 2,268 names and Claude 1,829, and only 94 were the same business on the same question. Put both lists for a question together and, on average, 2.5 names in 100 appear on both (3.9 in English, 1.0 in Arabic).

IndustryQuestions comparedIn common, EnglishIn common, ArabicIn common, all
Education and childcare4510 of 242 of 2126.7%
Real estate397 of 203 of 1925.6%
Fitness and wellness5010 of 252 of 2524.0%
Business setup344 of 114 of 2323.5%
Restaurants and cafes489 of 231 of 2520.8%
Home services405 of 250 of 1512.5%
Law firms343 of 200 of 148.8%
Automotive403 of 230 of 177.5%
Dental clinics453 of 210 of 246.7%
Aesthetics and dermatology461 of 232 of 236.5%
All industries42155 of 215 (25.6%)14 of 206 (6.8%)16.4%

Agreement was highest in education, real estate and fitness, where a few well-known schools, nurseries, brokers and gym chains lead. It was lowest for clinics, garages and law firms, where many small businesses compete area by area. In Arabic, four industries (home services, law, automotive and dental) had no business in common on a single question. Our industry reports join English and Arabic spellings of the same business, so they find a few more matches; both methods show the same picture: the two assistants rarely agree.

The 9 questions where both put the same business first

The pattern: a long-established name that leads its category, or a free zone, a developer or a sports club that is close to the obvious answer. Where many businesses compete, the assistants went separate ways.

Where they agreed on nothing

The first three businesses each assistant named, on questions with no name in common. This is what the AI named on one day; it is not our ranking.

QuestionClaude, live searchGemini, from memory
Best pilates studio in Downtown Dubai?THE LAB STUDIOS, Posture, Kure PilatesREFORM Athletica, Embody Fitness, The Hundred Pilates Studio
Best restaurant in Deira for a birthday dinner?The Banc Dubai, Gusto Italian Restaurant, MiyakoBoardwalk, The Thai Kitchen, The Courtyard
Best aesthetic clinic in Al Barsha for Botox?Avoria Aesthetic Clinic, Glow Aesthetics Dermatology Clinic Al Barsha, Dynamic Aesthetic ClinicLucia Clinic, Enfield Royal Clinic, Novomed Centre
Which business setup consultant in Sharjah is the most reliable?A&A Associate, Signature Pro Services, Perfect Business SolutionsDecisive Zone, Shuraa Business Setup, Commitbiz Management Consultants
Affordable part-time maid service in Deira?Hello Cleaner, The Maids, At DoorstepJustLife, Urban Company, Helpsters

Does one AI model agree with itself?

Not reliably. We sent the first English and the first Arabic question in each industry (20 questions, mostly about Dubai Marina) to Gemini Flash-Lite a second time, between 1 and 23 minutes after the first run. We set this up as a check against a second model, calling "Gemini 3.5 Flash-Lite" by name, but the API reported the same model version, gemini-3.5-flash-lite, for both runs. So we read it for what it is: the same model asked the same question twice.

On one Arabic law question, the first run named no firm ("as an AI, I cannot favour one firm over another outright") and the second named five. Here are the other 19. For the Arabic questions, names are shown in the Latin form the answer gave in brackets.

QuestionFirst pick, run 1First pick, run 2Names in common
What is the best dental clinic in Dubai Marina?Noưra Smile Dental ClinicNoưra Dental Clinic1
Best aesthetic clinic in Dubai Marina for Botox?Novomed MarinaNovomed Marina3
Best real estate agency in Dubai Marina for buying an apartment?haus & hausEspace Real Estate5
What is the best business setup company in Dubai for a small startup?VirtuzoneVirtuzone3
Best law firm in Dubai Marina for a business dispute?M&CO LegalMIOLAW2
Best restaurant in Dubai Marina for a birthday dinner?Pier 7Pier 75
Best cleaning company in Dubai Marina?ServiceMarketojas1
Best gym in Dubai Marina?F45 TrainingThe Gym Dubai3
Best nursery in Dubai Marina?Willow Children's NurseryBlossom Nursery3
Best car service garage in Dubai Marina?Deutsche TechnikRoyal Swiss Auto Services3
ما أفضل عيادة أسنان في دبي مارينا؟ (best dental clinic, Dubai Marina)Expert Dental ArtsAmacare / Ideal Smirks0
أفضل عيادة تجميل في دبي مارينا للبوتوكس؟ (Botox, Dubai Marina)Beverly Hills Twilight Surgical CenterCosmoSurge0
أفضل شركة عقارات في دبي مارينا لشراء شقة؟ (buying an apartment, Dubai Marina)Espace Real EstateEmaar Properties0
ما أفضل شركة لتأسيس الأعمال في دبي لشركة ناشئة صغيرة؟ (business setup for a small startup)IFZAVirtuzone2
أفضل مطعم في دبي مارينا لعشاء عيد ميلاد؟ (birthday dinner, Dubai Marina)PubliquePier 71
أفضل شركة تنظيف في دبي مارينا؟ (cleaning company, Dubai Marina)JustLifeJustLife2
أفضل نادي رياضي في دبي مارينا؟ (gym, Dubai Marina)The GymFitness First0
أفضل حضانة في دبي مارينا؟ (nursery, Dubai Marina)Blossom Dubai MarinaBlossom Nursery1
أفضل كراج لصيانة السيارات في دبي مارينا؟ (car garage, Dubai Marina)WBA (Munich Motor Works)Royal Swiss Auto Services0

The same business came first on 4 of 19 questions: 3 of 10 in English and 1 of 9 in Arabic. The two runs shared at least one name on 14 of 19, which was every English question (10 of 10) but only 4 of the 9 Arabic ones. Two of the "different" first picks look like the same brand under a slightly different name (Noưra, and Blossom), so a looser count is 6 of 19. Either way, the business at the top changed more often than it stayed.

Does a bigger model agree with a smaller one?

Not much more. We asked the first 10 English dental questions to Gemini 3.8 Flash, a bigger Gemini model, also from memory. It agreed with Flash-Lite on the first clinic once (Saudi German Hospital, for an emergency dentist near JLT) and shared at least one name on 4 of the 9 questions both answered.

QuestionGemini 3.8 Flash, first pickGemini Flash-Lite, first pick
What is the best dental clinic in Dubai Marina?Marina Medical CenterNoưra Smile Dental Clinic
Which dentist in Sharjah has the best reviews?Thumbay Dental HospitalImperial Dental Clinic
How much does teeth whitening cost in Dubai, and which clinic is good value?NOA Dental ClinicGlorious Dental Clinic
Where can I get affordable dental implants in the UAE?Thumbay Dental HospitalHamdan Bin Mohammed College of Dental Medicine at MBRU
Emergency dentist open now near JLT?Saudi German Hospital DubaiSaudi German Hospital
Best dentist in Dubai for a child who is scared of the dentist?Dr. Yasmin Pediatric Dental ClinicThe Children's Dental Center
Which clinic in Dubai is best for Invisalign for adults?Noa Dental ClinicDr. Michael's Dental Clinic
Is there a dental clinic in Business Bay that takes my insurance and is well reviewed?Magnum Clinic(named no clinic)
Where should I go for a root canal in Downtown Dubai?MediclinicNoưra Clinic
Top rated orthodontist in Al NahdaDr. Joy Dental ClinicPrime Medical Center

The bigger model did handle one detail better. Asked about Al Nahda, which Arabic live search had confused with districts in Jeddah and Riyadh, it got the place right:

Top rated orthodontist in Al Nahda

"Because Al Nahda spans the border between Dubai and Sharjah, top-rated dental centers and orthodontists operate in both zones."

Gemini 3.8 Flash, answering from memory through the Gemini API, 21 October 2026. Recorded by Adjoltz.

Why do the lists differ so much?

Our reading of the data, cause by cause:

What does this mean for tracking AI visibility?

Your place in AI answers is a rate, not a rank. The useful number is: across my buyers' real questions, on several tools, in both languages, in what share of answers was I named, and who was named instead. Measured the same way each time, that number can move. A single "we're first on ChatGPT" screenshot cannot.

  1. Fix a question list. 10 to 40 questions your buyers really ask, with the areas you serve, in English and Arabic. Keep it the same between checks.
  2. Cover more than one assistant. Two tools shared a name on 16.4% of our questions, so each one needs its own check. At a minimum, ChatGPT and Gemini (Google AI).
  3. Ask more than once. One run is noisy. Repeat the important questions and count how often you appear.
  4. Count shares, not first place. Record the share of answers that name you and the competitors named instead.
  5. Track Arabic separately. With 6.8% agreement in Arabic, an English result says nothing about the Arabic one.
  6. Keep dated records. Save the raw answers or screenshots with the date and the tool, and re-check on a schedule.

This is how our plans work. Each one re-checks a fixed question list on ChatGPT and Gemini (Google AI): Foundation (AED 4,500 a month) 25 questions monthly in one language, Growth (AED 8,500) 40 English and 40 Arabic every 2 weeks, Authority (AED 16,000) 60 and 60 weekly. Plans have a 3-month minimum, then run month to month, with no setup fee. The free AI check is a quick first look.

What this data does not show

Questions people ask

Why do different AI assistants recommend different businesses?

Because they build the answer from different inputs. One may search the web and use the few pages that fit the question, another may answer from what its model remembers, and each search tool finds different pages. In our data, Claude with live search and Gemini from memory named even one business in common on only 16.4% of 421 questions.

If AI named my business once, will it name me again?

Not necessarily. When we asked Gemini Flash-Lite the same 19 questions twice, minutes apart, it put the same business first only 4 times. Treat a single screenshot as a snapshot and measure how often you are named across many runs.

How many AI tools should I check?

At least two, and more if your buyers use them. Two tools shared a name on only one question in six in our study, and on fewer than one in fourteen Arabic questions, so a result on one tool says little about the other.

Does asking the same question twice give the same answer?

Often not. In our small repeat test (19 questions), the first business changed 15 times. In English the two runs still shared at least one name every time; in Arabic they shared a name on only 4 of 9 questions.

Are Arabic answers less consistent?

Yes. Claude and Gemini shared a business on 25.6% of English questions but only 6.8% of Arabic ones, and four industries had no shared name on any Arabic question. Track Arabic as its own list of questions.

How do you measure AI visibility if answers keep changing?

As a rate, not a rank. Keep a fixed list of buyer questions, ask them on several assistants in both languages on a schedule, and count the share of answers that name you and your competitors. Our plans re-check the same questions on ChatGPT and Gemini (Google AI) monthly, every 2 weeks or weekly, depending on the plan.

Sources

  1. Adjoltz: UAE AI visibility study 2026 (method, all 10 industries)
  2. Study data, one row per question (CSV)
  3. Question list (500 questions, JSON lines)
  4. Gemini API: grounding with Google Search

Read next

What does AI say about your business?

Free AI check on WhatsApp: 10 real buyer questions on ChatGPT and Gemini (Google AI). Result in about 10 minutes during Dubai working hours.

Get my free AI check