Short answer
Pick 10–30 questions your buyers ask, run each one in ChatGPT, Gemini and Claude at least three times, and log whether your product is named, its position, which competitors appear and which pages are cited. Repeat weekly with the same questions. You can do it by hand, script it with the official APIs, or use a tracker.
Why one screenshot isn’t enough
AI answers aren’t deterministic. In a SparkToro and Gumshoe study, hundreds of volunteers ran 12 prompts through ChatGPT, Claude and Google’s AI, collecting 2,961 responses. ChatGPT and Google’s AI returned the same list of brands less than 1 time in 100. What held up was frequency: across 994 responses to headphone prompts, the leading brands appeared in 55–77% of them.
So tracking means sampling. Ask each question several times, count how often you’re named (your visibility), and treat position as secondary.
Track mentions by hand, step by step
- 01
Build a question set
10–30 questions across these shapes:
- Category: “best meditation app”
- Use case: “meditation app for anxiety before sleep”
- Alternatives: “alternative to Headspace”
- Comparison: “Calm vs Headspace”
Keep branded questions (“is Still a good app?”) in a separate group. They tell you what the assistant says about you, but they inflate visibility if mixed in.
- 02
Remove personalization
Memory and custom instructions change answers. In ChatGPT, use a temporary chat without personalization or turn memory off; in Gemini and Claude, use a clean session without memory. Note which you used so runs stay comparable.
- 03
Run each question three times per assistant
Start a new chat for every run. Five runs per question if you’re about to make a decision on the result.
- 04
Log the same fields every time
Date, assistant, question, run, named (yes/no), position, competitors named, cited URLs. See the sample below.
- 05
Compute the rate and repeat weekly
Visibility = runs where you’re named ÷ total runs. Re-run the exact same set on the same weekday. Change questions only deliberately, and start a new baseline when you do.
| Question | Assistant | Run | Named | Position | Cited pages |
|---|---|---|---|---|---|
| best meditation app for sleep | ChatGPT | 1 | Yes | 3 | 2 lists, 1 review |
| best meditation app for sleep | ChatGPT | 2 | No | — | 2 lists, 1 forum thread |
| best meditation app for sleep | Gemini | 1 | Yes | 2 | 3 lists |
| alternative to Headspace | Gemini | 1 | No | — | 1 list, 1 comparison |
| alternative to Headspace | Claude | 1 | Yes | 4 | 2 lists, 1 review |
Automate it with the official APIs
By hand works for a baseline. For weekly tracking, script it. All three providers expose web search through their APIs:
- OpenAI Responses API with the
web_searchtool. You can pass an approximate user location including a two-lettercountry, and cited sources come back asurl_citationannotations with URL and title. - Gemini API with the
google_searchtool. The response’sgroundingMetadatalists the web sources (groundingChunks) and which parts of the answer they support. - Claude API (Messages) with the
web_searchserver tool. It accepts auser_locationwith a two-lettercountry, and citations are always on: cited passages come back asweb_search_result_locationentries with URL and title.
curl https://api.openai.com/v1/responses \
-H "Authorization: Bearer $OPENAI_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "<any model with web search>",
"tools": [{ "type": "web_search",
"user_location": { "type": "approximate", "country": "US" } }],
"input": "What is the best meditation app for sleep?"
}'The hard parts aren’t the calls:
- Matching names. String matching fails on generic names (“Notes”, “Focus”) and misses aliases. Extract the list of recommended products from each answer first, then match against your name and aliases.
- Volume. 20 questions × 3 assistants × 3 runs is 180 calls per check-in, each with search fees on top of tokens. Check current pricing for each provider before scheduling it daily.
- API vs app. API answers won’t match the consumer apps exactly (no memory, possibly different models). That’s fine for trend tracking as long as you’re consistent.
Tools that track it for you
A category of AI visibility trackers now exists. They differ mostly in who they’re built for and how they charge. Plans change often, so check each vendor’s pricing page.
| Tool | Built for | Notes |
|---|---|---|
| Profound | Enterprise brands and agencies | Many engines; demo-led sales |
| Peec AI | Marketing teams and agencies | ChatGPT, Perplexity, Gemini and more; monthly plans |
| Otterly.AI | Marketing teams, agencies, solo marketers | Wide engine coverage; lower-cost monthly plans |
| AthenaHQ | Mid-market and enterprise marketing teams | Monitoring plus content and PR tools; free entry plan with limited credits |
| MentionReach | Indie app and web developers | ChatGPT, Gemini and Claude; prepaid credits that never expire; 1 credit per check |
Disclosure: MentionReach is our product. It covers fewer engines than the enterprise tools; the trade is pay-per-check pricing and an app-first setup (paste an App Store, Google Play or web URL). See pricing.
What to do with the results
- Low visibility, and the cited pages don’t mention you: work on getting onto those pages. See how to get cited.
- Named, but late in the list: look at how cited pages describe you versus the apps ranked above you.
- Strong on one assistant, absent on another: compare cited domains per assistant. They often differ.
- One competitor everywhere: read the pages that name them. That’s your outreach list. More in how to measure AI visibility.
Frequently asked questions
How often should I check my brand mentions in ChatGPT?
Weekly is enough for most products. Answers vary more from run to run than they trend from day to day, so daily checks mostly measure noise unless you run many questions.
How many questions should I track?
Start with 10 to 30 questions that real buyers ask, across category, use-case, alternative and comparison shapes. Keep branded questions in a separate group.
Should I check while logged in to ChatGPT?
Memory and custom instructions personalize answers. Use a temporary chat without personalization or turn memory off, and do the same every time so runs are comparable.
Can I track ChatGPT, Gemini and Claude with the same method?
Yes. Use the same question set and the same number of runs for each, and report results per assistant as well as combined, because they often cite different sources.
Sources
- AI recommendations change with nearly every query (SparkToro × Gumshoe study) · Search Engine Journal
- Web search tool (Responses API) · OpenAI
- Grounding with Google Search · Google AI for Developers
- Web search tool · Claude Docs (Anthropic)
- Temporary Chat · OpenAI Help Center
- Profound · tryprofound.com
- Peec AI · peec.ai
- Otterly.AI · otterly.ai
- AthenaHQ · athenahq.ai