Gumshoe AI Citation Analysis Review - Persona-Driven LLM Tracking Evaluated

Gumshoe AI Citation Analysis Review

How good is Gumshoe's persona-driven citation tracking across 11 AI models? An independent look at its citation attribution accuracy, model coverage, and what those numbers actually mean for a public-beta tool.

By Ben Tannenbaum, Founder of Aiso

Published June 2026·Featured in Search Engine Land& Forbes

Bottom line

Aiso rates Gumshoe at roughly 82% on citation attribution accuracy and finds effective, consistent tracking across approximately 7 of its 11 claimed AI models in the current public beta. These are directional scores from our structured review of its citation and persona-tracking capability, cross-checked against Gumshoe's published materials and hands-on testing - not audited benchmarks. As a pre-seed, public-beta product (Seattle, 2025), sampling depth varies by model. Vendor-stated figures (“thousands of conversations / 11 models / hundreds of brands”) are promising directional claims, not independently verified.

82%

Citation attribution accuracy (directional)

~7/11

Models with consistent citation tracking (beta)

Confidence: High for directional view of citation share and competitive patterns. Moderate for exact accuracy percentages and full 11-model coverage claims (Aiso assessment, not audited).

This review is maintained by the team at Aiso, an AI-search visibility platform behind a 5x AI-visibility lift for Particle and AI-visibility programs for brands like Sophia High School and Stay Unique.

Citation analysis metrics breakdown

Citation attribution accuracy

Aiso directional rating~82%

Model coverage (effective)

Consistent tracking (beta)~7 of 11

Figures are Aiso's directional assessment, triangulated from a structured capability review, Gumshoe's own materials, and hands-on beta testing. Gumshoe does not publish audited precision / recall benchmarks - treat exact percentages as directional. Vendor-stated model counts and conversation volumes are labeled as such. See how we assessed this.

How we assessed this

We score every tool in this series on the same rubric - citation attribution accuracy, model breadth and depth, source extraction reliability, and methodology transparency - and triangulate each figure from:

The resulting scores are directional estimates, not audited lab benchmarks. Where a vendor does not publish prompt-sampling design, precision / recall, refresh cadence, or independent validation - as is the case here for a public-beta product - we say so, and we recommend a direct reproducibility test before precision-critical use. We refresh this page as new information appears.

How Gumshoe's citation tracking works

Persona-driven conversations

Citation extraction

Citation analysis comparison

Tool Citation accuracy Model count Persona-driven Methodology published
Gumshoe AI ~82% (directional) 11 (vendor-stated) Yes Partial
Aiso High (auditable) 4+ major models Yes Full
Bluefish AI ~96% (reported) Not published Partial Partial

Gumshoe figures are Aiso's directional assessment; vendor-stated model counts are as published by Gumshoe. Aiso methodology descriptors are qualitative. Bluefish figures sourced from vendor materials and our Bluefish citation analysis review. None are independently audited benchmarks.

Citation tracking features

Ongoing tracking

Model breadth

Reporting outputs

What to trust Gumshoe for, and what to verify

Trust it for

Verify before relying on

Questions to ask Gumshoe before you buy

  1. Persona design

    • How are personas constructed, and how many per market / segment?
    • How often are personas refreshed to reflect shifting buyer language?
  2. Sampling depth

    • How many conversations per model per topic per run?
    • How is volatility handled when the same prompt returns different citations?
  3. Reproducibility

    • Can you rerun the same persona set and compare results week over week?
    • What confidence intervals or variance metrics are provided?
  4. Model coverage

    • Which of the 11 models are fully instrumented vs. partially covered?
    • What is directly observed vs. estimated or inferred?
  5. Attribution accuracy

    • How is a cited source confirmed vs. a hallucinated citation?
    • What is the false-positive rate for domain attribution?
  6. Independent validation

    • Any third-party methodology review or customer reproducibility audit?
    • Any measurement against human-labeled citation datasets?

Recommendations

  1. For broad multi-model citation tracking

    Gumshoe is a compelling early option for brands that need directional visibility across a wide range of AI models, including newer platforms most tools have not yet covered.

  2. For persona-relevant prompt design

    The persona-driven approach is meaningfully better than generic keyword monitoring for understanding how AI cites sources in buyer-intent contexts - a worthwhile trade-off for the added sampling variability.

  3. For verifiable, audit-grade citation measurement

    If reproducibility and traceability matter for your reporting, prioritize tools that publish their methodology and let you inspect the underlying prompts. Aiso is built around transparent measurement, the real prompts customers ask, and reproducible citation results you can check.

Frequently asked questions

How accurate is Gumshoe AI's citation analysis?

Aiso's directional assessment rates Gumshoe at roughly 82% citation attribution accuracy across the models it monitors effectively. That figure comes from a structured capability review cross-checked against Gumshoe's published materials and hands-on beta testing - not an independently audited benchmark. As a public-beta product, persona sampling depth and consistency vary by model, so treat the number as a direction-of-travel score rather than a certified precision/recall figure.

How many AI models does Gumshoe actually track?

Gumshoe states it runs persona-driven conversations across approximately 11 AI models including ChatGPT, Gemini, Claude, Perplexity, Grok, DeepSeek, and Google AI Overviews. Aiso's hands-on review found that citation extraction and source-tracking is meaningfully consistent across roughly 7 of those 11 in the current beta, with the remaining models showing thinner or less stable coverage. Model counts and depths are vendor-stated and subject to change as the product matures.

What is persona-driven citation tracking and why does it matter?

Gumshoe runs simulated conversations using buyer personas to mimic the kinds of questions real customers ask AI assistants. This surfaces which sources and brands get cited in context, rather than just monitoring raw keyword mentions. The approach can improve relevance of the prompts used, though it introduces variability: persona design and sampling depth directly affect which citations appear and how reproducible results are across runs.

How does Gumshoe compare to other citation analysis tools?

Gumshoe's strength is breadth - 11 claimed models including newer entrants like Grok and DeepSeek - and its persona-based approach surfaces contextually relevant citations. Its limitations as an early-stage beta are typical: methodology is not yet fully published, sampling depth varies by model, and reproducibility checks are not available. Tools differ most on transparency and depth of sampling. Aiso publishes its measurement methodology and the real prompts customers ask, which makes results auditable.

Measure AI citation visibility you can actually verify

Aiso tracks how your brand is cited across ChatGPT, Claude, Gemini, and Perplexity, with transparent, reproducible methodology and the real prompts customers ask. See exactly how every citation number is produced.