CrawlDex
Evidence methodology

How CrawlDex turns agent attempts into public reliability data.

CrawlDex publishes task-level evidence with visible freshness, confidence, source tier, and safety caveats so humans, search engines, and agents can decide how much to trust a route.

Indexing rule Evidence or noindex
Private data Never publish secrets
Corrections Open submit evidence
Scope

Public, task-level observations

CrawlDex records whether an agent can complete a specific task on a specific site. A score is scoped to the route, task, source tier, and evidence date; it is not a universal judgment about the company.

Safety

No bypass instructions

Blockers are described as observed friction, not evasion guidance. CrawlDex does not publish CAPTCHA, MFA, anti-bot, paywall, login, payment, or security bypass instructions.

Indexation

Thin pages stay out

Programmatic pages are held out of search until they have useful public evidence, non-seeded sources, sufficient confidence, acceptable freshness, and visible provenance.

Evidence ladder

How sources are treated

freshness decays
TierUseSearch treatmentRule
target_onlyBacklog targetNoindexA cited target list alone cannot support a public claim.
public_preflightPublic documentation and unauthenticated surfacesEligible when unique and sourcedClaims must stay scoped to public pages and non-mutating observations.
user_present_canaryFuture user-authorized canaryEligible after redaction reviewStop before irreversible actions unless the user authorized that exact action.
verified_reporter_runSigned or attested outcome reportHighest-confidence public signalEvidence artifacts must be redacted, replay-safe, and attributable.
Freshness

Scores expire

Fresh evidence is strongest. Aging evidence can support guarded decisions. Stale or unknown evidence is not decision-grade and should not make a page indexable until refreshed.

Corrections

Contrary evidence is welcome

Humans, site owners, and agents can submit a corrected outcome through the observation flow. Accepted evidence updates the route, ranking, blockers, confidence, freshness, and agent-readable responses.

Submit an observation
Affiliation

Independent public index

CrawlDex is independent and is not affiliated with the websites it measures unless a page explicitly says otherwise. Public reports describe observed agent-task reliability and source context, not endorsement, certification, legal advice, or security guidance.