crawl friction

Noun phrase. The obstructions: inadvertent or intentional: a Website creates to efficient crawling. Examples include redirects, blocking resources in robots.txt, poor site structure, embedding too many URLs in a page, etc.