Check Out Our Brand Spankin’ New Small Business Hub!
Cancel
Matthew Henry

Matthew Henry

Matthew Henry is Portent's resident SEO tools developer and math wizard.

Articles by Matthew Henry

Old-robot-speech

Matthew Henry //  15 Sep, 2016

The Complete Guide to Robots.txt

Robots.txt is a small text file that lives in the root directory of a website. It tells well-behaved crawlers whether to crawl certain parts of the site or not. The file uses simple syntax to be easy for crawlers to put in place (which makes it easy for webmasters to put in place, too). Write… Read More

SEO-spider-trap-portent

Matthew Henry //  2 Feb, 2016

Field Guide to Spider Traps: An SEO’s Companion

If search engines can’t crawl your site, SEO efforts do not amount to much. One of the problems I see most often are ‘spider traps’. Traps kill crawls and hurt indexation. Here’s how you find and fix them: What is a spider trap? A spider trap is a structural issue that causes a web crawler… Read More