The SEO Web Spider user guide
Get more from every crawl.
From your first website crawl to the finer details of your results.
Find the answer, try it out, and keep exploring.
New here? Start with your first crawl.A short walkthrough from opening a page to exploring your results.
Read the quick start
Get support
Find your next step
Browse the user guide
14 guides to explore
Getting started
Install the app, learn the essentials, and run your first crawl.
- Help OverviewGet to know SEO Web Spider and find the right guide for your first analysis, website crawl or results review.
- Install SEO Web SpiderInstall the macOS or Windows app, complete your first launch and register a Pro licence.
- Quick StartOpen a website, analyse a page, run your first crawl and review the results. Save reports or export CSV with Pro.
- Free and Pro Feature ComparisonCompare Free and Pro, including crawl limits, speed, saved reports, CSV export and URL-list import.
4 guides
Crawling & page analysis
Explore websites, control your crawls, and understand what happens along the way.
- Using the Browser and Page AnalysisExplore browser controls, rendered page analysis, headings, words, links, images and site files.
- Crawling a WebsiteStart, pause and manage a crawl, understand its scope and speed, and monitor the results.
- How the Crawler WorksUnderstand rendered crawling, URL normalisation, discovery, redirects, robots information and local storage.
- Responsible CrawlingPlan an authorised crawl, choose a considerate speed, monitor its impact and protect sensitive results.
4 guides
Understanding your results
Make sense of crawl data, link metrics, and every result column.
- Crawl Results and URL DetailsRead internal and external results, customise columns, inspect URL details and save or export reports with Pro.
- How Link Metrics Are CalculatedLearn what inlinks, outlinks and unique counts measure, with worked examples and explanations of common differences.
- Result Variables and Column GlossaryFind definitions, calculation rules and limitations for crawl columns, Page Analysis and URL Details.
3 guides
Settings & troubleshooting
Manage your data, keep the app up to date, and work through common issues.
- Settings, Local Data and ExportsManage the crawler User Agent, understand local files and preferences, and save reports or export CSV with Pro.
- Upgrade SEO Web SpiderUpdate the macOS or Windows app, preserve preferences and check registration after an upgrade.
- TroubleshootingResolve installation, page analysis, crawl, results, external status and registration problems.
3 guides
No guides found just yet.
Try a shorter search or choose another topic. You can also ask us for help.
There’s a community behind every good question.
Explore our Facebook group or get in touch for product support.