Skip to content
SEO Web Spider

Getting started

Free and Pro Feature Comparison

Compare Free and Pro, including crawl limits, speed, saved reports, CSV export and URL-list import.

2 min read

On this page

Free and Pro include the same core crawling, rendered-page analysis and result-inspection features. Pro adds faster crawling, saved reports, Internal Links CSV export and URL-list import.

Feature Free Pro
Configurable crawl URL limit, including pages and assets Up to 1,000,000 Up to 1,000,000
In-app browser Yes Yes
Google search or direct URL entry Yes Yes
Recent crawl history suggestions Yes Yes
Page analysis sidebar Yes Yes
Rendered DOM extraction Yes Yes
Same-host website crawling Yes Yes
Crawl window Yes Yes
Internal Links results table Yes Yes
External Links results table Yes Yes
External header checks Yes Yes
URL details drawer Yes Yes
Overview, Inlinks, Outlinks, Resources, Redirects and Headers details Yes Yes
Filter results Yes Yes
Sort results Yes Yes
Resize table columns Yes Yes
Persistent internal column visibility Yes Yes
Export Internal Links results as CSV No Yes
Save crawl reports No Yes
Open saved crawl reports No Yes
Import a list of URLs No Yes
Custom crawler User Agent Yes Yes
Local SQLite crawl storage Yes Yes
Local SQLite crawl history Yes Yes
Help menu legal documents Yes Yes
Gentle crawl speed Yes, 1 concurrent crawler Yes, 1 concurrent crawler
Balanced crawl speed No Yes, 6 concurrent crawlers
Fast crawl speed No Yes, 12 concurrent crawlers
Product name SEO Web Spider SEO Web Spider Pro
Registration key required No Yes

The concurrency limit is shared between pages and assets. Actual crawl capacity depends on your computer and the website. External-link header checks are optional and run after the crawl stops or finishes.

Which Version Should I Use?

Use Free when:

  • you are testing a small site;
  • you want a cautious first crawl;
  • one crawler at a time is sufficient;
  • you are learning the app.

Use Pro when:

  • you crawl larger sites regularly;
  • you have permission to crawl at a higher request rate;
  • you want Balanced or Fast mode;
  • you need to save and reopen crawl reports;
  • you want to export Internal Links results to CSV;
  • you need to import a list of URLs;
  • you need to reduce crawl time on sites that can safely handle more requests.

Notes About Adverts

The free app is funded through adverts and product messages. The application can display London Web Factory managed messages in the splash screen and status bar. Pro unlocks the speed and reporting features listed above. Registering does not necessarily remove every advertising or message surface; availability can vary by release.

For the current offer, see the Free and Pro product comparison.

Technical reference adapted from the version 0.1.0 documentation; Free and Pro features reflect the current product comparison. Adapted from London Web Factory’s product help.