Comparison

A crawler without a per-seat licence

Consuela is a desktop crawler that keeps your data on your own machine. It stores every pass as a SQLite file you can query, and covers the diagnostics work you would otherwise open a second tool for.

Get Consuela Read the docs

	Consuela	Typical commercial crawler
Licence model	No per-seat licence	Commonly an annual, per-user subscription
Where the crawl runs	Your machine	Usually your machine, for a desktop crawler
Crawl storage	A SQLite file on disk, queryable with any client	Often held in memory, with on-disk storage as an option
Saving and re-opening a crawl	Included	Varies; sometimes limited to paid tiers
DNS and hosts tools	Included Not released	Rarely part of a crawler
Runs project commands	Included Not released	Rarely part of a crawler

The right-hand column describes what is ordinarily true of commercial desktop crawlers as a category. It is not a measurement of any particular product, and it is hedged because the category is not uniform — individual tools differ, and their feature sets and pricing change. Check any product you are considering against its own current documentation rather than against this table.