SiteOne Crawler Report - spider.cloud

Summary

Website Quality Score

8.2 Good

Performance

10.0

SEO

8.6

Security

8.5

Accessibility

5.0

Best Practices

9.0

⛔ Skipped URLs - 41 skipped URLs found.
⛔ 2 page(s) with multiple <h1> headings.
⚠️ 28 page(s) do not support Brotli compression.
⚠️ No WebP image found on the website.
⚠️ No AVIF image found on the website.
⚠️ 1 page(s) with large inline SVGs (> 5120 bytes).
⚠️ 2 page(s) with skipped heading levels.
⚠️ 28 page(s) without aria labels.
⚠️ 28 page(s) without role attributes.
⚠️ Security - 30 pages(s) with warning(s).
⏩ Loaded robots.txt for domain 'spider.cloud': status code 200, size 679 B and took 417 ms.
⏩ External URLs - 41 external URL(s) found.
⏩ 404 NOTICE - 2 non-existent page(s) found.
⏩ DNS IPv6: domain spider.cloud does not support IPv6 (DNS server: 127.0.0.53).
✅ Redirects - no redirects found.
✅ SSL/TLS certificate is valid until Jun 6 00:19:43 2026 GMT. Issued by C = US, O = Let's Encrypt, CN = R13. Subject is CN = spider.cloud.
✅ SSL/TLS certificate issued by 'C = US, O = Let's Encrypt, CN = R13'.
✅ Performance OK - all non-media URLs are faster than 3 seconds.
✅ HTTP headers - found 20 unique headers.
✅ All 28 unique title(s) are within the allowed 10% duplicity. Highest duplicity title has 3%.
✅ All 28 description(s) are within the allowed 10% duplicity. Highest duplicity description has 3%.
✅ All pages have quoted attributes.
✅ All pages have inline SVGs with less than 5 duplicates.
✅ All pages have valid or none inline SVGs.
✅ All pages have <h1> heading.
✅ All pages have DOM depth less than 30.
✅ All pages have clickable (interactive) phone numbers.
✅ All pages have valid HTML.
✅ All pages have image alt attributes.
✅ All pages have form labels.
✅ All pages have lang attribute.
✅ DNS IPv4 OK: domain spider.cloud resolved to 76.76.21.21 (DNS server: 127.0.0.53).

Visited URLs

Found 30 row(s).

URL	Status	Type	Time (s)	Size	Cache
/docs	404	HTML	543 ms	50 kB	0 s
/docs/overview	200	HTML	303 ms	140 kB	0 s
/docs/api	200	HTML	265 ms	188 kB	0 s
/docs/core/webhooks	200	HTML	294 ms	88 kB	0 s
/docs/core/data-connectors	200	HTML	275 ms	126 kB	0 s
/docs/advanced/json-scraping	200	HTML	496 ms	80 kB	0 s
/docs/guides/recipes	200	HTML	251 ms	119 kB	0 s
/docs/integrations/flowiseai	200	HTML	333 ms	73 kB	0 s
/docs/core/scraping-crawling	200	HTML	188 ms	93 kB	0 s
/docs/integrations/langchain	200	HTML	249 ms	83 kB	0 s
/docs/concepts	200	HTML	273 ms	84 kB	0 s
/docs/integrations/agno	200	HTML	275 ms	80 kB	0 s
/docs/core/search	404	HTML	21 ms	50 kB	0 s
/docs/core/reliability	200	HTML	267 ms	105 kB	0 s
/docs/integrations/overview	200	HTML	260 ms	117 kB	0 s
/docs/integrations/llamaindex	200	HTML	273 ms	78 kB	0 s
/docs/core/efficient-scraping	200	HTML	244 ms	85 kB	0 s
/docs/core/spider-browser	200	HTML	247 ms	98 kB	0 s
/docs/guides/use-cases	200	HTML	300 ms	77 kB	0 s
/docs/integrations/crewai	200	HTML	269 ms	85 kB	0 s
/docs/quickstart	200	HTML	257 ms	97 kB	0 s
/docs/core/concurrent-streaming	200	HTML	222 ms	80 kB	0 s
/docs/integrations/zapier	200	HTML	282 ms	78 kB	0 s
/docs/core/authentication	200	HTML	285 ms	87 kB	0 s
/docs/libraries	200	HTML	277 ms	92 kB	0 s
/docs/integrations/mcp	200	HTML	267 ms	95 kB	0 s
/docs/integrations/x402	200	HTML	297 ms	90 kB	0 s
/docs/core/error-codes	200	HTML	226 ms	86 kB	0 s
/docs/core/rate-limits	200	HTML	387 ms	84 kB	0 s
/docs/core/realtime-search	200	HTML	253 ms	94 kB	0 s
No rows found, please edit your search term.

(+) Show entire table

Best practices

Found 10 row(s).

Analysis name	OK	Notice	Warning	Critical
Heading structure	54	0	2	2
Invalid inline SVGs	85	0	0	0
Large inline SVGs (> 5120 B)	83	0	2	0
Duplicate inline SVGs (> 5 and > 1024 B)	85	0	0	0
DOM depth (> 30)	30	0	0	0
Title uniqueness (> 10%)	28	0	0	0
Description uniqueness (> 10%)	28	0	0	0
Brotli support	0	0	28	0
WebP support	0	0	1	0
AVIF support	0	0	1	0
No rows found, please edit your search term.

Large inline SVGs

Severity	Occurs	Detail	Affected URLs (max 5)
warning	1	<svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 1920 1920" width="40" height="24"> ...	/docs/integrations/overview
warning	1	<svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 109 22" width="40" height="24"> ...	/docs/integrations/overview

Duplicate inline SVGs

No problems found.

Invalid inline SVGs

No problems found.

Missing quotes on attributes

No problems found.

DOM depth

No problems found.

Heading structure

Severity	Occurs	Detail	Affected URLs (max 5)
critical	3	Multiple <h1> headings found.	URL 1, URL 2
warning	3	Heading structure is skipping levels: found an <h4> after an <h2>.	URL 1, URL 2

Non-clickable phone numbers

No problems found.

Title uniqueness

No problems found.

Description uniqueness

No problems found.

Accessibility

Analysis name	OK	Warning	Critical
Missing aria labels	5	97	1
Missing roles	0	5	0
Missing html lang attribute	1	0	0
Missing image alt attributes	18	0	0

Valid HTML

No problems found.

Missing image alt attributes

No problems found.

Missing form labels

No problems found.

Missing aria labels

Found 111 row(s).

Severity	Occurs	Detail	Affected URLs (max 5)
critical	3	<select ***>	URL 1, URL 2, URL 3
warning	1064	<a class="text-* dark:text-* hover:text-* hover:underline" *** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	756	<a class="truncate block px-* py-* rounded-* text-* font-* text-* hover:text-* hover:bg-* transition-* duration-* no-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	139	<button class="flex flex-* items-* justify-* transition-* [&[data-* *** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	123	<a class="text-* dark:text-* tracking-* underline-* hover:underline hover:text-* dark:hover:text-* focus-* focus-* focus-* dark:focus-* focus-* focus-* dark:focus-* truncate inline" *** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	117	<a ***>	URL 1, URL 2, URL 3, URL 4, URL 5
warning	104	<button class="inline-* items-* justify-* whitespace-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* hover:bg-* hover:text-* h-* rounded-* px-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	84	<a class="font-* flex place-* gap-* hover:bg-* dark:hover:bg-* px-* py-* rounded font-* whitespace-* text-* hover:text-* transition-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	56	<a class="font-* flex place-* gap-* hover:bg-* dark:hover:bg-* px-* py-* rounded font-* whitespace-* text-* hover:text-* transition-* hidden lg:inline" *** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	56	<button class="font-* flex place-* gap-* hover:bg-* dark:hover:bg-* px-* py-* rounded font-* whitespace-* cursor-* text-* hover:text-* transition-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<button class="inline-* items-* justify-* whitespace-* rounded-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* border border-* bg-* hover:text-* h-* w-* lg:hidden" *** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<a class="text-* dark:text-* hover:text-* hover:underline inline-* items-* gap-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<button class="inline-* items-* justify-* whitespace-* rounded-* text-* font-* transition-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* hover:bg-* hover:text-* h-* py-* w-* px-" id="theme-button-selector" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<button class="flex-* px-* py-* text-* font-* rounded-* border border-* bg-* text-* hover:text-* hover:bg-* transition-" id="cookie-decline" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<a class="flex md:hidden place-* gap-* text-* md:text-* hover:bg-* dark:hover:bg-* px-* py-* rounded" *** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<button class="flex-* px-* py-* text-* font-* rounded-* bg-* text-* hover:opacity-* transition-" id="cookie-accept" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<a class="flex place-* gap-* text-* hover:bg-* px-* py-* rounded-* transition-* no-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<a class="flex items-* justify-* gap-* px-* py-* text-* font-* text-* hover:text-* transition-* group overflow-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<a class="underline hover:text-* transition-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<a class="text-* dark:text-* text-* hover:bg-* dark:hover:bg-* hover:rounded px-* py-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	27	<a class="truncate block px-* py-* rounded-* text-* font-* text-* hover:text-* hover:bg-* transition-* duration-* no-* bg-* text-* dark:text-* font-" ** >	URL 1, URL 2, URL 3, URL 4, URL 5
warning	20	<a class="block no-* text-* hover:text-* transition-* focus:outline-* focus:text-" ** >	/docs/overview
warning	15	<a class="flex items-* gap-* px-* py-* rounded-* text-* font-* text-* hover:text-* hover:bg-* transition-* duration-* no-" ** >	/docs/api
warning	12	<a class="inline text-* dark:text-" ** >	/docs/api
warning	11	<a class="inline-* items-* justify-* whitespace-* rounded-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* border border-* bg-* hover:text-* h-* px-* py-* gap-" ** >	/docs/integrations/overview
warning	11	<a class="pt-* inline-" ** >	/docs/integrations/zapier
warning	8	<a class="group flex flex-* p-* rounded-* border border-* hover:border-* dark:hover:border-* transition-" ** >	/docs/guides/use-cases
warning	7	<button class="inline-* items-* justify-* whitespace-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* hover:bg-* hover:text-* h-* rounded-* px-* absolute top-* right-" ** >	/docs/libraries
warning	5	<a class="flex items-* gap-* p-* rounded-* border border-* bg-* dark:bg-* hover:border-* hover:bg-* dark:hover:bg-* transition-* no-" ** >	/docs/core/data-connectors
warning	4	<a class="text-* inline-* flex-* items-* gap-* text-* font-* text-* py-* px-* hover:bg-* hover:text-* transition-* duration-" ** >	/docs/api
warning	4	<a class="group flex items-* gap-* rounded-* border border-* bg-* px-* py-* hover:border-* transition-" ** >	/docs/overview
warning	3	<button class="py-* px-* rounded-* text-* hover:text-* hover:bg-* transition-" ** >	URL 1, URL 2, URL 3
warning	2	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3b:-trigger-python" ** >	URL 1, URL 2
warning	2	<button class="inline-* items-* justify-* whitespace-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* border border-* bg-* hover:text-* h-* rounded-* px-" ** >	URL 1, URL 2
warning	2	<button class="inline-* items-* justify-* whitespace-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* bg-* text-* hover:bg-* h-* rounded-* px-" ** >	URL 1, URL 2
warning	2	<button class="flex h-* items-* justify-* whitespace-* rounded-* border-* px-* text-* ring-* placeholder:text-* focus:outline-* focus:ring-* focus:ring-* disabled:cursor-* disabled:opacity-* [& *** >	URL 1, URL 2
warning	2	<button class="inline-* items-* gap-* text-* font-* text-* hover:text-* transition-* cursor-" ** >	URL 1, URL 2
warning	2	<a class="inline-* items-* gap-* rounded px-* py-* text-* font-* text-* hover:text-* hover:bg-* transition-* duration-" ** >	/docs/api
warning	2	<a class="text-* dark:text-* tracking-* underline-* hover:underline hover:text-* dark:hover:text-* focus-* focus-* focus-* dark:focus-* focus-* focus-* dark:focus-* truncate inline text-" ** >	/docs/api
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3a:-trigger-simple" ** >	/docs/integrations/crewai
warning	1	<a id="403-body" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3h:-trigger-json-config" ** >	/docs/integrations/mcp
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R7h:-trigger-pip" ** >	/docs/integrations/langchain
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R7h:-trigger-pnpm" ** >	/docs/integrations/langchain
warning	1	<a id="400-request" *** >	/docs/core/error-codes
warning	1	<a id="401-body" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R7h:-trigger-yarn" ** >	/docs/integrations/langchain
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R6n:-trigger-curl" ** >	/docs/core/reliability
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3:-trigger-curl-install" ** >	/docs/quickstart
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3a:-trigger-data_extraction" ** >	/docs/integrations/crewai
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R6i:-trigger-curl" ** >	/docs/core/reliability
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R1k:-trigger-unix" ** >	/docs/quickstart
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R1l:-trigger-screenshot" ** >	/docs/quickstart
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9Rea:-trigger-curl" ** >	/docs/core/data-connectors
warning	1	<a id="401-request" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3b:-trigger-curl" ** >	/docs/core/webhooks
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R7a:-trigger-go" ** >	/docs/integrations/x402
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3b:-trigger-typescript" ** >	/docs/integrations/x402
warning	1	<a id="2xx-body" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3b:-trigger-go" ** >	/docs/integrations/x402
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3a:-trigger-custom_params" ** >	/docs/integrations/crewai
warning	1	<a id="503-request" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3m:-trigger-cursor-hosted" ** >	/docs/integrations/mcp
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9Rec:-trigger-python" ** >	/docs/core/data-connectors
warning	1	<a id="400-body" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R1l:-trigger-scrape" ** >	/docs/quickstart
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R6n:-trigger-python" ** >	/docs/core/reliability
warning	1	<button class="ask-* inline-* items-* gap-* rounded px-* py-* text-* font-* text-* hover:text-* hover:bg-* transition-* duration-* cursor-" ** >	/docs/api
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3h:-trigger-claude-code" ** >	/docs/integrations/mcp
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9Rea:-trigger-python" ** >	/docs/core/data-connectors
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9Ree:-trigger-python" ** >	/docs/core/data-connectors
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R7a:-trigger-pip" ** >	/docs/integrations/x402
warning	1	<a class="underline text-* dark:text-* tracking-* underline-* hover:underline hover:text-* dark:hover:text-* focus-* focus-* focus-* dark:focus-* focus-* focus-* dark:focus-* truncate inline" *** >	/docs/api
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3a:-trigger-typescript" ** >	/docs/integrations/langchain
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9Re6:-trigger-python" ** >	/docs/core/data-connectors
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9Re8:-trigger-python" ** >	/docs/core/data-connectors
warning	1	<a id="404-body" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R7h:-trigger-npm" ** >	/docs/integrations/langchain
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R1k:-trigger-windows" ** >	/docs/quickstart
warning	1	<a id="429-request" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R6i:-trigger-python" ** >	/docs/core/reliability
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R6k:-trigger-python" ** >	/docs/core/reliability
warning	1	<a id="429-body" *** >	/docs/core/error-codes
warning	1	<a id="503-body" *** >	/docs/core/error-codes
warning	1	<a id="413-request" *** >	/docs/core/error-codes
warning	1	<a id="402-request" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3m:-trigger-claude-code-hosted" ** >	/docs/integrations/mcp
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3m:-trigger-claude-desktop-hosted" ** >	/docs/integrations/mcp
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3:-trigger-node-install" ** >	/docs/quickstart
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R1l:-trigger-crawl" ** >	/docs/quickstart
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3:-trigger-python-install" ** >	/docs/quickstart
warning	1	<a id="204-request" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R6k:-trigger-curl" ** >	/docs/core/reliability
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3b:-trigger-node" ** >	/docs/core/webhooks
warning	1	<a id="500-request" *** >	/docs/core/error-codes
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3a:-trigger-website_url" ** >	/docs/integrations/crewai
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3m:-trigger-generic-hosted" ** >	/docs/integrations/mcp
warning	1	<button class="inline-* items-* justify-* whitespace-* rounded-* px-* py-* text-* font-* ring-* transition-* focus-* focus-* focus-* focus-* disabled:pointer-* disabled:opacity-* data-* data-* data-* flex-" id="radix-:r9R3a:-trigger-python" ** >	/docs/integrations/langchain
warning	1	<a class="w-* lg:w-* lg:max-* group px-* space-* py-* flex flex-* justify-* relative dark:hover:bg-* hover:bg-* rounded-* transition-* lg:border-* lg:border-" ** >	/docs/overview
warning	1	<a id="500-body" *** >	/docs/core/error-codes
You have reached the limit of 100 rows as a protection against very large output or exhausted memory.
No rows found, please edit your search term.

(+) Show entire table

Missing roles

Severity	Occurs	Detail	Affected URLs (max 5)
warning	29	<nav>	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<header class="mx-* w-* flex-* sticky place-* top-* bg-* dark:bg-* border-* z-* px-*">	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<aside class="hidden md:block md:min-* relative">	URL 1, URL 2, URL 3, URL 4, URL 5
warning	28	<footer class="py-*">	URL 1, URL 2, URL 3, URL 4, URL 5
warning	20	<footer class="flex gap-* items-* text-* pt-* place-* rtl:place-* border-* border-*">	/docs/overview
warning	1	<footer>	/docs/guides/recipes

Missing html lang attribute

No problems found.

Security

Found 10 row(s).

Header	OK	Notice	Warning	Critical	Recommendation
Access-Control-Allow-Origin	0	0	30	0	Access-Control-Allow-Origin is set to '*' which allows any origin to access the resource. This can be a security risk.
X-XSS-Protection	0	30	0	0	X-XSS-Protection header is set but deprecated. Consider removing it and using Content-Security-Policy instead.
Feature-Policy	0	30	0	0	Feature-Policy header is not set but Permissions-Policy is set. That's enough.
Server	0	30	0	0	Server header is set to 'Vercel'. It is better not to reveal used technologies.
Strict-Transport-Security	30	0	0	0
X-Frame-Options	30	0	0	0
X-Content-Type-Options	30	0	0	0
Referrer-Policy	30	0	0	0
Content-Security-Policy	30	0	0	0
Permissions-Policy	30	0	0	0
No rows found, please edit your search term.

Security headers

Severity	Occurs	Detail	Affected URLs (max 5)
warning	30	Access-Control-Allow-Origin is set to '*' which allows any origin to access the resource. This can be a security risk.	URL 1, URL 2, URL 3, URL 4, URL 5
notice	30	X-XSS-Protection header is set but deprecated. Consider removing it and using Content-Security-Policy instead.	URL 1, URL 2, URL 3, URL 4, URL 5
notice	30	Server header is set to 'Vercel'. It is better not to reveal used technologies.	URL 1, URL 2, URL 3, URL 4, URL 5
notice	30	Feature-Policy header is not set but Permissions-Policy is set. That's enough.	URL 1, URL 2, URL 3, URL 4, URL 5

TOP non-unique titles

Nothing to report.

TOP non-unique descriptions

Nothing to report.

SEO metadata

Found 28 row(s).

URL 🔼	Indexing	Title	H1	Description	Keywords
/docs/advanced/json-scraping	Allowed	Advanced JSON Scraping - Spider	JSON Scraping	Learn how to scrape JSON data embedded in HTML pages.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/api	Allowed	Spider API Reference	API Reference	Complete reference documentation for the Spider API. Includes code snippets and examples for quickly getting started with the system.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/concepts	Allowed	Concepts - Spider	Key Concepts	Learn about the core concepts that make the system relevant to your needs.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/authentication	Allowed	Authentication - Spider	Authentication	Learn how to authenticate your requests to the Spider API using Bearer tokens.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/concurrent-streaming	Allowed	Concurrent Streaming - Spider	Concurrent Streaming	Unlock high-speed data extraction with Spider API’s concurrent streaming. Learn how to stream multiple requests concurrently for maximum performance.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/data-connectors	Allowed	Data Connectors Docs - Spider	Data Connectors	Stream crawl results directly to S3, Google Cloud, Azure Blob, Google Sheets, or Supabase.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/efficient-scraping	Allowed	Efficient Scraping - Spider	Efficient Scraping	Learn how to do high performance scraping with Spider.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/error-codes	Allowed	Error Codes Docs - Spider	Error Codes	Learn about the error codes returned by the Spider API.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/rate-limits	Allowed	Rate Limits - Spider	Rate Limits	Understand Spider API rate limits, HTTP headers, and best practices for handling 429 errors.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/realtime-search	Allowed	Realtime Search - Spider	Realtime Search	Learn how to do realtime search with Spider.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/reliability	Allowed	Reliability - Spider	Reliability	Patterns for reliable data delivery: streaming with data connectors, background crawls, checkpointing, and webhook-driven pipelines.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/scraping-crawling	Allowed	Scraping and Crawling Docs - Spider	Scraping and Crawling	Learn how to scrape and crawl websites with Spider API.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/spider-browser	Allowed	Spider Browser Docs - Spider	Spider Browser	Remote browser with built-in stealth, CAPTCHA solving, and structured extraction. Connect over WebSocket and scrape any site.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/core/webhooks	Allowed	Webhooks - Spider	Webhooks	Configure webhooks to receive real-time HTTP POST notifications for crawl events, page discovery, and credit usage alerts.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/guides/recipes	Allowed	Recipes - Spider	Recipes	Copy-paste code recipes for every Spider API feature: scraping, crawling, AI extraction, browser automation, screenshots, search, streaming, webhooks, CSS selectors, and cloud storage.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/guides/use-cases	Allowed	Use Cases - Spider	Use Cases	Real-world use cases for Spider: AI training data, RAG, lead generation, price monitoring, SEO tracking, and more.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/integrations/agno	Allowed	Agno Integration - Spider	Agno Integration	Integrate Agno with Spider to load documents efficiently. Agno is a framework for building LLM-powered applications.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/integrations/crewai	Allowed	CrewAI Integration - Spider	CrewAI Integration	Use CrewAI with Spider to enhance your AI agents. CrewAI is a cutting-edge framework for orchestrating autonomous AI agents.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/integrations/flowiseai	Allowed	FlowiseAI Integration - Spider	FlowiseAI Integration	FlowiseAI is an open-source, low-code tool that enables developers to build customized large language model (LLM) applications and AI agents through a user-friendly drag-and-drop interface.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/integrations/langchain	Allowed	LangChain Integration - Spider	LangChain Integration	Use LangChain with Spider as a document loader. LangChain is a framework designed for building applications powered by large language models.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/integrations/llamaindex	Allowed	LlamaIndex Integration - Spider	LlamaIndex Integration	LlamaIndex is a framework that connects language models to external data sources, enabling efficient data retrieval and querying for applications like chatbots and search systems.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/integrations/mcp	Allowed	MCP Server Integration - Spider	MCP Server	Connect AI agents to Spider through the Model Context Protocol. Crawl, scrape, search, and extract web data from Claude, Cursor, Windsurf, and any MCP client.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/integrations/overview	Allowed	Integrations Overview - Spider	Spider Integrations	See how Spider integrates with top tools to streamline and scale data collection.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/integrations/x402	Allowed	x402 Integration - Spider	x402 Integration	Pay for Spider API calls with USDC using the x402 protocol. No account or API key needed. Autonomous agents pay per request over HTTP.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/integrations/zapier	Allowed	Zapier Integration - Spider	Zapier Integration	Use Zapier with Spider to automate tasks. Zapier is a web automation tool that connects apps and services to automate tasks without coding.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/libraries	Allowed	Libraries - Spider	Libraries	Discover and utilize client libraries for seamless integration with the Spider API, enabling efficient data extraction and processing.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/overview	Allowed	Overview - Spider	Spider Developer Platform	Discover Spider API's core features and benefits for fast scalable web data collection.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
/docs/quickstart	Allowed	Quickstart tutorial - Spider	Developer Quickstart	Quickly get started with the Spider API through our detailed guide, designed to ensure seamless integration and effective data extraction.	web scraping API, web crawling API, web scraper, web crawler, AI data extraction, structured data extraction, RAG pipeline, LLM data, AI agents, web automation, headless browser, markdown conversion
No rows found, please edit your search term.

(+) Show entire table

OpenGraph metadata

Found 28 row(s).

URL 🔼	OG Title	OG Description	OG Image	Twitter Title	Twitter Image
/docs/advanced/json-scraping	Advanced JSON Scraping - Spider	Learn how to scrape JSON data embedded in HTML pages.	/img/spider-og.png	Advanced JSON Scraping - Spider	/img/spider-og.png
/docs/api	Spider API Reference	Complete reference documentation for the Spider API. Includes code snippets and examples for quickly getting started with the system.	/img/spider-og.png	Spider API Reference	/img/spider-og.png
/docs/concepts	Concepts - Spider	Learn about the core concepts that make the system relevant to your needs.	/img/spider-og.png	Concepts - Spider	/img/spider-og.png
/docs/core/authentication	Authentication - Spider	Learn how to authenticate your requests to the Spider API using Bearer tokens.	/img/spider-og.png	Authentication - Spider	/img/spider-og.png
/docs/core/concurrent-streaming	Concurrent Streaming - Spider	Unlock high-speed data extraction with Spider API’s concurrent streaming. Learn how to stream multiple requests concurrently for maximum performance.	/img/spider-og.png	Concurrent Streaming - Spider	/img/spider-og.png
/docs/core/data-connectors	Data Connectors Docs - Spider	Stream crawl results directly to S3, Google Cloud, Azure Blob, Google Sheets, or Supabase.	/img/spider-og.png	Data Connectors Docs - Spider	/img/spider-og.png
/docs/core/efficient-scraping	Efficient Scraping - Spider	Learn how to do high performance scraping with Spider.	/img/spider-og.png	Efficient Scraping - Spider	/img/spider-og.png
/docs/core/error-codes	Error Codes Docs - Spider	Learn about the error codes returned by the Spider API.	/img/spider-og.png	Error Codes Docs - Spider	/img/spider-og.png
/docs/core/rate-limits	Rate Limits - Spider	Understand Spider API rate limits, HTTP headers, and best practices for handling 429 errors.	/img/spider-og.png	Rate Limits - Spider	/img/spider-og.png
/docs/core/realtime-search	Realtime Search - Spider	Learn how to do realtime search with Spider.	/img/spider-og.png	Realtime Search - Spider	/img/spider-og.png
/docs/core/reliability	Reliability - Spider	Patterns for reliable data delivery: streaming with data connectors, background crawls, checkpointing, and webhook-driven pipelines.	/img/spider-og.png	Reliability - Spider	/img/spider-og.png
/docs/core/scraping-crawling	Scraping and Crawling Docs - Spider	Learn how to scrape and crawl websites with Spider API.	/img/spider-og.png	Scraping and Crawling Docs - Spider	/img/spider-og.png
/docs/core/spider-browser	Spider Browser Docs - Spider	Remote browser with built-in stealth, CAPTCHA solving, and structured extraction. Connect over WebSocket and scrape any site.	/img/spider-og.png	Spider Browser Docs - Spider	/img/spider-og.png
/docs/core/webhooks	Webhooks - Spider	Configure webhooks to receive real-time HTTP POST notifications for crawl events, page discovery, and credit usage alerts.	/img/spider-og.png	Webhooks - Spider	/img/spider-og.png
/docs/guides/recipes	Recipes - Spider	Copy-paste code recipes for every Spider API feature: scraping, crawling, AI extraction, browser automation, screenshots, search, streaming, webhooks, CSS selectors, and cloud storage.	/img/spider-og.png	Recipes - Spider	/img/spider-og.png
/docs/guides/use-cases	Use Cases - Spider	Real-world use cases for Spider: AI training data, RAG, lead generation, price monitoring, SEO tracking, and more.	/img/spider-og.png	Use Cases - Spider	/img/spider-og.png
/docs/integrations/agno	Agno Integration - Spider	Integrate Agno with Spider to load documents efficiently. Agno is a framework for building LLM-powered applications.	/img/spider-og.png	Agno Integration - Spider	/img/spider-og.png
/docs/integrations/crewai	CrewAI Integration - Spider	Use CrewAI with Spider to enhance your AI agents. CrewAI is a cutting-edge framework for orchestrating autonomous AI agents.	/img/spider-og.png	CrewAI Integration - Spider	/img/spider-og.png
/docs/integrations/flowiseai	FlowiseAI Integration - Spider	FlowiseAI is an open-source, low-code tool that enables developers to build customized large language model (LLM) applications and AI agents through a user-friendly drag-and-drop interface.	/img/spider-og.png	FlowiseAI Integration - Spider	/img/spider-og.png
/docs/integrations/langchain	LangChain Integration - Spider	Use LangChain with Spider as a document loader. LangChain is a framework designed for building applications powered by large language models.	/img/spider-og.png	LangChain Integration - Spider	/img/spider-og.png
/docs/integrations/llamaindex	LlamaIndex Integration - Spider	LlamaIndex is a framework that connects language models to external data sources, enabling efficient data retrieval and querying for applications like chatbots and search systems.	/img/spider-og.png	LlamaIndex Integration - Spider	/img/spider-og.png
/docs/integrations/mcp	MCP Server Integration - Spider	Connect AI agents to Spider through the Model Context Protocol. Crawl, scrape, search, and extract web data from Claude, Cursor, Windsurf, and any MCP client.	/img/spider-og.png	MCP Server Integration - Spider	/img/spider-og.png
/docs/integrations/overview	Integrations Overview - Spider	See how Spider integrates with top tools to streamline and scale data collection.	/img/spider-og.png	Integrations Overview - Spider	/img/spider-og.png
/docs/integrations/x402	x402 Integration - Spider	Pay for Spider API calls with USDC using the x402 protocol. No account or API key needed. Autonomous agents pay per request over HTTP.	/img/spider-og.png	x402 Integration - Spider	/img/spider-og.png
/docs/integrations/zapier	Zapier Integration - Spider	Use Zapier with Spider to automate tasks. Zapier is a web automation tool that connects apps and services to automate tasks without coding.	/img/spider-og.png	Zapier Integration - Spider	/img/spider-og.png
/docs/libraries	Libraries - Spider	Discover and utilize client libraries for seamless integration with the Spider API, enabling efficient data extraction and processing.	/img/spider-og.png	Libraries - Spider	/img/spider-og.png
/docs/overview	Overview - Spider	Discover Spider API's core features and benefits for fast scalable web data collection.	/img/spider-og.png	Overview - Spider	/img/spider-og.png
/docs/quickstart	Quickstart tutorial - Spider	Quickly get started with the Spider API through our detailed guide, designed to ensure seamless integration and effective data extraction.	/img/spider-og.png	Quickstart tutorial - Spider	/img/spider-og.png
No rows found, please edit your search term.

(+) Show entire table

Heading structure

Found 28 row(s).

Heading structure	Count	Errors 🔽	URL
<h1> Recipes [#recipes] <h2> Crawl a Website [#crawl-a-website] <h2> Extract Structured Data [#extract-structured-data] <h2> Capture a Screenshot [#capture-a-screenshot] <h2> Search the Web [#search-the-web] <h2> Stream Results in Real-Time [#stream-results-in-real-time] <h2> Discover All Links [#discover-all-links] <h2> Automate Browser Interactions [#automate-browser-interactions] <h2> Target Content with CSS Selectors [#target-content-with-css-selectors] <h2> Transform HTML to Markdown [#transform-html-to-markdown] <h1> Hello World <h1> Hello <h2> Deliver Results Asynchronously [#deliver-results-asynchronously]	13	3	/docs/guides/recipes
<h1> FlowiseAI Integration [#flowiseai-integration] <h2> Setup <h1> Scrape and Crawl [#scrape-and-crawl]	3	2	/docs/integrations/flowiseai
<h1> Spider Developer Platform <h2> How It Works [#how-it-works] <h2> API Endpoints [#api-endpoints] <h2> Request Modes [#request-modes] <h2> Proxy Mode [#proxy-mode] <h2> Browser Cloud [#browser-cloud] <h2> Credits [#credits] <h2> Build now <h2> Explore our guides <h3> Spider Platform <h3> Spider API <h3> Extract Leads <h3> Website Archiving <h3> LangChain + Groq + Spider Integration Guide <h3> Stock Research Assistant Using crewAI and Spider <h3> Automated Cold Email Outreach Using Spider <h3> Scrape & Crawl Agent with Microsoft's Autogen <h3> Proxy Mode - Spider <h3> Crawling Authenticated Pages <h3> Speedy Resilient Web Scraper for RAG AI: Part 2 <h3> Speedy Resilient Web Scraper for RAG AI: Part 1 <h3> Set Up Automated Free Website Static Search <h3> Build an AI Agent from Scratch <h3> Discord Real-Time Data Retrieval <h3> Scaling Headless Chrome for High-Performance Applications <h3> Spider Search (SERP) <h3> The Spider Open Source Ecosystem <h3> Self-Hosting Spider: Using the Open Source Rust Crate <h3> Spider Pricing and Plans: What You Pay and Why	29	0	/docs/overview
<h1> API Reference [#api] <h2> Authentication <h2> Response formats <h3> Common Parameters [#common-parameters]	4	0	/docs/api
<h1> Webhooks [#webhooks] <h2> Available Events [#available-events] <h2> Inline Webhook (Per-Request) [#inline-webhook-per-request] <h2> Webhook Payload [#webhook-payload] <h3> Discord Webhooks [#discord-webhooks]	5	0	/docs/core/webhooks
<h1> Data Connectors [#data-connectors] <h2> Supported Connectors [#supported-connectors] <h2> Event Triggers [#event-triggers] <h3> <h3> <h3> <h3> <h3> <h2> Multiple Connectors [#multiple-connectors]	9	0	/docs/core/data-connectors
<h1> JSON Scraping [#json-scraping] <h2> Extracting JSON-LD from a Page <h2> Example Response [#example-response] <h3> Scrape Next.js SSR data embedded in the HTML	4	0	/docs/advanced/json-scraping
<h1> Scraping and Crawling [#scraping-and-crawling] <h2> Scraping a Single Page <h2> Crawling Multiple Pages [#crawling-multiple-pages] <h2> Request Types [#request-types] <h3> Streaming Responses [#streaming-responses] <h2> Response Fields [#response-fields] <h2> Handling Errors [#handling-errors]	7	0	/docs/core/scraping-crawling
<h1> LangChain Integration [#langchain-integration] <h2> Install <h2> Usage [#usage] <h2> Modes [#modes] <h3> Custom Parameters [#custom-parameters]	5	0	/docs/integrations/langchain
<h1> Key Concepts [#key-concepts] <h2> Crawling vs. Scraping [#crawling-vs-scraping] <h2> Request Modes [#request-modes] <h2> Concurrent Crawling [#concurrent-crawling] <h2> Output Formats [#output-formats] <h2> Streaming [#streaming] <h2> Screenshot Capabilities [#screenshot-capabilities] <h2> AI-Powered Extraction [#ai-powered-extraction] <h2> Credits System [#credits-system]	9	0	/docs/concepts
<h1> Agno Integration [#agno-integration] <h2> Install <h2> Scrape a URL [#scrape-a-url] <h2> Search and Scrape [#search-and-scrape] <h2> Toolkit Parameters [#toolkit-parameters] <h2> Toolkit Functions [#toolkit-functions]	6	0	/docs/integrations/agno
<h1> Reliability [#reliability] <h2> Stream + Data Connector [#stream-data-connector] <h2> Background Crawl with Webhook [#background-crawl-with-webhook] <h2> JSONL Checkpointing [#jsonl-checkpointing] <h2> Webhook Queue Pipeline [#webhook-queue-pipeline] <h2> Choosing a Pattern [#choosing-a-pattern]	6	0	/docs/core/reliability
<h1> Spider Integrations <h2> AI Integrations <h3> LangChain <h3> Llama Index Logo LlamaIndex <h3> CrewAI Logo CrewAI <h3> FlowiseAI Logo FlowiseAI <h3> AutoGen Logo Autogen <h3> Composio Logo Composio <h3> Agno Logo Agno <h3> Julep Logo Julep <h2> Data Integrations <h3> Data Connectors <h2> No-Code Integrations <h3> Zapier Logo Zapier <h3> Pipedream Logo Pipedream	15	0	/docs/integrations/overview
<h1> LlamaIndex Integration [#llamaindex-integration] <h2> Install <h2> Usage [#usage]	3	0	/docs/integrations/llamaindex
<h1> Efficient Scraping [#efficient-scraping] <h2> Sending Multiple URLs in One Request <h2> Batch Mode [#batch-mode] <h2> Retries [#retries] <h2> Timeouts [#timeouts] <h3> Concurrency and Streaming [#concurrency-and-streaming]	6	0	/docs/core/efficient-scraping
<h1> Spider Browser [#spider-browser] <h2> Quick Start <h2> Installation [#installation] <h2> Navigating Pages [#navigating-pages] <h2> Extracting Structured Data [#extracting-structured-data] <h2> Natural Language Extraction [#natural-language-extraction] <h2> Screenshots [#screenshots] <h2> Page Interactions [#page-interactions] <h2> Autonomous Agent Mode [#autonomous-agent-mode] <h2> Stealth and Anti-Bot [#stealth-and-anti-bot] <h2> Connection Options [#connection-options] <h2> Python Quick Start [#python-quick-start]	12	0	/docs/core/spider-browser
<h1> Use Cases [#use-cases] <h2> AI & LLM Training Data <h2> RAG Applications <h2> Lead Generation <h2> Price Monitoring <h2> Market Research <h2> Content Aggregation <h2> SEO & SERP Tracking <h2> Website Archiving	9	0	/docs/guides/use-cases
<h1> CrewAI Integration [#crewai-integration] <h2> Install <h2> Usage [#usage] <h2> SpiderTool Arguments [#spidertool-arguments] <h2> Agent Setup [#agent-setup] <h3> Next steps	6	0	/docs/integrations/crewai
<h1> Developer Quickstart <h2> Create and Export an API Key <h3> Make Your First API Request <h2> Handle the Response [#handle-the-response] <h2> Next Steps [#next-steps]	5	0	/docs/quickstart
<h1> Concurrent Streaming [#concurrent-streaming] <h2> How Streaming Works <h2> When to Use Streaming [#when-to-use-streaming] <h2> Python: Streaming with the API [#python-streaming-with-the-api] <h2> Python: Streaming with the SDK [#python-streaming-with-the-sdk] <h2> Node.js: Streaming [#node-js-streaming]	6	0	/docs/core/concurrent-streaming
<h1> Zapier Integration [#zapier-integration] <h2> Before you start <h2> Setting up the Zapier workflow	3	0	/docs/integrations/zapier
<h1> Authentication [#authentication] <h2> Getting Your API Key <h2> Using Your API Key [#using-your-api-key] <h2> Using the SDK [#using-the-sdk] <h2> Security Best Practices [#security-best-practices] <h2> Regenerating Your API Key [#regenerating-your-api-key] <h3> Authentication Errors [#authentication-errors]	7	0	/docs/core/authentication
<h1> Libraries [#libraries] <h2> Python [#python] <h2> JavaScript / TypeScript [#javascript-typescript] <h2> Rust [#rust] <h2> Go [#go] <h2> CLI [#cli]	6	0	/docs/libraries
<h1> MCP Server [#mcp-server] <h2> Connect <h2> Available Tools [#available-tools] <h2> Usage Examples [#usage-examples] <h2> Browser Session Lifecycle [#browser-session-lifecycle] <h3> Parameters [#parameters] <h2> Hosted Server [#hosted-server] <h3> npm Package [#npm-package]	8	0	/docs/integrations/mcp
<h1> x402 Integration [#x402-integration] <h2> Payment flow <h2> Install [#install] <h2> Usage [#usage] <h2> Supported endpoints [#supported-endpoints] <h2> Protocol details [#protocol-details] <h2> x402 vs API keys [#x402-vs-api-keys] <h3> Resources	8	0	/docs/integrations/x402
<h1> Error Codes [#error-codes] <h2> JSON Error Response Format <h2> Response Body Status Codes (for pages) [#response-body-status-codes-for-pages] <h2> HTTP Status Codes for Spider Request [#http-status-codes-for-spider-request]	4	0	/docs/core/error-codes
<h1> Rate Limits [#rate-limits] <h2> Rate Limit Tiers <h2> Rate Limit Headers [#rate-limit-headers] <h2> Handling 429 Errors [#handling-429-errors] <h2> Best Practices [#best-practices]	5	0	/docs/core/rate-limits
<h1> Realtime Search [#realtime-search] <h2> Basic Web Search <h2> Search and Scrape in One Request [#search-and-scrape-in-one-request] <h2> Batch Multiple Queries [#batch-multiple-queries] <h2> Geo-Targeted Search [#geo-targeted-search]	5	0	/docs/core/realtime-search
No rows found, please edit your search term.

(+) Show entire table

404 URLs

Status	URL 404 🔼	Found at URL
404	/docs
404	/docs/core/search	/docs/overview

Redirected URLs

No redirects found.

Skipped URLs Summary

Found 29 row(s).

Reason	Domain	Unique URLs 🔽
Not allowed host	github.com	10
Not allowed host	zapier.com	3
Not allowed host	www.npmjs.com	2
Not allowed host	doc.rust-lang.org	1
Not allowed host	python.langchain.com	1
Not allowed host	microsoft.github.io	1
Not allowed host	modelcontextprotocol.io	1
Not allowed host	discord.gg	1
Not allowed host	langchain.com	1
Not allowed host	x402.org	1
Not allowed host	ahrefs.com	1
Not allowed host	developer.mozilla.org	1
Not allowed host	www.json.org	1
Not allowed host	docs.crewai.com	1
Not allowed host	docs.llamaindex.ai	1
Not allowed host	www.agno.com	1
Not allowed host	docs.agno.com	1
Not allowed host	docs.julep.ai	1
Not allowed host	flowiseai.com	1
Not allowed host	pypi.org	1
Not allowed host	pipedream.com	1
Not allowed host	spidercloud.statuspage.io	1
Not allowed host	docs.composio.dev	1
Not allowed host	docs.rs	1
Not allowed host	www.linkedin.com	1
Not allowed host	twitter.com	1
Not allowed host	llamaindex.ai	1
Not allowed host	www.base.org	1
Not allowed host	crewai.ai	1
No rows found, please edit your search term.

(+) Show entire table

Skipped URLs

Found 41 row(s).

Reason	Skipped URL 🔼	Source	Found at URL
Not allowed host	http://www.json.org/	<a href>	/docs/api
Not allowed host	https://ahrefs.com/blog/google-advanced-search-operators/	<a href>	/docs/core/realtime-search
Not allowed host	https://crewai.ai/	<a href>	/docs/integrations/crewai
Not allowed host	https://developer.mozilla.org/en-US/docs/Web/API/Service_Worker_API	<a href>	/docs/api
Not allowed host	https://discord.gg/5jpNWhEZRw	<a href>	/docs
Not allowed host	https://doc.rust-lang.org/cargo/commands/cargo-install.html	<a href>	/docs/libraries
Not allowed host	https://docs.agno.com/first-agent	<a href>	/docs/integrations/agno
Not allowed host	https://docs.composio.dev/introduction/foundations/components/list_local_tools	<a href>	/docs/integrations/overview
Not allowed host	https://docs.crewai.com/concepts/tasks	<a href>	/docs/integrations/crewai
Not allowed host	https://docs.julep.ai/docs/integrations/web_browser_automation/spider	<a href>	/docs/integrations/overview
Not allowed host	https://docs.llamaindex.ai/en/stable/getting_started/installation/	<a href>	/docs/integrations/llamaindex
Not allowed host	https://docs.rs/spider/latest/spider/	<a href>	/docs
Not allowed host	https://flowiseai.com/	<a href>	/docs/integrations/flowiseai
Not allowed host	https://github.com/coinbase/x402	<a href>	/docs/integrations/x402
Not allowed host	https://github.com/mozilla/readability	<a href>	/docs/api
Not allowed host	https://github.com/spider-rs/spider	<a href>	/docs
Not allowed host	https://github.com/spider-rs/spider-browser	<a href>	/docs/core/spider-browser
Not allowed host	https://github.com/spider-rs/spider-clients/tree/main/cli	<a href>	/docs/overview
Not allowed host	https://github.com/spider-rs/spider-clients/tree/main/go	<a href>	/docs/libraries
Not allowed host	https://github.com/spider-rs/spider-clients/tree/main/javascript	<a href>	/docs/overview
Not allowed host	https://github.com/spider-rs/spider-clients/tree/main/python	<a href>	/docs/overview
Not allowed host	https://github.com/spider-rs/spider-clients/tree/main/rust	<a href>	/docs/overview
Not allowed host	https://github.com/spider-rs/spider-mcp	<a href>	/docs/integrations/mcp
Not allowed host	https://langchain.com/	<a href>	/docs/integrations/langchain
Not allowed host	https://llamaindex.ai/	<a href>	/docs/integrations/llamaindex
Not allowed host	https://microsoft.github.io/autogen/0.2/docs/notebooks/agentchat_webcrawling_with_spider/	<a href>	/docs/integrations/overview
Not allowed host	https://modelcontextprotocol.io/	<a href>	/docs/integrations/mcp
Not allowed host	https://pipedream.com/apps/spider	<a href>	/docs/integrations/overview
Not allowed host	https://pypi.org/project/requests/	<a href>	/docs/core/efficient-scraping
Not allowed host	https://python.langchain.com/docs/how_to/installation/	<a href>	/docs/integrations/langchain
Not allowed host	https://spidercloud.statuspage.io/	<a href>	/docs
Not allowed host	https://twitter.com/spider_rust	<a href>	/docs
Not allowed host	https://www.agno.com/	<a href>	/docs/integrations/agno
Not allowed host	https://www.base.org/	<a href>	/docs/integrations/x402
Not allowed host	https://www.linkedin.com/company/spider-cloud/?_l=en_US	<a href>	/docs
Not allowed host	https://www.npmjs.com/package/spider-browser	<a href>	/docs/overview
Not allowed host	https://www.npmjs.com/package/spider-cloud-mcp	<a href>	/docs/integrations/mcp
Not allowed host	https://x402.org/facilitator	<a href>	/docs/integrations/x402
Not allowed host	https://zapier.com/	<a href>	/docs/integrations/zapier
Not allowed host	https://zapier.com/apps/spider/integrations	<a href>	/docs/integrations/zapier
Not allowed host	https://zapier.com/developer/public-invite/206270/4609ca61fd3b0d84b8ebe242735ff697/	<a href>	/docs/integrations/zapier
No rows found, please edit your search term.

(+) Show entire table

External URLs

41 external URL(s)

Found 41 row(s).

External URL	Pages 🔽	Found on URL (max 5)
http://www.json.org/	1	/docs/api
https://ahrefs.com/blog/google-advanced-search-operators/	1	/docs/core/realtime-search
https://crewai.ai/	1	/docs/integrations/crewai
https://developer.mozilla.org/en-US/docs/Web/API/Service_Worker_API	1	/docs/api
https://discord.gg/5jpNWhEZRw	1	/docs
https://doc.rust-lang.org/cargo/commands/cargo-install.html	1	/docs/libraries
https://docs.agno.com/first-agent	1	/docs/integrations/agno
https://docs.composio.dev/introduction/foundations/components/list_local_tools	1	/docs/integrations/overview
https://docs.crewai.com/concepts/tasks	1	/docs/integrations/crewai
https://docs.julep.ai/docs/integrations/web_browser_automation/spider	1	/docs/integrations/overview
https://docs.llamaindex.ai/en/stable/getting_started/installation/	1	/docs/integrations/llamaindex
https://docs.rs/spider/latest/spider/	1	/docs
https://flowiseai.com/	1	/docs/integrations/flowiseai
https://github.com/coinbase/x402	1	/docs/integrations/x402
https://github.com/mozilla/readability	1	/docs/api
https://github.com/spider-rs/spider	1	/docs
https://github.com/spider-rs/spider-browser	1	/docs/core/spider-browser
https://github.com/spider-rs/spider-clients/tree/main/cli	1	/docs/overview
https://github.com/spider-rs/spider-clients/tree/main/go	1	/docs/libraries
https://github.com/spider-rs/spider-clients/tree/main/javascript	1	/docs/overview
https://github.com/spider-rs/spider-clients/tree/main/python	1	/docs/overview
https://github.com/spider-rs/spider-clients/tree/main/rust	1	/docs/overview
https://github.com/spider-rs/spider-mcp	1	/docs/integrations/mcp
https://langchain.com/	1	/docs/integrations/langchain
https://llamaindex.ai/	1	/docs/integrations/llamaindex
https://microsoft.github.io/autogen/0.2/docs/notebooks/agentchat_webcrawling_with_spider/	1	/docs/integrations/overview
https://modelcontextprotocol.io/	1	/docs/integrations/mcp
https://pipedream.com/apps/spider	1	/docs/integrations/overview
https://pypi.org/project/requests/	1	/docs/core/efficient-scraping
https://python.langchain.com/docs/how_to/installation/	1	/docs/integrations/langchain
https://spidercloud.statuspage.io/	1	/docs
https://twitter.com/spider_rust	1	/docs
https://www.agno.com/	1	/docs/integrations/agno
https://www.base.org/	1	/docs/integrations/x402
https://www.linkedin.com/company/spider-cloud/?_l=en_US	1	/docs
https://www.npmjs.com/package/spider-browser	1	/docs/overview
https://www.npmjs.com/package/spider-cloud-mcp	1	/docs/integrations/mcp
https://x402.org/facilitator	1	/docs/integrations/x402
https://zapier.com/	1	/docs/integrations/zapier
https://zapier.com/apps/spider/integrations	1	/docs/integrations/zapier
https://zapier.com/developer/public-invite/206270/4609ca61fd3b0d84b8ebe242735ff697/	1	/docs/integrations/zapier
No rows found, please edit your search term.

(+) Show entire table

TOP fastest URLs

Found 20 row(s).

Time 🔼	Status	Fast URL
187 ms	200	/docs/core/scraping-crawling
221 ms	200	/docs/core/concurrent-streaming
226 ms	200	/docs/core/error-codes
244 ms	200	/docs/core/efficient-scraping
246 ms	200	/docs/core/spider-browser
249 ms	200	/docs/integrations/langchain
251 ms	200	/docs/guides/recipes
253 ms	200	/docs/core/realtime-search
257 ms	200	/docs/quickstart
259 ms	200	/docs/integrations/overview
265 ms	200	/docs/api
267 ms	200	/docs/core/reliability
267 ms	200	/docs/integrations/mcp
269 ms	200	/docs/integrations/crewai
272 ms	200	/docs/integrations/llamaindex
273 ms	200	/docs/concepts
275 ms	200	/docs/core/data-connectors
275 ms	200	/docs/integrations/agno
276 ms	200	/docs/libraries
282 ms	200	/docs/integrations/zapier
No rows found, please edit your search term.

TOP slowest URLs

Found 20 row(s).

Time 🔽	Status	Slow URL
543 ms	404	/docs
496 ms	200	/docs/advanced/json-scraping
387 ms	200	/docs/core/rate-limits
332 ms	200	/docs/integrations/flowiseai
303 ms	200	/docs/overview
299 ms	200	/docs/guides/use-cases
297 ms	200	/docs/integrations/x402
294 ms	200	/docs/core/webhooks
284 ms	200	/docs/core/authentication
282 ms	200	/docs/integrations/zapier
276 ms	200	/docs/libraries
275 ms	200	/docs/integrations/agno
275 ms	200	/docs/core/data-connectors
273 ms	200	/docs/concepts
272 ms	200	/docs/integrations/llamaindex
269 ms	200	/docs/integrations/crewai
267 ms	200	/docs/integrations/mcp
267 ms	200	/docs/core/reliability
265 ms	200	/docs/api
259 ms	200	/docs/integrations/overview
No rows found, please edit your search term.

Content types

Content type	URLs 🔽	Total size	Total time	Avg time	Status 20x	Status 40x
HTML	30	3 MB	8.4 s	279 ms	28	2

Content types (MIME types)

Content type	URLs 🔽	Total size	Total time	Avg time	Status 20x	Status 40x
text/html; charset=utf-8	30	3 MB	8.4 s	279 ms	28	2

Source domains

Domain	Totals	HTML
spider.cloud	30 / 3MB / 8.4s	30 / 3MB / 8.4s

HTTP headers

Found 20 row(s).

Header 🔼	Occurs	Unique	Values preview	Min value	Max value
Access-Control-Allow-Origin	30	1	*
Age	30	-	[ignored generic values]	0 sec(s)	1 sec(s)
Cache-Control	30	1	public, max-age=0, must-revalidate
Content-Disposition	30	-	[ignored generic values]
Content-Security-Policy	30	1	default-src 'self'; script-src 'self' 'unsafe-inline' 'wasm-unsafe-eval' https:/…e'; base-uri 'self'; form-action 'self'
Content-Type	30	1	text/html; charset=utf-8
Cross-Origin-Opener-Policy	30	1	same-origin
Cross-Origin-Resource-Policy	30	1	cross-origin
Date	30	-	[ignored generic values]	2026-03-24	2026-03-24
Etag	30	-	[ignored generic values]
Last-Modified	30	-	[ignored generic values]	2026-03-24	2026-03-24
Permissions-Policy	30	1	camera=(), microphone=(), geolocation=(), payment=()
Referrer-Policy	30	1	strict-origin-when-cross-origin
Server	30	1	Vercel
Strict-Transport-Security	30	1	max-age=63072000
X-Content-Type-Options	30	1	nosniff
X-Frame-Options	30	1	DENY
X-Vercel-Cache	30	1	HIT
X-Vercel-Id	30	20+	[see values below]
X-XSS-Protection	30	1	1; mode=block
No rows found, please edit your search term.

HTTP header values

Found 34 row(s).

Header	Occurs	Value
Access-Control-Allow-Origin	30	*
Cache-Control	30	public, max-age=0, must-revalidate
Content-Security-Policy	30	default-src 'self'; script-src 'self' 'unsafe-inline' 'wasm-unsafe-eval' https://us.i.posthog.com https://us-assets.i.posthog.com https://challenges.cloudflare.com; style-src 'self' 'unsafe-inline'; img-src 'self' data: blob: https:; font-src 'self'; connect-src 'self' https://us.i.posthog.com https://us-assets.i.posthog.com https://api.spider.cloud https://api-data.spider.cloud https://browser.spider.cloud wss://browser.spider.cloud https://challenges.cloudflare.com https://.algolia.net https://.algolianet.com; frame-src https://challenges.cloudflare.com; frame-ancestors 'none'; base-uri 'self'; form-action 'self'
Content-Type	30	text/html; charset=utf-8
Cross-Origin-Opener-Policy	30	same-origin
Cross-Origin-Resource-Policy	30	cross-origin
Permissions-Policy	30	camera=(), microphone=(), geolocation=(), payment=()
Referrer-Policy	30	strict-origin-when-cross-origin
Server	30	Vercel
Strict-Transport-Security	30	max-age=63072000
X-Content-Type-Options	30	nosniff
X-Frame-Options	30	DENY
X-Vercel-Cache	30	HIT
X-Vercel-Id	1	arn1::dqkth-1774362949274-b4338479f0e3
X-Vercel-Id	1	arn1::hxqjc-1774362950145-d7178862ad04
X-Vercel-Id	1	arn1::gs4pq-1774362948846-8d393c7b8eec
X-Vercel-Id	1	arn1::4x4xm-1774362950266-3261fb7b59a8
X-Vercel-Id	1	arn1::f7lq9-1774362948479-376d3bd49dd0
X-Vercel-Id	1	arn1::dqkth-1774362949451-2edba40e75be
X-Vercel-Id	1	arn1::48lgj-1774362949545-1e1ed2789ab7
X-Vercel-Id	1	arn1::r9kjn-1774362948379-a6d48ccbff81
X-Vercel-Id	1	arn1::45qvs-1774362949767-a76c64712c53
X-Vercel-Id	1	arn1::45qvs-1774362949146-107633376453
X-Vercel-Id	1	arn1::bqrlz-1774362950346-9203144c93fd
X-Vercel-Id	1	arn1::fg8ls-1774362949946-06b20a767716
X-Vercel-Id	1	arn1::6pxjs-1774362949867-9f5798b39737
X-Vercel-Id	1	arn1::bqrlz-1774362948745-af9412007be5
X-Vercel-Id	1	arn1::fg8ls-1774362949687-7dca424909be
X-Vercel-Id	1	arn1::vcb87-1774362947794-051e71b71bf9
X-Vercel-Id	1	arn1::fg8ls-1774362949099-0f948369a883
X-Vercel-Id	1	arn1::48lgj-1774362948948-a4c7f4200d74
X-Vercel-Id	1	arn1::7vgmg-1774362949390-deb92a8a6b03
X-Vercel-Id	1	arn1::btcsp-1774362950063-06e334ff548f
X-XSS-Protection	30	1; mode=block
No rows found, please edit your search term.

(+) Show entire table

HTTP Caching by content type (only from crawlable domains)

Content type	Cache type	URLs 🔽	AVG lifetime	MIN lifetime	MAX lifetime
HTML	Cache-Control + ETag + Last-Modified	30	0 s	0 s	0 s

HTTP Caching by domain

Domain	Cache type	URLs 🔽	AVG lifetime	MIN lifetime	MAX lifetime
spider.cloud	Cache-Control + ETag + Last-Modified	30	0 s	0 s	0 s

HTTP Caching by domain and content type

Domain	Content type	Cache type	URLs 🔽	AVG lifetime	MIN lifetime	MAX lifetime
spider.cloud	HTML	Cache-Control + ETag + Last-Modified	30	0 s	0 s	0 s

DNS info

DNS resolving tree
spider.cloud
IPv4: 76.76.21.21

DNS server: 127.0.0.53

SSL/TLS info

Info	Text
Issuer	C = US, O = Let's Encrypt, CN = R13
Subject	CN = spider.cloud
Valid from	Mar 8 00:19:44 2026 GMT (VALID already 16.6 day(s))
Valid to	Jun 6 00:19:43 2026 GMT (VALID still for 73.4 day(s))
Supported protocols	TLSv1.2, TLSv1.3
RAW certificate output	Certificate: Data: Version: 3 (0x2) Serial Number: 06:85:6c:50:99:17:98:79:48:80:64:5e:c8:c2:41:aa:ae:a3 Signature Algorithm: sha256WithRSAEncryption Issuer: C = US, O = Let's Encrypt, CN = R13 Validity Not Before: Mar 8 00:19:44 2026 GMT Not After : Jun 6 00:19:43 2026 GMT Subject: CN = spider.cloud Subject Public Key Info: Public Key Algorithm: rsaEncryption Public-Key: (2048 bit) Modulus: 00:f7:9f:8f:aa:40:6f:0c:5d:15:c7:56:2f:2d:3a: 14:22:61:da:c6:1c:82:82:8b:87:4e:e7:27:4e:b9: 28:cd:2e:f7:a8:dd:4a:fd:b5:db:e8:06:7e:cf:1c: 3f:b6:88:7e:3d:50:48:fd:2c:3b:3c:15:60:f0:37: 03:52:a9:c0:86:4e:79:0d:ea:95:d9:9c:c7:e6:43: ba:e6:e2:be:c3:fa:3d:e5:88:d9:e5:e6:c4:2b:08: 86:4c:98:bf:f3:0c:65:85:62:8a:9f:1e:4a:61:9c: fb:d4:d7:0f:7e:36:03:a7:5a:7f:36:1f:b5:63:90: 38:0f:70:07:e4:e8:15:e5:01:d2:45:ae:ef:c6:ed: 4d:ef:61:2e:6d:53:b9:bb:94:39:a1:b6:30:f1:23: 7b:48:f1:a0:c9:c3:6b:e3:18:82:a7:0e:02:16:9a: 65:ff:0f:ce:44:88:73:c3:eb:f9:2b:f0:56:88:cf: 31:a8:9d:94:0b:cf:eb:64:87:ac:93:85:03:02:bd: 51:e9:97:02:7c:66:ad:6b:7a:c7:e5:48:69:e1:72: 11:55:08:c8:5c:7b:f9:4d:31:d4:50:b4:32:00:32: 12:51:3a:14:e6:34:29:24:3b:54:0f:0a:05:ad:bf: 55:cd:5d:a1:92:1d:a1:f1:dd:74:81:21:44:4f:8b: 05:95 Exponent: 65537 (0x10001) X509v3 extensions: X509v3 Key Usage: critical Digital Signature, Key Encipherment X509v3 Extended Key Usage: TLS Web Server Authentication X509v3 Basic Constraints: critical CA:FALSE X509v3 Subject Key Identifier: F6:AE:51:EE:BB:7B:79:3E:6E:CC:40:FF:08:DE:A7:40:FA:B3:0D:17 X509v3 Authority Key Identifier: E7:AB:9F:0F:2C:33:A0:53:D3:5E:4F:78:C8:B2:84:0E:3B:D6:92:33 Authority Information Access: CA Issuers - URI:http://r13.i.lencr.org/ X509v3 Subject Alternative Name: DNS:spider.cloud X509v3 Certificate Policies: Policy: 2.23.140.1.2.1 X509v3 CRL Distribution Points: Full Name: URI:http://r13.c.lencr.org/36.crl CT Precertificate SCTs: Signed Certificate Timestamp: Version : v1 (0x0) Log ID : 49:9C:9B:69:DE:1D:7C:EC:FC:36:DE:CD:87:64:A6:B8: 5B:AF:0A:87:80:19:D1:55:52:FB:E9:EB:29:DD:F8:C3 Timestamp : Mar 8 01:18:14.281 2026 GMT Extensions: none Signature : ecdsa-with-SHA256 30:46:02:21:00:AF:55:42:A8:3E:50:4A:C4:55:63:32: 36:FC:7B:87:48:A0:4E:AB:C5:E8:85:0E:68:D1:0A:C3: CC:02:ED:BB:9A:02:21:00:92:CA:12:5F:D7:3E:17:55: 3F:AD:5B:8A:2E:9B:2D:E2:44:CB:8F:65:8B:40:85:8D: AE:A2:3F:62:B9:17:0B:CA Signed Certificate Timestamp: Version : v1 (0x0) Log ID : 71:7E:95:F3:C2:38:8A:6D:B1:E3:84:49:3D:31:E1:5A: A9:62:08:76:2D:42:00:E0:05:0C:D0:67:B5:A6:61:E2 Timestamp : Mar 8 01:18:14.408 2026 GMT Extensions: 00:00:05:00:0B:24:81:78 Signature : ecdsa-with-SHA256 30:46:02:21:00:C5:28:63:94:E2:BC:0C:81:E7:99:CC: 49:27:A5:4E:A4:18:E5:EB:BA:FB:A7:05:E1:C8:BF:9D: 74:32:09:A3:38:02:21:00:DD:57:E3:9E:0D:0F:32:F0: B6:A7:93:CA:71:5D:CB:20:EA:AF:AC:A2:C6:C0:82:75: F6:9F:E5:99:87:9C:2F:8C Signature Algorithm: sha256WithRSAEncryption Signature Value: 20:19:3c:ed:82:e9:8d:93:43:5e:01:3d:61:bc:f7:83:b9:15: d3:70:1b:1c:1c:e2:19:8f:5c:37:c8:31:77:68:10:92:7d:df: 65:59:9b:cb:ba:f6:b7:18:49:14:a4:e0:01:c6:84:3b:ad:1f: e1:30:f0:31:51:13:f4:2c:ec:ed:6e:66:85:27:9c:33:79:34: c6:3c:b5:df:2b:18:fa:f3:5f:d1:7e:21:84:8a:78:e6:c8:9b: 4c:c9:f9:2f:97:ba:b9:4a:e0:1b:69:95:ed:f2:4c:f5:ad:30: 31:d6:e6:5f:55:98:90:2c:2f:4c:e6:45:23:10:92:72:69:25: 39:0f:6a:ca:b6:e8:66:2a:1e:83:48:ca:54:e3:a9:e0:ad:c5: 2f:77:36:9b:01:f3:fd:d6:04:2d:a7:d7:bd:99:32:54:6f:c7: 33:a0:e0:43:8e:33:5f:8d:23:11:5d:83:18:cf:c1:62:a8:40: 34:c8:91:74:bf:e8:05:01:d2:24:a5:ef:2f:7f:32:51:40:51: 53:57:0f:cb:b7:a1:d1:a3:39:a2:17:2d:35:b7:1e:36:9b:f9: f0:7a:6c:e4:ab:14:3e:ec:54:0a:3f:0b:be:38:7c:1d:19:79: 39:c1:1b:20:b6:b8:05:d9:82:37:9e:51:de:a9:ec:1b:b2:94: a0:46:d5:4f
RAW protocols output	=== ssl2 === s_client: Unknown option: -ssl2 s_client: Use -help for summary. === ssl3 === s_client: Unknown option: -ssl3 s_client: Use -help for summary. === tls1 === 40076C83977B0000:error:0A0000BF:SSL routines:tls_setup_handshake:no protocols available:../ssl/statem/statem_lib.c:104: CONNECTED(00000003) --- no peer certificate available --- No client certificate CA names sent --- SSL handshake has read 0 bytes and written 7 bytes Verification: OK --- New, (NONE), Cipher is (NONE) Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) --- === tls1_1 === 40873AD37E7E0000:error:0A0000BF:SSL routines:tls_setup_handshake:no protocols available:../ssl/statem/statem_lib.c:104: CONNECTED(00000003) --- no peer certificate available --- No client certificate CA names sent --- SSL handshake has read 0 bytes and written 7 bytes Verification: OK --- New, (NONE), Cipher is (NONE) Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) --- === tls1_2 === depth=2 C = US, O = Internet Security Research Group, CN = ISRG Root X1 verify return:1 depth=1 C = US, O = Let's Encrypt, CN = R13 verify return:1 depth=0 CN = spider.cloud verify return:1 CONNECTED(00000003) --- Certificate chain 0 s:CN = spider.cloud i:C = US, O = Let's Encrypt, CN = R13 a:PKEY: rsaEncryption, 2048 (bit); sigalg: RSA-SHA256 v:NotBefore: Mar 8 00:19:44 2026 GMT; NotAfter: Jun 6 00:19:43 2026 GMT 1 s:C = US, O = Let's Encrypt, CN = R13 i:C = US, O = Internet Security Research Group, CN = ISRG Root X1 a:PKEY: rsaEncryption, 2048 (bit); sigalg: RSA-SHA256 v:NotBefore: Mar 13 00:00:00 2024 GMT; NotAfter: Mar 12 23:59:59 2027 GMT --- Server certificate -----BEGIN CERTIFICATE----- MIIE9DCCA9ygAwIBAgISBoVsUJkXmHlIgGReyMJBqq6jMA0GCSqGSIb3DQEBCwUA MDMxCzAJBgNVBAYTAlVTMRYwFAYDVQQKEw1MZXQncyBFbmNyeXB0MQwwCgYDVQQD EwNSMTMwHhcNMjYwMzA4MDAxOTQ0WhcNMjYwNjA2MDAxOTQzWjAXMRUwEwYDVQQD EwxzcGlkZXIuY2xvdWQwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQD3 n4+qQG8MXRXHVi8tOhQiYdrGHIKCi4dO5ydOuSjNLveo3Ur9tdvoBn7PHD+2iH49 UEj9LDs8FWDwNwNSqcCGTnkN6pXZnMfmQ7rm4r7D+j3liNnl5sQrCIZMmL/zDGWF YoqfHkphnPvU1w9+NgOnWn82H7VjkDgPcAfk6BXlAdJFru/G7U3vYS5tU7m7lDmh tjDxI3tI8aDJw2vjGIKnDgIWmmX/D85EiHPD6/kr8FaIzzGonZQLz+tkh6yThQMC vVHplwJ8Zq1resflSGnhchFVCMhce/lNMdRQtDIAMhJROhTmNCkkO1QPCgWtv1XN XaGSHaHx3XSBIURPiwWVAgMBAAGjggIcMIICGDAOBgNVHQ8BAf8EBAMCBaAwEwYD VR0lBAwwCgYIKwYBBQUHAwEwDAYDVR0TAQH/BAIwADAdBgNVHQ4EFgQU9q5R7rt7 eT5uzED/CN6nQPqzDRcwHwYDVR0jBBgwFoAU56ufDywzoFPTXk94yLKEDjvWkjMw MwYIKwYBBQUHAQEEJzAlMCMGCCsGAQUFBzAChhdodHRwOi8vcjEzLmkubGVuY3Iu b3JnLzAXBgNVHREEEDAOggxzcGlkZXIuY2xvdWQwEwYDVR0gBAwwCjAIBgZngQwB AgEwLgYDVR0fBCcwJTAjoCGgH4YdaHR0cDovL3IxMy5jLmxlbmNyLm9yZy8zNi5j cmwwggEOBgorBgEEAdZ5AgQCBIH/BIH8APoAdwBJnJtp3h187Pw23s2HZKa4W68K h4AZ0VVS++nrKd34wwAAAZzLBgEJAAAEAwBIMEYCIQCvVUKoPlBKxFVjMjb8e4dI oE6rxeiFDmjRCsPMAu27mgIhAJLKEl/XPhdVP61bii6bLeJEy49li0CFja6iP2K5 FwvKAH8AcX6V88I4im2x44RJPTHhWqliCHYtQgDgBQzQZ7WmYeIAAAGcywYBiAAI AAAFAAskgXgEAwBIMEYCIQDFKGOU4rwMgeeZzEknpU6kGOXruvunBeHIv510Mgmj OAIhAN1X454NDzLwtqeTynFdyyDqr6yixsCCdfaf5ZmHnC+MMA0GCSqGSIb3DQEB CwUAA4IBAQAgGTztgumNk0NeAT1hvPeDuRXTcBscHOIZj1w3yDF3aBCSfd9lWZvL uva3GEkUpOABxoQ7rR/hMPAxURP0LOztbmaFJ5wzeTTGPLXfKxj681/RfiGEinjm yJtMyfkvl7q5SuAbaZXt8kz1rTAx1uZfVZiQLC9M5kUjEJJyaSU5D2rKtuhmKh6D SMpU46ngrcUvdzabAfP91gQtp9e9mTJUb8czoOBDjjNfjSMRXYMYz8FiqEA0yJF0 v+gFAdIkpe8vfzJRQFFTVw/Lt6HRozmiFy01tx42m/nwemzkqxQ+7FQKPwu+OHwd GXk5wRsgtrgF2YI3nlHeqewbspSgRtVP -----END CERTIFICATE----- subject=CN = spider.cloud issuer=C = US, O = Let's Encrypt, CN = R13 --- No client certificate CA names sent Peer signing digest: SHA256 Peer signature type: RSA-PSS Server Temp Key: X25519, 253 bits --- SSL handshake has read 3154 bytes and written 302 bytes Verification: OK --- New, TLSv1.2, Cipher is ECDHE-RSA-AES128-GCM-SHA256 Server public key is 2048 bit Secure Renegotiation IS supported Compression: NONE Expansion: NONE No ALPN negotiated SSL-Session: Protocol : TLSv1.2 Cipher : ECDHE-RSA-AES128-GCM-SHA256 Session-ID: D9CC60AD4A6114475AB52C94600A041E229256D2CE4AC3414813024385ABE5A1 Session-ID-ctx: Master-Key: 1E7FE283DD1065E77713244A67A6275EBDA9F4FE728460990240B5EDF8665B475EE46D937A0E9CEF98EC849DDF4DFA1E PSK identity: None PSK identity hint: None SRP username: None TLS session ticket: 0000 - e0 57 10 4f d8 f4 72 42-a3 db 8d f2 1a b4 ad f7 .W.O..rB........ 0010 - 10 cf 7a 43 3b f4 bb dc-ce e4 59 c1 df b1 a6 c6 ..zC;.....Y..... 0020 - 46 44 b8 83 3c 4d 8b 8f-2c 7e 88 42 67 a1 30 f9 FD.. 0030 - 01 c7 99 0c 52 60 ea c9-68 6f ea 19 81 1c 56 c2 ....R`..ho....V. 0040 - 7b a7 80 bc 2c c2 4f 2f-a7 61 02 d5 75 db 24 73 {...,.O/.a..u.$s 0050 - 56 7e b5 41 17 24 23 2f-0a f1 0a 55 42 4f c4 c2 V~.A.$#/...UBO.. 0060 - 95 a7 94 6a 8f 39 ba f3-c7 c4 57 40 a6 45 c0 2d ...j.9....W@.E.- 0070 - 2b c1 61 0d 3d 64 69 05-5c 1b 91 +.a.=di.\.. Start Time: 1774362951 Timeout : 7200 (sec) Verify return code: 0 (ok) Extended master secret: yes --- DONE === tls1_3 === depth=2 C = US, O = Internet Security Research Group, CN = ISRG Root X1 verify return:1 depth=1 C = US, O = Let's Encrypt, CN = R13 verify return:1 depth=0 CN = spider.cloud verify return:1 CONNECTED(00000003) --- Certificate chain 0 s:CN = spider.cloud i:C = US, O = Let's Encrypt, CN = R13 a:PKEY: rsaEncryption, 2048 (bit); sigalg: RSA-SHA256 v:NotBefore: Mar 8 00:19:44 2026 GMT; NotAfter: Jun 6 00:19:43 2026 GMT 1 s:C = US, O = Let's Encrypt, CN = R13 i:C = US, O = Internet Security Research Group, CN = ISRG Root X1 a:PKEY: rsaEncryption, 2048 (bit); sigalg: RSA-SHA256 v:NotBefore: Mar 13 00:00:00 2024 GMT; NotAfter: Mar 12 23:59:59 2027 GMT --- Server certificate -----BEGIN CERTIFICATE----- MIIE9DCCA9ygAwIBAgISBoVsUJkXmHlIgGReyMJBqq6jMA0GCSqGSIb3DQEBCwUA MDMxCzAJBgNVBAYTAlVTMRYwFAYDVQQKEw1MZXQncyBFbmNyeXB0MQwwCgYDVQQD EwNSMTMwHhcNMjYwMzA4MDAxOTQ0WhcNMjYwNjA2MDAxOTQzWjAXMRUwEwYDVQQD EwxzcGlkZXIuY2xvdWQwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQD3 n4+qQG8MXRXHVi8tOhQiYdrGHIKCi4dO5ydOuSjNLveo3Ur9tdvoBn7PHD+2iH49 UEj9LDs8FWDwNwNSqcCGTnkN6pXZnMfmQ7rm4r7D+j3liNnl5sQrCIZMmL/zDGWF YoqfHkphnPvU1w9+NgOnWn82H7VjkDgPcAfk6BXlAdJFru/G7U3vYS5tU7m7lDmh tjDxI3tI8aDJw2vjGIKnDgIWmmX/D85EiHPD6/kr8FaIzzGonZQLz+tkh6yThQMC vVHplwJ8Zq1resflSGnhchFVCMhce/lNMdRQtDIAMhJROhTmNCkkO1QPCgWtv1XN XaGSHaHx3XSBIURPiwWVAgMBAAGjggIcMIICGDAOBgNVHQ8BAf8EBAMCBaAwEwYD VR0lBAwwCgYIKwYBBQUHAwEwDAYDVR0TAQH/BAIwADAdBgNVHQ4EFgQU9q5R7rt7 eT5uzED/CN6nQPqzDRcwHwYDVR0jBBgwFoAU56ufDywzoFPTXk94yLKEDjvWkjMw MwYIKwYBBQUHAQEEJzAlMCMGCCsGAQUFBzAChhdodHRwOi8vcjEzLmkubGVuY3Iu b3JnLzAXBgNVHREEEDAOggxzcGlkZXIuY2xvdWQwEwYDVR0gBAwwCjAIBgZngQwB AgEwLgYDVR0fBCcwJTAjoCGgH4YdaHR0cDovL3IxMy5jLmxlbmNyLm9yZy8zNi5j cmwwggEOBgorBgEEAdZ5AgQCBIH/BIH8APoAdwBJnJtp3h187Pw23s2HZKa4W68K h4AZ0VVS++nrKd34wwAAAZzLBgEJAAAEAwBIMEYCIQCvVUKoPlBKxFVjMjb8e4dI oE6rxeiFDmjRCsPMAu27mgIhAJLKEl/XPhdVP61bii6bLeJEy49li0CFja6iP2K5 FwvKAH8AcX6V88I4im2x44RJPTHhWqliCHYtQgDgBQzQZ7WmYeIAAAGcywYBiAAI AAAFAAskgXgEAwBIMEYCIQDFKGOU4rwMgeeZzEknpU6kGOXruvunBeHIv510Mgmj OAIhAN1X454NDzLwtqeTynFdyyDqr6yixsCCdfaf5ZmHnC+MMA0GCSqGSIb3DQEB CwUAA4IBAQAgGTztgumNk0NeAT1hvPeDuRXTcBscHOIZj1w3yDF3aBCSfd9lWZvL uva3GEkUpOABxoQ7rR/hMPAxURP0LOztbmaFJ5wzeTTGPLXfKxj681/RfiGEinjm yJtMyfkvl7q5SuAbaZXt8kz1rTAx1uZfVZiQLC9M5kUjEJJyaSU5D2rKtuhmKh6D SMpU46ngrcUvdzabAfP91gQtp9e9mTJUb8czoOBDjjNfjSMRXYMYz8FiqEA0yJF0 v+gFAdIkpe8vfzJRQFFTVw/Lt6HRozmiFy01tx42m/nwemzkqxQ+7FQKPwu+OHwd GXk5wRsgtrgF2YI3nlHeqewbspSgRtVP -----END CERTIFICATE----- subject=CN = spider.cloud issuer=C = US, O = Let's Encrypt, CN = R13 --- No client certificate CA names sent Peer signing digest: SHA256 Peer signature type: RSA-PSS Server Temp Key: X25519, 253 bits --- SSL handshake has read 3110 bytes and written 310 bytes Verification: OK --- New, TLSv1.3, Cipher is TLS_AES_128_GCM_SHA256 Server public key is 2048 bit Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) --- DONE --- Post-Handshake New Session Ticket arrived: SSL-Session: Protocol : TLSv1.3 Cipher : TLS_AES_128_GCM_SHA256 Session-ID: EA004DD17EE274B228C9913D0C65E6C90B0E2BCACABBCE434AE117BB61F9A88C Session-ID-ctx: Resumption PSK: 45C8F2318B334412F4215FE8B5946280A324A499761B5735729577333893082B PSK identity: None PSK identity hint: None SRP username: None TLS session ticket lifetime hint: 604800 (seconds) TLS session ticket: 0000 - f2 57 e5 94 a9 a8 f1 2b-3d ba 2b 25 0c 50 cc 0d .W.....+=.+%.P.. 0010 - 52 f4 01 9b a5 75 a5 de-1e 0f 62 31 dc 63 d8 73 R....u....b1.c.s 0020 - a2 46 c8 a5 25 9b 66 d3-8e f7 a6 bd 88 ad 7f 10 .F..%.f......... 0030 - ca a1 10 b1 fc 75 91 04-42 fc d5 9a 8f 6f 59 43 .....u..B....oYC 0040 - 26 0c 2f 48 8d 91 5c 1e-5a fd 34 6f 16 23 3b e7 &./H..\.Z.4o.#;. 0050 - 70 85 01 83 09 7a 83 d2-b6 bc 59 43 36 ce b6 d0 p....z....YC6... 0060 - 1c 62 cb de bd a8 79 d3-de .b....y.. Start Time: 1774362951 Timeout : 7200 (sec) Verify return code: 0 (ok) Extended master secret: no Max Early Data: 0 --- read R BLOCK

Crawler stats

Basic stats
Total execution time	6.4 s
Total URLs	30
Total size	3 MB
Requests - total time	8.4 s
Requests - avg time	279 ms
Requests - min time	21 ms
Requests - max time	543 ms
Requests by status	200: 28 404: 2

Analysis stats

Found 21 row(s).

Class::method	Exec time 🔽	Exec count
SslTlsAnalyzer::getTLSandSSLCertificateInfo	385 ms	1
AccessibilityAnalyzer::checkMissingLabels	53 ms	28
AccessibilityAnalyzer::checkMissingAriaLabels	52 ms	28
BestPracticeAnalyzer::checkHeadingStructure	50 ms	30
AccessibilityAnalyzer::checkMissingRoles	40 ms	28
BestPracticeAnalyzer::checkMaxDOMDepth	39 ms	30
AccessibilityAnalyzer::checkMissingLang	37 ms	28
BestPracticeAnalyzer::checkNonClickablePhoneNumbers	33 ms	30
BestPracticeAnalyzer::checkInlineSvg	18 ms	30
BestPracticeAnalyzer::checkMissingQuotesOnAttributes	6 ms	30
SeoAndOpenGraphAnalyzer::analyzeHeadings	5 ms	1
SecurityAnalyzer::checkHtmlSecurity	1 ms	30
AccessibilityAnalyzer::checkImageAltAttributes	1 ms	28
SecurityAnalyzer::checkHeaders	0 ms	30
SeoAndOpenGraphAnalyzer::analyzeSeo	0 ms	1
SeoAndOpenGraphAnalyzer::analyzeOpenGraph	0 ms	1
BestPracticeAnalyzer::checkTitleUniqueness	0 ms	1
BestPracticeAnalyzer::checkMetaDescriptionUniqueness	0 ms	1
BestPracticeAnalyzer::checkBrotliSupport	0 ms	1
BestPracticeAnalyzer::checkWebpSupport	0 ms	1
BestPracticeAnalyzer::checkAvifSupport	0 ms	1
No rows found, please edit your search term.

(+) Show entire table

Content processor stats

Found 12 row(s).

Class::method	Exec time 🔽	Exec count
HtmlProcessor::findUrls	613 ms	30
AstroProcessor::findUrls	166 ms	30
NextJsProcessor::applyContentChangesBeforeUrlParsing	15 ms	30
JavaScriptProcessor::findUrls	10 ms	30
CssProcessor::findUrls	2 ms	30
AstroProcessor::applyContentChangesBeforeUrlParsing	0 ms	30
NextJsProcessor::findUrls	0 ms	30
JavaScriptProcessor::applyContentChangesBeforeUrlParsing	0 ms	30
SvelteProcessor::applyContentChangesBeforeUrlParsing	0 ms	30
SvelteProcessor::findUrls	0 ms	30
CssProcessor::applyContentChangesBeforeUrlParsing	0 ms	30
HtmlProcessor::applyContentChangesBeforeUrlParsing	0 ms	30
No rows found, please edit your search term.

Crawler info

Version	2.1.0.20260317
Executed At	2026-03-24 14:35:45
Command	siteone-crawler --url=https://spider.cloud/docs --markdown-export-dir=/tmp/siteone-spider --markdown-exclude-selector=header,footer,nav,.sidebar,.menu,.breadcrumb,script,style --timeout=30 --workers=5 --disable-javascript --disable-styles --disable-fonts --disable-images --disable-files --no-color --hide-progress-bar --output=text --include-regex=/docs/
Hostname	ubuntu-8gb-hel1-1
User-Agent	Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/26.0.0.0 Safari/537.36 siteone-crawler/2.1.0.20260317