#### #### ##### #### #### ####### #### ### #### ######### #### ###### #### ###### #### ###################### ##### #### ####### ####### ##### #### ####### ####### # #### ###################### #### #### ###### #### #### #### ## #### #### #### #### ################## #### #### ################## ================================================== # SiteOne Crawler, v2.1.0.20260317 # # Author: jan.reges@siteone.cz # ================================================== Detected terminal width 138 < 140 chars - compact mode activated. URL | Status | Type | Time | Size | Cache | Access. | Best pr. ------------------------------------------------------------------------------------------------------------------------------------ /docs | 404 | HTML | 543 ms | 50 kB | 0 s | | 7 /docs/overview | 200 | HTML | 303 ms | 140 kB | 0 s | 1/2/2 | 7 /docs/api | 200 | HTML | 265 ms | 188 kB | 0 s | 1/2/2 | 7 /docs/core/webhooks | 200 | HTML | 294 ms | 88 kB | 0 s | 2/2 | 7 /docs/core/data-connectors | 200 | HTML | 275 ms | 126 kB | 0 s | 2/2 | 7 /docs/advanced/json-scraping | 200 | HTML | 496 ms | 80 kB | 0 s | 2/2 | 7 /docs/guides/recipes | 200 | HTML | 251 ms | 119 kB | 0 s | 2/2 | 1/6 /docs/integrations/flowiseai | 200 | HTML | 332 ms | 73 kB | 0 s | 2/2 | 1/6 /docs/core/scraping-crawling | 200 | HTML | 187 ms | 93 kB | 0 s | 2/2 | 7 /docs/integrations/langchain | 200 | HTML | 249 ms | 83 kB | 0 s | 2/2 | 7 /docs/concepts | 200 | HTML | 273 ms | 84 kB | 0 s | 2/2 | 7 /docs/integrations/agno | 200 | HTML | 275 ms | 80 kB | 0 s | 2/2 | 7 /docs/core/search | 404 | HTML | 21 ms | 50 kB | 0 s | | 7 /docs/core/reliability | 200 | HTML | 266 ms | 105 kB | 0 s | 2/2 | 7 /docs/integrations/overview | 200 | HTML | 259 ms | 117 kB | 0 s | 2/2 | 1/7 /docs/integrations/llamaindex | 200 | HTML | 272 ms | 78 kB | 0 s | 2/2 | 7 /docs/core/efficient-scraping | 200 | HTML | 244 ms | 85 kB | 0 s | 2/2 | 7 /docs/core/spider-browser | 200 | HTML | 246 ms | 98 kB | 0 s | 2/2 | 7 /docs/guides/use-cases | 200 | HTML | 299 ms | 77 kB | 0 s | 2/2 | 7 /docs/integrations/crewai | 200 | HTML | 268 ms | 85 kB | 0 s | 2/2 | 7 /docs/quickstart | 200 | HTML | 257 ms | 97 kB | 0 s | 1/2/2 | 7 /docs/core/concurrent-streaming | 200 | HTML | 221 ms | 80 kB | 0 s | 2/2 | 7 /docs/integrations/zapier | 200 | HTML | 282 ms | 78 kB | 0 s | 2/2 | 7 /docs/core/authentication | 200 | HTML | 284 ms | 87 kB | 0 s | 2/2 | 7 /docs/libraries | 200 | HTML | 276 ms | 92 kB | 0 s | 2/2 | 7 /docs/integrations/mcp | 200 | HTML | 267 ms | 95 kB | 0 s | 2/2 | 1/6 /docs/integrations/x402 | 200 | HTML | 297 ms | 90 kB | 0 s | 2/2 | 1/6 /docs/core/error-codes | 200 | HTML | 226 ms | 86 kB | 0 s | 2/2 | 7 /docs/core/rate-limits | 200 | HTML | 387 ms | 84 kB | 0 s | 2/2 | 7 /docs/core/realtime-search | 200 | HTML | 253 ms | 94 kB | 0 s | 2/2 | 7 Skipped URLs Summary -------------------- Reason | Domain | Unique URLs -------------------------------------------------------------- Not allowed host | github.com | 10 Not allowed host | zapier.com | 3 Not allowed host | www.npmjs.com | 2 Not allowed host | doc.rust-lang.org | 1 Not allowed host | python.langchain.com | 1 Not allowed host | microsoft.github.io | 1 Not allowed host | modelcontextprotocol.io | 1 Not allowed host | discord.gg | 1 Not allowed host | langchain.com | 1 Not allowed host | x402.org | 1 Not allowed host | ahrefs.com | 1 Not allowed host | developer.mozilla.org | 1 Not allowed host | www.json.org | 1 Not allowed host | docs.crewai.com | 1 Not allowed host | docs.llamaindex.ai | 1 Not allowed host | www.agno.com | 1 Not allowed host | docs.agno.com | 1 Not allowed host | docs.julep.ai | 1 Not allowed host | flowiseai.com | 1 Not allowed host | pypi.org | 1 Not allowed host | pipedream.com | 1 Not allowed host | spidercloud.statuspage.io | 1 Not allowed host | docs.composio.dev | 1 Not allowed host | docs.rs | 1 Not allowed host | www.linkedin.com | 1 Not allowed host | twitter.com | 1 Not allowed host | llamaindex.ai | 1 Not allowed host | www.base.org | 1 Not allowed host | crewai.ai | 1 Skipped URLs ------------ Reason | Skipped URL | Source | Found at URL ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Not allowed host | http://www.json.org/ | | /docs/api Not allowed host | https://ahrefs.com/blog/google-advanced-search-operators/ | | /docs/core/realtime-search Not allowed host | https://crewai.ai/ | | /docs/integrations/crewai Not allowed host | https://developer.mozilla.org/en-US/docs…/Service_Worker_API | | /docs/api Not allowed host | https://discord.gg/5jpNWhEZRw | | /docs Not allowed host | https://doc.rust-lang.org/cargo/commands/cargo-install.html | | /docs/libraries Not allowed host | https://docs.agno.com/first-agent | | /docs/integrations/agno Not allowed host | https://docs.composio.dev/introduction/f…ts/list_local_tools | | /docs/integrations/overview Not allowed host | https://docs.crewai.com/concepts/tasks | | /docs/integrations/crewai Not allowed host | https://docs.julep.ai/docs/integrations/…r_automation/spider | | /docs/integrations/overview Not allowed host | https://docs.llamaindex.ai/en/stable/get…arted/installation/ | | /docs/integrations/llamaindex Not allowed host | https://docs.rs/spider/latest/spider/ | | /docs Not allowed host | https://flowiseai.com/ | | /docs/integrations/flowiseai Not allowed host | https://github.com/coinbase/x402 | | /docs/integrations/x402 Not allowed host | https://github.com/mozilla/readability | | /docs/api Not allowed host | https://github.com/spider-rs/spider | | /docs Not allowed host | https://github.com/spider-rs/spider-browser | | /docs/core/spider-browser Not allowed host | https://github.com/spider-rs/spider-clients/tree/main/cli | | /docs/overview Not allowed host | https://github.com/spider-rs/spider-clients/tree/main/go | | /docs/libraries Not allowed host | https://github.com/spider-rs/spider-clie…ree/main/javascript | | /docs/overview Not allowed host | https://github.com/spider-rs/spider-clients/tree/main/python | | /docs/overview Not allowed host | https://github.com/spider-rs/spider-clients/tree/main/rust | | /docs/overview Not allowed host | https://github.com/spider-rs/spider-mcp | | /docs/integrations/mcp Not allowed host | https://langchain.com/ | | /docs/integrations/langchain Not allowed host | https://llamaindex.ai/ | | /docs/integrations/llamaindex Not allowed host | https://microsoft.github.io/autogen/0.2/…awling_with_spider/ | | /docs/integrations/overview Not allowed host | https://modelcontextprotocol.io/ | | /docs/integrations/mcp Not allowed host | https://pipedream.com/apps/spider | | /docs/integrations/overview Not allowed host | https://pypi.org/project/requests/ | | /docs/core/efficient-scraping Not allowed host | https://python.langchain.com/docs/how_to/installation/ | | /docs/integrations/langchain Not allowed host | https://spidercloud.statuspage.io/ | | /docs Not allowed host | https://twitter.com/spider_rust | | /docs Not allowed host | https://www.agno.com/ | | /docs/integrations/agno Not allowed host | https://www.base.org/ | | /docs/integrations/x402 Not allowed host | https://www.linkedin.com/company/spider-cloud/?_l=en_US | | /docs Not allowed host | https://www.npmjs.com/package/spider-browser | | /docs/overview Not allowed host | https://www.npmjs.com/package/spider-cloud-mcp | | /docs/integrations/mcp Not allowed host | https://x402.org/facilitator | | /docs/integrations/x402 Not allowed host | https://zapier.com/ | | /docs/integrations/zapier Not allowed host | https://zapier.com/apps/spider/integrations | | /docs/integrations/zapier Not allowed host | https://zapier.com/developer/public-invi…84b8ebe242735ff697/ | | /docs/integrations/zapier External URLs ------------- External URL | Pages | Found on URL (max 5) ------------------------------------------------------------------------------------------------------------------------------------- http://www.json.org/ | 1 | /docs/api https://ahrefs.com/blog/google-advanced-search-operators/ | 1 | /docs/core/realtime-search https://crewai.ai/ | 1 | /docs/integrations/crewai https://developer.mozilla.org/en-US/docs…/Service_Worker_API | 1 | /docs/api https://discord.gg/5jpNWhEZRw | 1 | /docs https://doc.rust-lang.org/cargo/commands/cargo-install.html | 1 | /docs/libraries https://docs.agno.com/first-agent | 1 | /docs/integrations/agno https://docs.composio.dev/introduction/f…ts/list_local_tools | 1 | /docs/integrations/overview https://docs.crewai.com/concepts/tasks | 1 | /docs/integrations/crewai https://docs.julep.ai/docs/integrations/…r_automation/spider | 1 | /docs/integrations/overview https://docs.llamaindex.ai/en/stable/get…arted/installation/ | 1 | /docs/integrations/llamaindex https://docs.rs/spider/latest/spider/ | 1 | /docs https://flowiseai.com/ | 1 | /docs/integrations/flowiseai https://github.com/coinbase/x402 | 1 | /docs/integrations/x402 https://github.com/mozilla/readability | 1 | /docs/api https://github.com/spider-rs/spider | 1 | /docs https://github.com/spider-rs/spider-browser | 1 | /docs/core/spider-browser https://github.com/spider-rs/spider-clients/tree/main/cli | 1 | /docs/overview https://github.com/spider-rs/spider-clients/tree/main/go | 1 | /docs/libraries https://github.com/spider-rs/spider-clie…ree/main/javascript | 1 | /docs/overview https://github.com/spider-rs/spider-clients/tree/main/python | 1 | /docs/overview https://github.com/spider-rs/spider-clients/tree/main/rust | 1 | /docs/overview https://github.com/spider-rs/spider-mcp | 1 | /docs/integrations/mcp https://langchain.com/ | 1 | /docs/integrations/langchain https://llamaindex.ai/ | 1 | /docs/integrations/llamaindex https://microsoft.github.io/autogen/0.2/…awling_with_spider/ | 1 | /docs/integrations/overview https://modelcontextprotocol.io/ | 1 | /docs/integrations/mcp https://pipedream.com/apps/spider | 1 | /docs/integrations/overview https://pypi.org/project/requests/ | 1 | /docs/core/efficient-scraping https://python.langchain.com/docs/how_to/installation/ | 1 | /docs/integrations/langchain https://spidercloud.statuspage.io/ | 1 | /docs https://twitter.com/spider_rust | 1 | /docs https://www.agno.com/ | 1 | /docs/integrations/agno https://www.base.org/ | 1 | /docs/integrations/x402 https://www.linkedin.com/company/spider-cloud/?_l=en_US | 1 | /docs https://www.npmjs.com/package/spider-browser | 1 | /docs/overview https://www.npmjs.com/package/spider-cloud-mcp | 1 | /docs/integrations/mcp https://x402.org/facilitator | 1 | /docs/integrations/x402 https://zapier.com/ | 1 | /docs/integrations/zapier https://zapier.com/apps/spider/integrations | 1 | /docs/integrations/zapier https://zapier.com/developer/public-invi…84b8ebe242735ff697/ | 1 | /docs/integrations/zapier Redirected URLs --------------- No redirects found. 404 URLs -------- Status | URL 404 | Found at URL ---------------------------------------------------------------------------------------------------------------------------------------- 404 | /docs | 404 | /docs/core/search | /docs/overview SSL/TLS info ------------ Info | Text --------------------------------------------------------------------------------------------------------------------------------------- Issuer | C = US, O = Let's Encrypt, CN = R13 Subject | CN = spider.cloud Valid from | Mar 8 00:19:44 2026 GMT (VALID already 16.6 day(s)) Valid to | Jun 6 00:19:43 2026 GMT (VALID still for 73.4 day(s)) Supported protocols | TLSv1.2, TLSv1.3 RAW certificate output | Certificate: Data: Version: 3 (0x2) Serial Number:…9:ec:1b:b2:94: a0:46:d5:4f RAW protocols output | === ssl2 === s_client: Unknown option: -ssl2 s_client: Use -help for su…Max Early Data: 0 --- read R BLOCK TOP fastest URLs ---------------- Time | Status | Fast URL ------------------------------------------------------------------------------------------------------------------------------------------ 187 ms | 200 | /docs/core/scraping-crawling 221 ms | 200 | /docs/core/concurrent-streaming 226 ms | 200 | /docs/core/error-codes 244 ms | 200 | /docs/core/efficient-scraping 246 ms | 200 | /docs/core/spider-browser 249 ms | 200 | /docs/integrations/langchain 251 ms | 200 | /docs/guides/recipes 253 ms | 200 | /docs/core/realtime-search 257 ms | 200 | /docs/quickstart 259 ms | 200 | /docs/integrations/overview 265 ms | 200 | /docs/api 267 ms | 200 | /docs/core/reliability 267 ms | 200 | /docs/integrations/mcp 269 ms | 200 | /docs/integrations/crewai 272 ms | 200 | /docs/integrations/llamaindex 273 ms | 200 | /docs/concepts 275 ms | 200 | /docs/core/data-connectors 275 ms | 200 | /docs/integrations/agno 276 ms | 200 | /docs/libraries 282 ms | 200 | /docs/integrations/zapier TOP slowest URLs ---------------- Time | Status | Slow URL ------------------------------------------------------------------------------------------------------------------------------------- 543 ms | 404 | /docs 496 ms | 200 | /docs/advanced/json-scraping 387 ms | 200 | /docs/core/rate-limits 332 ms | 200 | /docs/integrations/flowiseai 303 ms | 200 | /docs/overview 299 ms | 200 | /docs/guides/use-cases 297 ms | 200 | /docs/integrations/x402 294 ms | 200 | /docs/core/webhooks 284 ms | 200 | /docs/core/authentication 282 ms | 200 | /docs/integrations/zapier 276 ms | 200 | /docs/libraries 275 ms | 200 | /docs/integrations/agno 275 ms | 200 | /docs/core/data-connectors 273 ms | 200 | /docs/concepts 272 ms | 200 | /docs/integrations/llamaindex 269 ms | 200 | /docs/integrations/crewai 267 ms | 200 | /docs/integrations/mcp 267 ms | 200 | /docs/core/reliability 265 ms | 200 | /docs/api 259 ms | 200 | /docs/integrations/overview SEO metadata ------------ This table contains large data and shows max 10 rows. To see them all, use output to HTML using `--output-html-report=tmp/myreport.html`. URL | Indexing | Title | H1 | Description | Keywords --------------------------------------------------------------------------------------------------------------------------------------- /docs/advanced/json-scraping | Allowed | Advanced…der | JSON Scr…ing | Learn ho…es. | web scra…ion /docs/api | Allowed | Spider A…nce | API Refe…nce | Complete…em. | web scra…ion /docs/concepts | Allowed | Concepts…der | Key Concepts | Learn ab…ds. | web scra…ion /docs/core/authentication | Allowed | Authenti…der | Authenti…ion | Learn ho…ns. | web scra…ion /docs/core/concurrent-streaming | Allowed | Concurre…der | Concurre…ing | Unlock h…ce. | web scra…ion /docs/core/data-connectors | Allowed | Data Con…der | Data Con…ors | Stream c…se. | web scra…ion /docs/core/efficient-scraping | Allowed | Efficien…der | Efficien…ing | Learn ho…er. | web scra…ion /docs/core/error-codes | Allowed | Error Co…der | Error Codes | Learn ab…PI. | web scra…ion /docs/core/rate-limits | Allowed | Rate Lim…der | Rate Limits | Understa…rs. | web scra…ion /docs/core/realtime-search | Allowed | Realtime…der | Realtime…rch | Learn ho…er. | web scra…ion OpenGraph metadata ------------------ This table contains large data and shows max 10 rows. To see them all, use output to HTML using `--output-html-report=tmp/myreport.html`. URL | OG Title | OG Description | OG Image | Twitter Title | Twitter Description | Twitter Image -------------------------------------------------------------------------------------------------------------------------------------------------- /docs/advanced/json-scraping | Advance…er | Learn h…s. | /img/spider-og.png | Advance…er | | /img/spider-og.png /docs/api | Spider…ce | Complet…m. | /img/spider-og.png | Spider…ce | | /img/spider-og.png /docs/concepts | Concept…er | Learn a…s. | /img/spider-og.png | Concept…er | | /img/spider-og.png /docs/core/authentication | Authent…er | Learn h…s. | /img/spider-og.png | Authent…er | | /img/spider-og.png /docs/core/concurrent-streaming | Concurr…er | Unlock…e. | /img/spider-og.png | Concurr…er | | /img/spider-og.png /docs/core/data-connectors | Data Co…er | Stream…e. | /img/spider-og.png | Data Co…er | | /img/spider-og.png /docs/core/efficient-scraping | Efficie…er | Learn h…r. | /img/spider-og.png | Efficie…er | | /img/spider-og.png /docs/core/error-codes | Error C…er | Learn a…I. | /img/spider-og.png | Error C…er | | /img/spider-og.png /docs/core/rate-limits | Rate Li…er | Underst…s. | /img/spider-og.png | Rate Li…er | | /img/spider-og.png /docs/core/realtime-search | Realtim…er | Learn h…r. | /img/spider-og.png | Realtim…er | | /img/spider-og.png Heading structure ----------------- This table contains large data and shows max 10 rows. To see them all, use output to HTML using `--output-html-report=tmp/myreport.html`. Heading structure | Count | Errors | URL ----------------------------------------------------------------------------------------------------------------------------------------

Recipes [#recipes]

Crawl a Website [#crawl-a-w…ver-results-asynchronously] | 13 | 3 | /docs/guides/recipes

FlowiseAI Integration [#flowiseai-integration]

…d Crawl [#scrape-and-crawl] | 3 | 2 | /docs/integrations/flowiseai

Spider Developer Platform

How It Works [#how-i…Plans: What You Pay and Why | 29 | 0 | /docs/overview

API Reference [#api]

Authentication

Respo…meters [#common-parameters] | 4 | 0 | /docs/api

Webhooks [#webhooks]

Available Events [#availa…ebhooks [#discord-webhooks] | 5 | 0 | /docs/core/webhooks

Data Connectors [#data-connectors]

Supported C…tors [#multiple-connectors] | 9 | 0 | /docs/core/data-connectors

JSON Scraping [#json-scraping]

Extracting JSON…R data embedded in the HTML | 4 | 0 | /docs/advanced/json-scraping

Scraping and Crawling [#scraping-and-crawling]

…g Errors [#handling-errors] | 7 | 0 | /docs/core/scraping-crawling

LangChain Integration [#langchain-integration]

…meters [#custom-parameters] | 5 | 0 | /docs/integrations/langchain

Key Concepts [#key-concepts]

Crawling vs. Scra…ts System [#credits-system] | 9 | 0 | /docs/concepts HTTP headers ------------ Header | Occurs | Unique | Values preview | Min value | Max value ----------------------------------------------------------------------------------------------------------------------------- Access-Control-Allow-Origin | 30 | 1 | * | | Age | 30 | - | [ignored generic values] | 0 sec(s) | 1 sec(s) Cache-Control | 30 | 1 | public, max-age=0, must-revalidate | | Content-Disposition | 30 | - | [ignored generic values] | | Content-Security-Policy | 30 | 1 | default-src 'self'; script-src '…m-action 'self' | | Content-Type | 30 | 1 | text/html; charset=utf-8 | | Cross-Origin-Opener-Policy | 30 | 1 | same-origin | | Cross-Origin-Resource-Policy | 30 | 1 | cross-origin | | Date | 30 | - | [ignored generic values] | 2026-03-24 | 2026-03-24 Etag | 30 | - | [ignored generic values] | | Last-Modified | 30 | - | [ignored generic values] | 2026-03-24 | 2026-03-24 Permissions-Policy | 30 | 1 | camera=(), microphone=(), geoloc…=(), payment=() | | Referrer-Policy | 30 | 1 | strict-origin-when-cross-origin | | Server | 30 | 1 | Vercel | | Strict-Transport-Security | 30 | 1 | max-age=63072000 | | X-Content-Type-Options | 30 | 1 | nosniff | | X-Frame-Options | 30 | 1 | DENY | | X-Vercel-Cache | 30 | 1 | HIT | | X-Vercel-Id | 30 | 20+ | [see values below] | | X-XSS-Protection | 30 | 1 | 1; mode=block | | HTTP header values ------------------ Header | Occurs | Value ---------------------------------------------------------------------------------------------------------------------------- Access-Control-Allow-Origin | 30 | * Cache-Control | 30 | public, max-age=0, must-revalidate Content-Security-Policy | 30 | default-src 'self'; script-src 'self' 'unsafe-inline' '…'self'; form-action 'self' Content-Type | 30 | text/html; charset=utf-8 Cross-Origin-Opener-Policy | 30 | same-origin Cross-Origin-Resource-Policy | 30 | cross-origin Permissions-Policy | 30 | camera=(), microphone=(), geolocation=(), payment=() Referrer-Policy | 30 | strict-origin-when-cross-origin Server | 30 | Vercel Strict-Transport-Security | 30 | max-age=63072000 X-Content-Type-Options | 30 | nosniff X-Frame-Options | 30 | DENY X-Vercel-Cache | 30 | HIT X-Vercel-Id | 1 | arn1::dqkth-1774362949274-b4338479f0e3 X-Vercel-Id | 1 | arn1::hxqjc-1774362950145-d7178862ad04 X-Vercel-Id | 1 | arn1::gs4pq-1774362948846-8d393c7b8eec X-Vercel-Id | 1 | arn1::4x4xm-1774362950266-3261fb7b59a8 X-Vercel-Id | 1 | arn1::f7lq9-1774362948479-376d3bd49dd0 X-Vercel-Id | 1 | arn1::dqkth-1774362949451-2edba40e75be X-Vercel-Id | 1 | arn1::48lgj-1774362949545-1e1ed2789ab7 X-Vercel-Id | 1 | arn1::r9kjn-1774362948379-a6d48ccbff81 X-Vercel-Id | 1 | arn1::45qvs-1774362949767-a76c64712c53 X-Vercel-Id | 1 | arn1::45qvs-1774362949146-107633376453 X-Vercel-Id | 1 | arn1::bqrlz-1774362950346-9203144c93fd X-Vercel-Id | 1 | arn1::fg8ls-1774362949946-06b20a767716 X-Vercel-Id | 1 | arn1::6pxjs-1774362949867-9f5798b39737 X-Vercel-Id | 1 | arn1::bqrlz-1774362948745-af9412007be5 X-Vercel-Id | 1 | arn1::fg8ls-1774362949687-7dca424909be X-Vercel-Id | 1 | arn1::vcb87-1774362947794-051e71b71bf9 X-Vercel-Id | 1 | arn1::fg8ls-1774362949099-0f948369a883 X-Vercel-Id | 1 | arn1::48lgj-1774362948948-a4c7f4200d74 X-Vercel-Id | 1 | arn1::7vgmg-1774362949390-deb92a8a6b03 X-Vercel-Id | 1 | arn1::btcsp-1774362950063-06e334ff548f X-XSS-Protection | 30 | 1; mode=block HTTP Caching by content type (only from crawlable domains) ---------------------------------------------------------- Content type | Cache type | URLs | AVG lifetime | MIN lifetime | MAX lifetime ---------------------------------------------------------------------------- HTML | Cache-Control + ETag + Last-Modified | 30 | 0 s | 0 s | 0 s HTTP Caching by domain ---------------------- Domain | Cache type | URLs | AVG lifetime | MIN lifetime | MAX lifetime ------------------------------------------------------------------------------------ spider.cloud | Cache-Control + ETag + Last-Modified | 30 | 0 s | 0 s | 0 s HTTP Caching by domain and content type --------------------------------------- Domain | Content type | Cache type | URLs | AVG lifetime | MIN lifetime | MAX lifetime --------------------------------------------------------------------------------------------------- spider.cloud | HTML | Cache-Control + ETag + Last-Modified | 30 | 0 s | 0 s | 0 s TOP non-unique titles --------------------- Nothing to report. TOP non-unique descriptions --------------------------- Nothing to report. Best practices -------------- Analysis name | OK | Notice | Warning | Critical -------------------------------------------------------------------------------- Heading structure | 54 | 0 | 2 | 2 Invalid inline SVGs | 85 | 0 | 0 | 0 Large inline SVGs (> 5120 B) | 83 | 0 | 2 | 0 Duplicate inline SVGs (> 5 and > 1024 B) | 85 | 0 | 0 | 0 DOM depth (> 30) | 30 | 0 | 0 | 0 Title uniqueness (> 10%) | 28 | 0 | 0 | 0 Description uniqueness (> 10%) | 28 | 0 | 0 | 0 Brotli support | 0 | 0 | 28 | 0 WebP support | 0 | 0 | 1 | 0 AVIF support | 0 | 0 | 1 | 0 Accessibility ------------- Analysis name | OK | Notice | Warning | Critical -------------------------------------------------------------------- Missing aria labels | 5 | 0 | 97 | 1 Missing roles | 0 | 0 | 5 | 0 Missing html lang attribute | 1 | 0 | 0 | 0 Missing image alt attributes | 18 | 0 | 0 | 0 Source domains -------------- Domain | Totals | HTML ------------------------------------------ spider.cloud | 30/3MB/8.4s | 30/3MB/8.4s Content types ------------- Content type | URLs | Total size | Total time | Avg time | Status 20x | Status 40x ------------------------------------------------------------------------------------- HTML | 30 | 3 MB | 8.4 s | 279 ms | 28 | 2 Content types (MIME types) -------------------------- Content type | URLs | Total size | Total time | Avg time | Status 20x | Status 40x --------------------------------------------------------------------------------------------------- text/html; charset=utf-8 | 30 | 3 MB | 8.4 s | 279 ms | 28 | 2 DNS info -------- DNS resolving tree ------------------------------------------------------------------------ spider.cloud IPv4: 76.76.21.21 DNS server: 127.0.0.53 Security -------- Header | OK | Notice | Warning | Critical | Recommendation ----------------------------------------------------------------------------------------------------------------------------------------- Access-Control-All…-Origin | 0 | 0 | 30 | 0 | Access-Control-Allow-Origin is set to '*' whic…n be a security risk. X-XSS-Protection | 0 | 30 | 0 | 0 | X-XSS-Protection header is set but deprecated.…urity-Policy instead. Feature-Policy | 0 | 30 | 0 | 0 | Feature-Policy header is not set but Permissio…s set. That's enough. Server | 0 | 30 | 0 | 0 | Server header is set to 'Vercel'. It is better…al used technologies. Strict-Transport-Security | 30 | 0 | 0 | 0 | X-Frame-Options | 30 | 0 | 0 | 0 | X-Content-Type-Options | 30 | 0 | 0 | 0 | Referrer-Policy | 30 | 0 | 0 | 0 | Content-Security-Policy | 30 | 0 | 0 | 0 | Permissions-Policy | 30 | 0 | 0 | 0 | Analysis stats -------------- Class::method | Exec time | Exec count ------------------------------------------------------------------------------- SslTlsAnalyzer::getTLSandSSLCertificateInfo | 385 ms | 1 AccessibilityAnalyzer::checkMissingLabels | 53 ms | 28 AccessibilityAnalyzer::checkMissingAriaLabels | 52 ms | 28 BestPracticeAnalyzer::checkHeadingStructure | 50 ms | 30 AccessibilityAnalyzer::checkMissingRoles | 40 ms | 28 BestPracticeAnalyzer::checkMaxDOMDepth | 39 ms | 30 AccessibilityAnalyzer::checkMissingLang | 37 ms | 28 BestPracticeAnalyzer::checkNonClickablePhoneNumbers | 33 ms | 30 BestPracticeAnalyzer::checkInlineSvg | 18 ms | 30 BestPracticeAnalyzer::checkMissingQuotesOnAttributes | 6 ms | 30 SeoAndOpenGraphAnalyzer::analyzeHeadings | 5 ms | 1 SecurityAnalyzer::checkHtmlSecurity | 1 ms | 30 AccessibilityAnalyzer::checkImageAltAttributes | 1 ms | 28 SecurityAnalyzer::checkHeaders | 0 ms | 30 SeoAndOpenGraphAnalyzer::analyzeSeo | 0 ms | 1 SeoAndOpenGraphAnalyzer::analyzeOpenGraph | 0 ms | 1 BestPracticeAnalyzer::checkTitleUniqueness | 0 ms | 1 BestPracticeAnalyzer::checkMetaDescriptionUniqueness | 0 ms | 1 BestPracticeAnalyzer::checkBrotliSupport | 0 ms | 1 BestPracticeAnalyzer::checkWebpSupport | 0 ms | 1 BestPracticeAnalyzer::checkAvifSupport | 0 ms | 1 Content processor stats ----------------------- Class::method | Exec time | Exec count ----------------------------------------------------------------------------------- HtmlProcessor::findUrls | 613 ms | 30 AstroProcessor::findUrls | 166 ms | 30 NextJsProcessor::applyContentChangesBeforeUrlParsing | 15 ms | 30 JavaScriptProcessor::findUrls | 10 ms | 30 CssProcessor::findUrls | 2 ms | 30 AstroProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 30 NextJsProcessor::findUrls | 0 ms | 30 JavaScriptProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 30 SvelteProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 30 SvelteProcessor::findUrls | 0 ms | 30 CssProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 30 HtmlProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 30