#### #### ##### #### #### ####### #### ### #### ######### #### ###### #### ###### #### ###################### ##### #### ####### ####### ##### #### ####### ####### # #### ###################### #### #### ###### #### #### #### ## #### #### #### #### ################## #### #### ################## ================================================== # SiteOne Crawler, v2.1.0.20260317 # # Author: jan.reges@siteone.cz # ================================================== Detected terminal width 138 < 140 chars - compact mode activated. URL | Status | Type | Time | Size | Cache | Access. | Best pr. ------------------------------------------------------------------------------------------------------------------------------------ /documentation | 308 | Redirect | 26 ms | 95 B | none | | /documentation/ | 200 | HTML | 59 ms | 624 kB | 0 s | 1/4/1 | 1/7 /documentation/data-extraction/ | 200 | HTML | 57 ms | 174 kB | 0 s | 1/4/1 | 1/7 /documentation/proxy-mode/ | 200 | HTML | 55 ms | 150 kB | 0 s | 1/4/1 | 1/7 /documentation/chatgpt | 308 | Redirect | 26 ms | 111 B | none | | /documentation/google-api | 308 | Redirect | 29 ms | 117 B | none | | /documentation/fast-search | 308 | Redirect | 28 ms | 119 B | none | | /documentation/youtube | 308 | Redirect | 26 ms | 111 B | none | | /documentation/walmart | 308 | Redirect | 26 ms | 111 B | none | | /documentation/js-scenario/ | 200 | HTML | 60 ms | 156 kB | 0 s | 1/4/1 | 1/7 /documentation/country_codes/ | 200 | HTML | 50 ms | 162 kB | 0 s | 1/3/2 | 1/7 /documentation/amazon | 308 | Redirect | 26 ms | 109 B | none | | /documentation/chatgpt/ | 200 | HTML | 70 ms | 193 kB | 0 s | 1/4/1 | 1/7 /documentation/google-api/ | 200 | HTML | 53 ms | 224 kB | 0 s | 1/4/1 | 2/6 /documentation/fast-search/ | 200 | HTML | 96 ms | 214 kB | 0 s | 1/4/1 | 1/7 /documentation/youtube/ | 200 | HTML | 56 ms | 566 kB | 0 s | 1/4/1 | 1/7 /documentation/walmart/ | 200 | HTML | 69 ms | 474 kB | 0 s | 1/4/1 | 1/7 /documentation/amazon/ | 200 | HTML | 96 ms | 557 kB | 0 s | 1/4/1 | 1/7 Skipped URLs Summary -------------------- Reason | Domain | Unique URLs -------------------------------------------------------------- Not allowed host | dashboard.scrapingbee.com | 4 Not allowed host | help.scrapingbee.com | 3 Not allowed host | app.scrapingbee.com | 2 Not allowed host | en.wikipedia.org | 1 Skipped URLs ------------ Reason | Skipped URL | Source | Found at URL ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Not allowed host | https://app.scrapingbee.com/account/manage/api_key | | /documentation/fast-search/ Not allowed host | https://app.scrapingbee.com/account/register | | /documentation/fast-search/ Not allowed host | https://dashboard.scrapingbee.com/account/login | | /documentation/ Not allowed host | https://dashboard.scrapingbee.com/account/manage/api_key | | /documentation/ Not allowed host | https://dashboard.scrapingbee.com/account/register | | /documentation/ Not allowed host | https://dashboard.scrapingbee.com/dashboard | | /documentation/proxy-mode/ Not allowed host | https://en.wikipedia.org/wiki/ISO_3166-1 | | /documentation/ Not allowed host | https://help.scrapingbee.com/en/ | | /documentation/ Not allowed host | https://help.scrapingbee.com/en/article/…t-settings-1tcst5f/ | | /documentation/ Not allowed host | https://help.scrapingbee.com/en/article/…l-encoding-1w5vas8/ | | /documentation/google-api/ External URLs ------------- External URL | Pages | Found on URL (max 5) ------------------------------------------------------------------------------------------------------------------------------------- https://app.scrapingbee.com/account/manage/api_key | 1 | /documentation/fast-search/ https://app.scrapingbee.com/account/register | 1 | /documentation/fast-search/ https://dashboard.scrapingbee.com/account/login | 1 | /documentation/ https://dashboard.scrapingbee.com/account/manage/api_key | 1 | /documentation/ https://dashboard.scrapingbee.com/account/register | 1 | /documentation/ https://dashboard.scrapingbee.com/dashboard | 1 | /documentation/proxy-mode/ https://en.wikipedia.org/wiki/ISO_3166-1 | 1 | /documentation/ https://help.scrapingbee.com/en/ | 1 | /documentation/ https://help.scrapingbee.com/en/article/…t-settings-1tcst5f/ | 1 | /documentation/ https://help.scrapingbee.com/en/article/…l-encoding-1w5vas8/ | 1 | /documentation/google-api/ Redirected URLs --------------- Status | Redirected URL | Target URL | Found at URL -------------------------------------------------------------------------------------------------------------------------------------- 308 | /documentation | /documentation/ | 308 | /documentation/amazon | /documentation/amazon/ | /documentation/ 308 | /documentation/chatgpt | /documentation/chatgpt/ | /documentation/ 308 | /documentation/fast-search | /documentation/fast-search/ | /documentation/ 308 | /documentation/google-api | /documentation/google-api/ | /documentation/ 308 | /documentation/walmart | /documentation/walmart/ | /documentation/ 308 | /documentation/youtube | /documentation/youtube/ | /documentation/ 404 URLs -------- No 404 URLs found. SSL/TLS info ------------ Info | Text --------------------------------------------------------------------------------------------------------------------------------------- Issuer | C = US, O = Google Trust Services, CN = WE1 Subject | CN = www.scrapingbee.com Valid from | Feb 18 04:21:17 2026 GMT (VALID already 34.4 day(s)) Valid to | May 19 05:04:37 2026 GMT (VALID still for 55.6 day(s)) Supported protocols | TLSv1.2, TLSv1.3 RAW certificate output | Certificate: Data: Version: 3 (0x2) Serial Number:…5:d8:d1:1c:d8:55:f2:bf:58:39:4f:29 RAW protocols output | === ssl2 === s_client: Unknown option: -ssl2 s_client: Use -help for su…erify return code: 0 (ok) --- DONE TOP fastest URLs ---------------- Time | Status | Fast URL ------------------------------------------------------------------------------------------------------------------------------------------ 50 ms | 200 | /documentation/country_codes/ 53 ms | 200 | /documentation/google-api/ 55 ms | 200 | /documentation/proxy-mode/ 56 ms | 200 | /documentation/youtube/ 57 ms | 200 | /documentation/data-extraction/ 59 ms | 200 | /documentation/ 60 ms | 200 | /documentation/js-scenario/ 69 ms | 200 | /documentation/walmart/ 71 ms | 200 | /documentation/chatgpt/ 96 ms | 200 | /documentation/amazon/ 96 ms | 200 | /documentation/fast-search/ TOP slowest URLs ---------------- Time | Status | Slow URL ------------------------------------------------------------------------------------------------------------------------------------- 96 ms | 200 | /documentation/fast-search/ 96 ms | 200 | /documentation/amazon/ 71 ms | 200 | /documentation/chatgpt/ 69 ms | 200 | /documentation/walmart/ 60 ms | 200 | /documentation/js-scenario/ 59 ms | 200 | /documentation/ 57 ms | 200 | /documentation/data-extraction/ 56 ms | 200 | /documentation/youtube/ 55 ms | 200 | /documentation/proxy-mode/ 53 ms | 200 | /documentation/google-api/ 50 ms | 200 | /documentation/country_codes/ SEO metadata ------------ This table contains large data and shows max 10 rows. To see them all, use output to HTML using `--output-html-report=tmp/myreport.html`. URL | Indexing | Title | H1 | Description | Keywords --------------------------------------------------------------------------------------------------------------------------------------- /documentation/ | Allowed | HTML API | HTML API | Scraping…ed. | /documentation/amazon/ | Allowed | Amazon API | Amazon API | Our Amaz…PI: | /documentation/chatgpt/ | Allowed | GPT API | GPT API | Our Chat…PI: | /documentation/country_codes/ | Allowed | Supporte…ies | Supporte…ies | List of…ezw | /documentation/data-extraction/ | Allowed | Data Ext…ion | Data Ext…ion | 💡 Impor…mat | /documentation/fast-search/ | Allowed | Fast Sea…API | Fast Sea…API | …st. | /documentation/google-api/ | Allowed | Google API | Google API | …me. | /documentation/js-scenario/ | Allowed | JavaScri…rio | JavaScri…rio | 💡 Impor…io. | /documentation/proxy-mode/ | Allowed | Proxy Mode | Proxy Mode | What is…de: | /documentation/walmart/ | Allowed | Walmart API | Walmart API | Our Walm…PI: | OpenGraph metadata ------------------ This table contains large data and shows max 10 rows. To see them all, use output to HTML using `--output-html-report=tmp/myreport.html`. URL | OG Title | OG Description | OG Image ----------------------------------------------------------------------------------------------------------------------------------------- /documentation/ | HTML API | ScrapingBee | ScrapingBee is the b…ou need. | /images/cover.png /documentation/amazon/ | Amazon API | ScrapingBee | Our Amazon API allow…uct API: | /images/cover.png /documentation/chatgpt/ | GPT API | ScrapingBee | Our Chat GPT API all…GPT API: | /images/cover.png /documentation/country_codes/ | Supported Countries…pingBee | List of supported co…mbabwezw | /images/cover.png /documentation/data-extraction/ | Data Extraction | Sc…pingBee | 💡 Important:This pa…g format | /images/cover.png /documentation/fast-search/ | Fast Search API | Sc…pingBee | …request. | /images/cover.png /documentation/google-api/ | Google API | ScrapingBee | …ealtime. | /images/cover.png /documentation/js-scenario/ | JavaScript Scenario…pingBee | 💡 Important:This pa…cenario. | /images/cover.png /documentation/proxy-mode/ | Proxy Mode | ScrapingBee | What is the proxy mo…xy mode: | /images/cover.png /documentation/walmart/ | Walmart API | ScrapingBee | Our Walmart API allo…rch API: | /images/cover.png Heading structure ----------------- This table contains large data and shows max 10 rows. To see them all, use output to HTML using `--output-html-report=tmp/myreport.html`. Heading structure | Count | Errors | URL ----------------------------------------------------------------------------------------------------------------------------------------

HTML API

Overview [#overview]

Getting Sta…Headers [#response-headers] | 52 | 0 | /documentation/

Data Extraction

Basic usage [#basic-usage] Proxy Mode

What is the proxy mode? [#what-is-t…on [#octoparse-integration] | 9 | 0 | /documentation/proxy-mode/

JavaScript Scenario

Basic usage [#basic-usage]…te]

Timeout [#timeout] | 13 | 0 | /documentation/js-scenario/

Supported Countries

List of supported country…of-supported-country-codes] | 2 | 0 | /documentation/country_codes/

GPT API

Overview [#overview]

Quick start…

Citations [#citations] | 9 | 0 | /documentation/chatgpt/

Google API

Overview [#overview]

Getting S…dit-cost-for-your-requests] | 16 | 0 | /documentation/google-api/

Fast Search API

Overview [#overview]

Gett…dit-cost-for-your-requests] | 10 | 0 | /documentation/fast-search/

YouTube API

Overview [#overview]

YouTube…dit-cost-for-your-requests] | 35 | 0 | /documentation/youtube/

Walmart API

Overview [#overview]

Walmart…dit-cost-for-your-requests] | 33 | 0 | /documentation/walmart/ HTTP headers ------------ Header | Occurs | Unique | Values preview | Min value | Max value ---------------------------------------------------------------------------------------------------------------------------- Access-Control-Allow-Origin | 18 | 1 | * | | Alt-Svc | 18 | 1 | h3=":443"; ma=86400 | | Cache-Control | 11 | 1 | public, max-age=0, must-revalidate | | Cf-Ray | 18 | - | [ignored generic values] | | Content-Length | 7 | - | [ignored generic values] | 0 B | 0 B Content-Type | 18 | 2 | text/html; charset=utf-8 (11) / text/html (7) | | Date | 18 | - | [ignored generic values] | 2026-03-24 | 2026-03-24 Etag | 10 | - | [ignored generic values] | | Link | 3 | 1 | ; rel="preconnect" | | Location | 7 | 7 | [see values below] | | Nel | 18 | 1 | {"report_to":"cf-nel","success_f…ax_age":604800} | | Referrer-Policy | 18 | 1 | strict-origin-when-cross-origin | | Report-To | 18 | 18 | [see values below] | | Server | 18 | 1 | cloudflare | | X-Content-Type-Options | 11 | 1 | nosniff | | HTTP header values ------------------ Header | Occurs | Value --------------------------------------------------------------------------------------------------------------------------- Access-Control-Allow-Origin | 18 | * Alt-Svc | 18 | h3=":443"; ma=86400 Cache-Control | 11 | public, max-age=0, must-revalidate Content-Type | 11 | text/html; charset=utf-8 Content-Type | 7 | text/html Link | 3 | ; rel="preconnect" Location | 1 | /documentation/chatgpt/ Location | 1 | /documentation/ Location | 1 | /documentation/fast-search/ Location | 1 | /documentation/youtube/ Location | 1 | /documentation/amazon/ Location | 1 | /documentation/walmart/ Location | 1 | /documentation/google-api/ Nel | 18 | {"report_to":"cf-nel","success_fraction":0.0,"max_age":604800} Referrer-Policy | 18 | strict-origin-when-cross-origin Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…E31THUFw6gNj830UHSE%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…xnLza9Pv6JgEQHy%2F0%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…LtGxTbauCZFe5j8R2QM%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…Ds7kkrTDni7bxS8e6Cw%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…wr%2FO%2FuXX%2BAkv4%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…Qy7v47WAWO1spWP47so%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…%2BkhwuBCqu%2BxlyS8%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…liSbuLZFFhlqyLT4Bs4%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…K%2FD8p7wxav3wdK63g%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…hqh4PH4LtDrsjB5grCM%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…CawSR8P1Ub%2BSD1frU%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…2BINLxOcAse1%2FUbCg%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…7JESfDlHRJ8cF0Tytbc%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…HPB2IT%2F%2B9RrZp9U%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…9TLc02QEtfQJCjehzDg%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…ujG1scd7tY6q6wV9UDQ%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…2BC7%2BAfBBLwV2z6Ps%3D"}]} Report-To | 1 | {"group":"cf-nel","max_age":604800,"endpoints":[{"url":…gY3wM2gvTrn0Bzh%2FI%3D"}]} Server | 18 | cloudflare X-Content-Type-Options | 11 | nosniff HTTP Caching by content type (only from crawlable domains) ---------------------------------------------------------- Content type | Cache type | URLs | AVG lifetime | MIN lifetime | MAX lifetime ---------------------------------------------------------------------------- HTML | Cache-Control + ETag | 10 | 0 s | 0 s | 0 s Redirect | No cache headers | 7 | - | - | - HTML | Cache-Control | 1 | 0 s | 0 s | 0 s HTTP Caching by domain ---------------------- Domain | Cache type | URLs | AVG lifetime | MIN lifetime | MAX lifetime ------------------------------------------------------------------------------------ www.scrapingbee.com | Cache-Control + ETag | 10 | 0 s | 0 s | 0 s www.scrapingbee.com | No cache headers | 7 | - | - | - www.scrapingbee.com | Cache-Control | 1 | 0 s | 0 s | 0 s HTTP Caching by domain and content type --------------------------------------- Domain | Content type | Cache type | URLs | AVG lifetime | MIN lifetime | MAX lifetime --------------------------------------------------------------------------------------------------- www.scrapingbee.com | HTML | Cache-Control + ETag | 10 | 0 s | 0 s | 0 s www.scrapingbee.com | Redirect | No cache headers | 7 | - | - | - www.scrapingbee.com | HTML | Cache-Control | 1 | 0 s | 0 s | 0 s TOP non-unique titles --------------------- Nothing to report. TOP non-unique descriptions --------------------------- Count | Description ------------------------------------------------------------------------------------------------------------------------------------------ 11 | Best practices -------------- Analysis name | OK | Notice | Warning | Critical -------------------------------------------------------------------------------- Non-clickable phone numbers | 0 | 0 | 1 | 0 Missing quotes on attributes | 0 | 0 | 216 | 0 Invalid inline SVGs | 8 | 0 | 0 | 0 Duplicate inline SVGs (> 5 and > 1024 B) | 8 | 0 | 0 | 0 Large inline SVGs (> 5120 B) | 8 | 0 | 0 | 0 DOM depth (> 30) | 11 | 0 | 0 | 0 Heading structure | 22 | 0 | 0 | 0 Title uniqueness (> 10%) | 11 | 0 | 0 | 0 Description uniqueness (> 10%) | 0 | 0 | 1 | 0 Brotli support | 0 | 0 | 11 | 0 WebP support | 0 | 0 | 1 | 0 AVIF support | 0 | 0 | 1 | 0 Accessibility ------------- Analysis name | OK | Notice | Warning | Critical -------------------------------------------------------------------- Missing aria labels | 1 | 0 | 8 | 2 Missing roles | 0 | 0 | 6 | 0 Missing form labels | 0 | 0 | 1 | 0 Missing image alt attributes | 8 | 0 | 2 | 0 Missing html lang attribute | 1 | 0 | 0 | 0 Source domains -------------- Domain | Totals | HTML | Redirect ------------------------------------------------------------------ www.scrapingbee.com | 18/3MB/917ms | 11/3MB/727ms | 7/773B/190ms Content types ------------- Content type | URLs | Total size | Total time | Avg time | Status 20x | Status 30x ------------------------------------------------------------------------------------- HTML | 11 | 3 MB | 727 ms | 66 ms | 11 | 0 Redirect | 7 | 773 B | 190 ms | 27 ms | 0 | 7 Content types (MIME types) -------------------------- Content type | URLs | Total size | Total time | Avg time | Status 20x | Status 30x --------------------------------------------------------------------------------------------------- text/html; charset=utf-8 | 11 | 3 MB | 727 ms | 66 ms | 11 | 0 text/html | 7 | 773 B | 190 ms | 27 ms | 0 | 7 DNS info -------- DNS resolving tree ------------------------------------------------------------------------ www.scrapingbee.com scrapingbee-landing-page.pages.dev IPv4: scrapingbee-landing-page.pages.dev. IPv4: 188.114.96.3 IPv4: 188.114.97.3 IPv6: scrapingbee-landing-page.pages.dev. IPv6: 2a06:98c1:3121::3 IPv6: 2a06:98c1:3120::3 DNS server: 127.0.0.53 Security -------- Header | OK | Notice | Warning | Critical | Recommendation ----------------------------------------------------------------------------------------------------------------------------------------- Strict-Transport-Security | 0 | 0 | 0 | 11 | Strict-Transport-Security header is not set. I…against MITM attacks. Content-Security-Policy | 0 | 0 | 0 | 11 | Content-Security-Policy header is not set. It…prevents XSS attacks. Access-Control-All…-Origin | 0 | 0 | 11 | 0 | Access-Control-Allow-Origin is set to '*' whic…n be a security risk. X-Frame-Options | 0 | 0 | 11 | 0 | X-Frame-Options header is not set. It prevents…deny' or 'sameorigin. Feature-Policy | 0 | 0 | 11 | 0 | Feature-Policy header is not set. It allows en…ssions-Policy is set. Permissions-Policy | 0 | 0 | 11 | 0 | Permissions-Policy header is not set. It allow…eatures for security. Server | 0 | 11 | 0 | 0 | Server header is set to 'cloudflare'. It is be…al used technologies. X-XSS-Protection | 11 | 0 | 0 | 0 | X-Content-Type-Options | 11 | 0 | 0 | 0 | Referrer-Policy | 11 | 0 | 0 | 0 | Analysis stats -------------- Class::method | Exec time | Exec count ------------------------------------------------------------------------------- SslTlsAnalyzer::getTLSandSSLCertificateInfo | 667 ms | 1 AccessibilityAnalyzer::checkMissingLabels | 63 ms | 11 BestPracticeAnalyzer::checkHeadingStructure | 57 ms | 11 AccessibilityAnalyzer::checkMissingAriaLabels | 55 ms | 11 BestPracticeAnalyzer::checkNonClickablePhoneNumbers | 53 ms | 11 AccessibilityAnalyzer::checkMissingRoles | 42 ms | 11 BestPracticeAnalyzer::checkMaxDOMDepth | 36 ms | 11 AccessibilityAnalyzer::checkMissingLang | 36 ms | 11 BestPracticeAnalyzer::checkInlineSvg | 11 ms | 11 BestPracticeAnalyzer::checkMissingQuotesOnAttributes | 9 ms | 11 AccessibilityAnalyzer::checkImageAltAttributes | 2 ms | 11 SeoAndOpenGraphAnalyzer::analyzeHeadings | 1 ms | 1 SecurityAnalyzer::checkHtmlSecurity | 1 ms | 11 SecurityAnalyzer::checkHeaders | 0 ms | 11 SeoAndOpenGraphAnalyzer::analyzeSeo | 0 ms | 1 SeoAndOpenGraphAnalyzer::analyzeOpenGraph | 0 ms | 1 BestPracticeAnalyzer::checkTitleUniqueness | 0 ms | 1 BestPracticeAnalyzer::checkMetaDescriptionUniqueness | 0 ms | 1 BestPracticeAnalyzer::checkBrotliSupport | 0 ms | 1 BestPracticeAnalyzer::checkAvifSupport | 0 ms | 1 BestPracticeAnalyzer::checkWebpSupport | 0 ms | 1 Content processor stats ----------------------- Class::method | Exec time | Exec count ----------------------------------------------------------------------------------- JavaScriptProcessor::findUrls | 17 ms | 11 NextJsProcessor::applyContentChangesBeforeUrlParsing | 16 ms | 11 HtmlProcessor::findUrls | 14 ms | 18 CssProcessor::findUrls | 3 ms | 11 AstroProcessor::findUrls | 0 ms | 11 AstroProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 11 HtmlProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 18 NextJsProcessor::findUrls | 0 ms | 11 JavaScriptProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 11 SvelteProcessor::findUrls | 0 ms | 11 SvelteProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 11 CssProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 11