#### #### #####
#### #### #######
#### ### #### #########
#### ###### #### ###### ####
###################### ##### ####
####### ####### ##### ####
####### ####### # ####
###################### ####
#### ###### #### ####
#### ## #### ####
#### #### ##################
#### #### ##################
==================================================
# SiteOne Crawler, v2.1.0.20260317 #
# Author: jan.reges@siteone.cz #
==================================================
Detected terminal width 138 < 140 chars - compact mode activated.
URL | Status | Type | Time | Size | Cache | Access. | Best pr.
------------------------------------------------------------------------------------------------------------------------------------
/ | 308 | Redirect | 267 ms | 91 B | 0 s | |
/introduction | 200 | HTML | 93 ms | 630 kB | 0 s | 2/2 | 1/6
/scraping-automation/introduction | 200 | HTML | 116 ms | 638 kB | 0 s | 2/2 | 1/6
/proxy-networks/introduction | 200 | HTML | 106 ms | 626 kB | 0 s | 2/2 | 1/6
/release-notes | 200 | HTML | 174 ms | 1 MB | 0 s | 3/1 | 1/6
/cli/overview | 200 | HTML | 176 ms | 674 kB | 0 s | 2/2 | 1/6
/ai/introduction | 200 | HTML | 130 ms | 674 kB | 0 s | 2/2 | 1/6
/datasets/introduction | 200 | HTML | 233 ms | 617 kB | 0 s | 2/2 | 1/6
/api-reference/SDK | 200 | HTML | 138 ms | 1 MB | 0 s | 2/2 | 1/6
/api-reference/SDK-JS | 200 | HTML | 143 ms | 985 kB | 0 s | 2/2 | 1/6
/integrations/introduction | 200 | HTML | 146 ms | 638 kB | 0 s | 2/2 | 1/6
/ai/mcp-server/overview | 200 | HTML | 142 ms | 651 kB | 0 s | 2/2 | 1/6
/api-reference/authentication | 200 | HTML | 103 ms | 766 kB | 0 s | 2/2 | 1/6
/general/account/overview | 200 | HTML | 139 ms | 619 kB | 0 s | 2/2 | 1/6
/scraping-automation/faqs | 200 | HTML | 143 ms | 662 kB | 0 s | 2/2 | 1/6
/scraping-automation/browser-extension | 307 | Redirect | 228 ms | 167 B | 0 s | |
/proxy-networks/errorCatalog | 200 | HTML | 126 ms | 905 kB | 0 s | 2/2 | 1/1/6
/scraping-automation/concepts/understanding-async-requests | 200 | HTML | 284 ms | 668 kB | 0 s | 2/2 | 1/6
/proxy-networks/config-options | 200 | HTML | 115 ms | 669 kB | 0 s | 2/2 | 1/6
/proxy-networks/website-blocking | 200 | HTML | 139 ms | 630 kB | 0 s | 2/2 | 1/6
/proxy-networks/residential/introduction | 200 | HTML | 91 ms | 639 kB | 0 s | 2/2 | 1/6
/proxy-networks/proxy-manager/introduction | 200 | HTML | 139 ms | 612 kB | 0 s | 2/2 | 1/6
/proxy-networks/socks5 | 200 | HTML | 107 ms | 745 kB | 0 s | 2/2 | 1/6
/proxy-networks/faqs | 200 | HTML | 112 ms | 1 MB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/parsed-json-…erp-migration-guide | 200 | HTML | 118 ms | 899 kB | 0 s | 2/2 | 1/6
/datasets/archive/overview | 200 | HTML | 74 ms | 618 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/query-parameters/google | 200 | HTML | 153 ms | 3 MB | 0 s | 2/2 | 1/6
/proxy-networks/residential/network-access | 200 | HTML | 229 ms | 718 kB | 0 s | 2/2 | 1/6
/general/usage-monitoring/fair_use_allowance | 200 | HTML | 95 ms | 645 kB | 0 s | 2/2 | 1/6
/proxy-networks/residential/configure-your-proxy | 200 | HTML | 90 ms | 763 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/parsed-json-…sing-search-results | 200 | HTML | 162 ms | 636 kB | 0 s | 2/2 | 1/6
/integrations/make | 200 | HTML | 257 ms | 652 kB | 0 s | 2/2 | 1/6
/scraping-automation/web-unlocker/features | 200 | HTML | 154 ms | 1006 kB | 0 s | 3/1 | 1/6
/datasets/functions/warc-ide | 308 | Redirect | 636 ms | 131 B | 0 s | |
/datasets/archive/faqs | 200 | HTML | 138 ms | 628 kB | 0 s | 2/2 | 1/6
/integrations/lindy-ai | 200 | HTML | 494 ms | 707 kB | 0 s | 3/1 | 1/6
/integrations/n8n | 200 | HTML | 91 ms | 685 kB | 0 s | 2/2 | 1/6
/integrations/llamaindex | 404 | HTML | 494 ms | 442 kB | 0 s | | 1/2
/api-reference/scrapers/synchronous-requests | 200 | HTML | 100 ms | 691 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/get-…pending-replacement | 200 | HTML | 296 ms | 689 kB | 0 s | 2/2 | 1/6
/integrations/langchain | 200 | HTML | 103 ms | 993 kB | 0 s | 2/2 | 1/6
/api-reference/marketplace-dataset-api/get-dataset-list | 200 | HTML | 91 ms | 677 kB | 0 s | 3/1 | 1/6
/datasets/scrapers/scrapers-library/error-list-by-endpoint | 200 | HTML | 280 ms | 742 kB | 0 s | 2/2 | 1/6
/general/account/faqs | 200 | HTML | 244 ms | 703 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/get-top-100-google-results | 200 | HTML | 166 ms | 1 MB | 0 s | 2/2 | 1/6
/datasets/scrapers/scrapers-library/ai-scrapers | 200 | HTML | 139 ms | 649 kB | 0 s | 2/2 | 1/1/6
/%20 | 404 | HTML | 866 ms | 442 kB | 0 s | | 1/2
/datasets/scrapers/custom-scrapers/scrape-any-web | 404 | HTML | 387 ms | 442 kB | 0 s | | 1/2
/cli/commands | 200 | HTML | 163 ms | 975 kB | 0 s | 2/2 | 1/6
/cli/examples | 200 | HTML | 112 ms | 962 kB | 0 s | 2/2 | 1/6
/api-reference/postman-collection | 200 | HTML | 131 ms | 628 kB | 0 s | 2/2 | 1/6
/cli/faqs | 200 | HTML | 99 ms | 752 kB | 0 s | 2/2 | 1/6
/cli/installation | 200 | HTML | 149 ms | 734 kB | 0 s | 2/2 | 1/6
/api-reference/terminology | 200 | HTML | 115 ms | 645 kB | 0 s | 2/2 | 1/6
/ai/for-agents/overview | 200 | HTML | 153 ms | 651 kB | 0 s | 2/2 | 1/6
/ai/mcp-server/faqs | 200 | HTML | 104 ms | 757 kB | 0 s | 2/2 | 1/6
/ai/for-agents/llm-references | 200 | HTML | 151 ms | 783 kB | 0 s | 2/2 | 1/6
/ai/agents | 200 | HTML | 87 ms | 826 kB | 0 s | 2/2 | 1/1/6
/ai/for-agents/docs-mcp | 200 | HTML | 250 ms | 740 kB | 0 s | 2/2 | 1/6
/ai/enrichment | 200 | HTML | 147 ms | 1 MB | 0 s | 2/2 | 1/1/6
/ai/training | 200 | HTML | 168 ms | 667 kB | 0 s | 2/2 | 1/1/6
/ai/deep-research | 200 | HTML | 99 ms | 1 MB | 0 s | 2/2 | 1/1/6
/ai/for-agents/skills | 200 | HTML | 235 ms | 857 kB | 0 s | 2/2 | 1/6
/datasets/marketplace/overview | 200 | HTML | 95 ms | 628 kB | 0 s | 2/2 | 1/6
/ai/llm-grounding | 200 | HTML | 246 ms | 1 MB | 0 s | 2/2 | 1/1/6
/integrations/llama-index | 200 | HTML | 240 ms | 803 kB | 0 s | 2/2 | 1/6
/integrations/stablersolo | 200 | HTML | 233 ms | 673 kB | 0 s | 3/1 | 1/6
/integrations/marketerbrowser | 200 | HTML | 249 ms | 695 kB | 0 s | 3/1 | 1/6
/integrations/easync | 200 | HTML | 223 ms | 670 kB | 0 s | 3/1 | 1/6
/integrations/macos | 200 | HTML | 168 ms | 703 kB | 0 s | 3/1 | 1/6
/integrations/smlogin | 200 | HTML | 170 ms | 760 kB | 0 s | 3/1 | 1/6
/integrations/morelogin | 200 | HTML | 104 ms | 704 kB | 0 s | 3/1 | 1/6
/integrations/lalicat | 200 | HTML | 250 ms | 689 kB | 0 s | 3/1 | 1/6
/integrations/proxifier | 200 | HTML | 76 ms | 712 kB | 0 s | 3/1 | 1/6
/integrations/apify | 200 | HTML | 235 ms | 678 kB | 0 s | 3/1 | 1/6
/integrations/changedetection | 200 | HTML | 152 ms | 674 kB | 0 s | 3/1 | 1/6
/scraping-automation/scraping-browser/introduction | 200 | HTML | 84 ms | 634 kB | 0 s | 2/2 | 1/6
/integrations/vmlogin | 200 | HTML | 260 ms | 681 kB | 0 s | 3/1 | 1/6
/integrations/aezakmi | 200 | HTML | 117 ms | 688 kB | 0 s | 3/1 | 1/6
/integrations/firefox | 200 | HTML | 97 ms | 687 kB | 0 s | 3/1 | 1/6
/integrations/geelark | 200 | HTML | 261 ms | 694 kB | 0 s | 3/1 | 1/6
/integrations/adspower | 200 | HTML | 146 ms | 686 kB | 0 s | 3/1 | 1/6
/integrations/clonbrowser | 200 | HTML | 245 ms | 680 kB | 0 s | 3/1 | 1/6
/integrations/foxyproxy | 200 | HTML | 157 ms | 678 kB | 0 s | 3/1 | 1/6
/integrations/xpander-ai | 200 | HTML | 110 ms | 763 kB | 0 s | 2/2 | 1/6
/integrations/strands | 200 | HTML | 150 ms | 923 kB | 0 s | 2/2 | 1/6
/integrations/pica | 200 | HTML | 229 ms | 785 kB | 0 s | 2/2 | 1/6
/integrations/agno | 200 | HTML | 174 ms | 683 kB | 0 s | 2/2 | 1/6
/integrations/mulogin | 200 | HTML | 227 ms | 717 kB | 0 s | 3/1 | 1/6
/integrations/genlogin | 200 | HTML | 277 ms | 690 kB | 0 s | 3/1 | 1/6
/integrations/postern | 200 | HTML | 235 ms | 680 kB | 0 s | 3/1 | 1/6
/integrations/openbullet | 200 | HTML | 256 ms | 688 kB | 0 s | 3/1 | 1/6
/integrations/helium-scraper | 200 | HTML | 149 ms | 674 kB | 0 s | 3/1 | 1/6
/integrations/telegram | 200 | HTML | 256 ms | 595 kB | 0 s | 2/2 | 1/6
/integrations/beautifulsoup | 200 | HTML | 125 ms | 711 kB | 0 s | 3/1 | 1/6
/integrations/android | 200 | HTML | 126 ms | 705 kB | 0 s | 3/1 | 1/6
/integrations/parsehub | 200 | HTML | 150 ms | 857 kB | 0 s | 3/1 | 1/6
/integrations/puppeteer | 200 | HTML | 143 ms | 776 kB | 0 s | 3/1 | 1/6
/integrations/screaming-frog | 200 | HTML | 212 ms | 653 kB | 0 s | 3/1 | 1/6
/integrations/sphere-browser | 200 | HTML | 230 ms | 680 kB | 0 s | 3/1 | 1/6
/integrations/switchyomega | 200 | HTML | 186 ms | 691 kB | 0 s | 3/1 | 1/6
/integrations/zapier | 200 | HTML | 156 ms | 683 kB | 0 s | 2/2 | 1/6
/integrations/octobrowser | 200 | HTML | 257 ms | 682 kB | 0 s | 3/1 | 1/6
/integrations/xlogin | 200 | HTML | 113 ms | 688 kB | 0 s | 3/1 | 1/6
/integrations/maskfog | 200 | HTML | 445 ms | 679 kB | 0 s | 3/1 | 1/6
/integrations/webharvy | 200 | HTML | 248 ms | 671 kB | 0 s | 3/1 | 1/6
/integrations/bitbrowser | 200 | HTML | 124 ms | 698 kB | 0 s | 3/1 | 1/6
/integrations/dify | 200 | HTML | 152 ms | 662 kB | 0 s | 2/2 | 1/6
/integrations/capsolver | 200 | HTML | 307 ms | 675 kB | 0 s | 3/1 | 1/6
/integrations/phantombuster | 200 | HTML | 206 ms | 712 kB | 0 s | 3/1 | 1/6
/integrations/hidemyacc | 200 | HTML | 244 ms | 695 kB | 0 s | 3/1 | 1/6
/integrations/octoparse | 200 | HTML | 223 ms | 690 kB | 0 s | 3/1 | 1/6
/integrations/dicloak | 200 | HTML | 222 ms | 717 kB | 0 s | 2/2 | 1/1/6
/integrations/incogniton | 200 | HTML | 214 ms | 678 kB | 0 s | 3/1 | 1/6
/integrations/ixbrowser | 200 | HTML | 237 ms | 692 kB | 0 s | 3/1 | 1/6
/integrations/postman | 200 | HTML | 608 ms | 661 kB | 0 s | 3/1 | 1/6
/integrations/ubuntu | 200 | HTML | 274 ms | 703 kB | 0 s | 3/1 | 1/6
/integrations/dolphin-anty | 200 | HTML | 269 ms | 680 kB | 0 s | 3/1 | 1/6
/integrations/antik | 200 | HTML | 263 ms | 689 kB | 0 s | 3/1 | 1/6
/integrations/ios | 200 | HTML | 232 ms | 683 kB | 0 s | 3/1 | 1/6
/integrations/scrapy | 200 | HTML | 251 ms | 792 kB | 0 s | 3/1 | 1/6
/integrations/shadowrocket | 200 | HTML | 127 ms | 661 kB | 0 s | 3/1 | 1/6
/integrations/nginx | 200 | HTML | 223 ms | 797 kB | 0 s | 3/1 | 1/6
/integrations/windows | 200 | HTML | 93 ms | 678 kB | 0 s | 3/1 | 1/6
/integrations/texau | 200 | HTML | 260 ms | 681 kB | 0 s | 3/1 | 1/6
/integrations/webscraper | 200 | HTML | 305 ms | 691 kB | 0 s | 3/1 | 1/6
/integrations/selenium | 200 | HTML | 294 ms | 770 kB | 0 s | 3/1 | 1/6
/integrations/undetectable | 200 | HTML | 276 ms | 679 kB | 0 s | 3/1 | 1/6
/integrations/playwright | 200 | HTML | 268 ms | 783 kB | 0 s | 3/1 | 1/6
/integrations/ghost-browser | 200 | HTML | 166 ms | 692 kB | 0 s | 3/1 | 1/6
/integrations/crew-ai | 200 | HTML | 286 ms | 706 kB | 0 s | 2/2 | 1/6
/integrations/insomniac | 200 | HTML | 249 ms | 720 kB | 0 s | 3/1 | 1/6
/integrations/multilogin | 200 | HTML | 227 ms | 684 kB | 0 s | 3/1 | 1/6
/integrations/ai-integrations | 200 | HTML | 86 ms | 705 kB | 0 s | 2/2 | 1/6
/integrations/gologin | 200 | HTML | 508 ms | 696 kB | 0 s | 3/1 | 1/6
/integrations/sessionbox | 200 | HTML | 259 ms | 679 kB | 0 s | 3/1 | 1/6
/integrations/chrome | 200 | HTML | 86 ms | 677 kB | 0 s | 3/1 | 1/6
/integrations/kameleo | 200 | HTML | 137 ms | 681 kB | 0 s | 3/1 | 1/6
/ai/mcp-server/usage-examples | 200 | HTML | 134 ms | 639 kB | 0 s | 2/2 | 1/6
/integrations/salefreaks | 200 | HTML | 386 ms | 803 kB | 0 s | 3/1 | 1/6
/ai/mcp-server/toon | 200 | HTML | 141 ms | 1 MB | 0 s | 2/2 | 1/6
/ai/mcp-server/tools | 200 | HTML | 121 ms | 792 kB | 0 s | 2/2 | 1/1/6
/ai/mcp-server/remote/quickstart | 200 | HTML | 279 ms | 665 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api | 307 | Redirect | 199 ms | 149 B | 0 s | |
/scraping-automation/web-unlocker | 307 | Redirect | 203 ms | 157 B | 0 s | |
/scraping-automation/scraping-browser | 307 | Redirect | 198 ms | 165 B | 0 s | |
/proxy-networks | 307 | Redirect | 98 ms | 121 B | 0 s | |
/general/account/ssl-certificate | 200 | HTML | 128 ms | 1 MB | 0 s | 2/2 | 1/6
/datasets/functions/introduction | 308 | Redirect | 246 ms | 139 B | 0 s | |
/general/account/referral-program | 200 | HTML | 85 ms | 622 kB | 0 s | 2/2 | 1/6
/datasets/marketplace | 307 | Redirect | 232 ms | 125 B | 0 s | |
/datasets/scrapers/overview | 200 | HTML | 482 ms | 605 kB | 0 s | 2/2 | 1/6
/general/webmaster-console | 200 | HTML | 230 ms | 630 kB | 0 s | 2/2 | 1/6
/general/account/limited-trial-restrictions | 200 | HTML | 162 ms | 679 kB | 0 s | 2/2 | 1/6
/general/account/users-management | 200 | HTML | 208 ms | 625 kB | 0 s | 2/2 | 1/1/6
/general/faqs | 200 | HTML | 83 ms | 940 kB | 0 s | 2/2 | 1/6
/general/websites | 200 | HTML | 241 ms | 700 kB | 0 s | 2/2 | 1/6
/scraping-automation/bright-shield/scraping-shield | 200 | HTML | 80 ms | 654 kB | 0 s | 2/2 | 1/6
/scraping-automation/web-unlocker/introduction | 200 | HTML | 240 ms | 638 kB | 0 s | 2/2 | 1/6
/scraping-automation/browser-extension/introduction | 200 | HTML | 114 ms | 607 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/Get_active_Zones | 200 | HTML | 85 ms | 694 kB | 0 s | 2/2 | 1/6
/api-reference/proxy/geolocation-targeting | 200 | HTML | 78 ms | 755 kB | 0 s | 2/2 | 1/6
/api-reference/proxy/request_error_handling | 200 | HTML | 226 ms | 646 kB | 0 s | 2/2 | 1/6
/general/webhook_notifications | 200 | HTML | 756 ms | 617 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/asynchronous-requests | 200 | HTML | 88 ms | 845 kB | 0 s | 3/1 | 1/6
/proxy-networks/mobile/faqs | 200 | HTML | 310 ms | 733 kB | 0 s | 2/2 | 1/6
/proxy-networks/proxy-manager/faqs | 200 | HTML | 162 ms | 1 MB | 0 s | 2/2 | 1/6
/api-reference/proxy/rotate_ips | 200 | HTML | 80 ms | 714 kB | 0 s | 2/2 | 1/6
/api-reference/proxy/carrier_specific_prox…eer_ip_mobile_only_ | 200 | HTML | 222 ms | 629 kB | 0 s | 2/2 | 1/6
/api-reference/proxy/ | 308 | Redirect | 32 ms | 105 B | 0 s | |
/api-reference/proxy/configuring_dns_resolution | 200 | HTML | 217 ms | 650 kB | 0 s | 2/2 | 1/6
/api-reference/proxy/select_super_proxy_in_specific_country | 200 | HTML | 245 ms | 640 kB | 0 s | 2/2 | 1/6
/proxy-networks/residential/quickstart | 200 | HTML | 106 ms | 649 kB | 0 s | 2/2 | 1/6
/proxy-networks/residential/send-your-first-request | 200 | HTML | 242 ms | 888 kB | 0 s | 2/2 | 1/6
/proxy-networks/isp/introduction | 200 | HTML | 76 ms | 618 kB | 0 s | 2/2 | 1/6
/proxy-networks/residential/faqs | 200 | HTML | 144 ms | 993 kB | 0 s | 2/2 | 1/6
/proxy-networks/data-center/introduction | 200 | HTML | 147 ms | 616 kB | 0 s | 2/2 | 1/6
/proxy-networks/proxy-manager/configuration | 200 | HTML | 83 ms | 764 kB | 0 s | 3/1 | 1/6
/proxy-networks/proxy-manager/security | 200 | HTML | 238 ms | 665 kB | 0 s | 2/2 | 1/6
/proxy-networks/proxy-manager/quickstart | 200 | HTML | 217 ms | 629 kB | 0 s | 2/2 | 1/6
/proxy-networks/proxy-manager/integration | 200 | HTML | 217 ms | 843 kB | 0 s | 3/1 | 1/6
/api-reference/account-management-api/remo…lowlist-or-denylist | 200 | HTML | 204 ms | 701 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/introduction | 200 | HTML | 105 ms | 889 kB | 0 s | 2/2 | 1/6
/integrations | 307 | Redirect | 321 ms | 123 B | 0 s | |
/general/account/billing-and-pricing/billing | 200 | HTML | 137 ms | 732 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/Refr…_Datacenter_ISP_IPs | 200 | HTML | 298 ms | 722 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/allowlist-ip | 200 | HTML | 277 ms | 690 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/denylist-ip | 200 | HTML | 439 ms | 687 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/allo…or-denylist-domains | 200 | HTML | 276 ms | 690 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/remo…from-zone-allowlist | 200 | HTML | 258 ms | 687 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/Refr…ted_residential_IPs | 200 | HTML | 255 ms | 715 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/remo…-from-zone-denylist | 200 | HTML | 268 ms | 687 kB | 0 s | 2/2 | 1/6
/api-reference/account-management-api/Swit…FF_in_a_Static_zone | 200 | HTML | 222 ms | 687 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/configuration | 200 | HTML | 131 ms | 625 kB | 0 s | 2/2 | 1/6
/integrations/browserscan | 404 | HTML | 463 ms | 442 kB | 0 s | | 1/2
/scraping-automation/serp-api/send-your-first-request | 200 | HTML | 136 ms | 931 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/pricing-and-billing | 200 | HTML | 88 ms | 635 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/quickstart | 200 | HTML | 440 ms | 647 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/your-first-async-request | 200 | HTML | 116 ms | 1 MB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/faqs | 200 | HTML | 132 ms | 1 MB | 0 s | 2/2 | 1/6
/api-reference/archive-api/run-a-search | 200 | HTML | 140 ms | 696 kB | 0 s | 2/2 | 1/6
/datasets/archive/api-reference | 307 | Redirect | 200 ms | 143 B | 0 s | |
/datasets/archive/data-range-vs-delivery-time | 200 | HTML | 118 ms | 608 kB | 0 s | 2/2 | 1/6
/datasets/scraper-studio/faqs | 200 | HTML | 335 ms | 802 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/query-parameters/duckduckgo | 200 | HTML | 178 ms | 745 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/query-parameters/bing | 200 | HTML | 101 ms | 791 kB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/query-parameters/yandex | 200 | HTML | 129 ms | 748 kB | 0 s | 2/2 | 1/6
/datasets/scrapers/scrapers-library/overview | 200 | HTML | 114 ms | 1 MB | 0 s | 2/2 | 1/6
/scraping-automation/serp-api/get-started-bing-serp-api | 200 | HTML | 163 ms | 707 kB | 0 s | 2/2 | 1/6
/general/usage-monitoring/Monitoring_Residential_Network_Usage | 200 | HTML | 224 ms | 610 kB | 0 s | 2/2 | 1/6
/general/usage-monitoring/serp-rate-limit | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/usage-monitoring/Event_log | 200 | HTML | 257 ms | 616 kB | 0 s | 2/2 | 1/6
/general/usage-monitoring/bandwidth | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/usage-monitoring/Usage | 200 | HTML | 235 ms | 626 kB | 0 s | 2/2 | 1/6
/general/authentication/How_to_set_up_Azur…ID_with_Bright_Data | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/serp-api/header-parameters/google | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/integrations/vercel-ai-sdk | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/integrations/ibm-watsonx-orchestrate | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/integrations/haystack | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/integrations/hugging-face | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/integrations/mastra | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/web-unlocker/your-first-async-request | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/web-unlocker/configuration | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/web-unlocker/send-your-first-request | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/account/billing-and-pricing/payment | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/web-unlocker/quickstart | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/web-unlocker/five-minute-how-to | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/web-unlocker/bestpractices | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/warc-ide | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/data-validation/data-validation-for-customers | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/rest-api/scraper/crawl-api | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/rest-api/scraper/asynchronous-requests | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_Zone_passwords | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Add_a_Zone | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…th_stats_for_a_Zone | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_Available_Countries | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Add_…_Datacenter_ISP_IPs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_Zone_permissions | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Remo…ted_residential_IPs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_country_cities | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…_for_all_your_Zones | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Change_account_status | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…acenter_and_ISP_IPs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Migr…P_IPs_between_zones | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…ng_to_use_your_Zone | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Remove_Zone | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/domain-consumption | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…_Datacenter_ISP_IPs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…th_stats_for_a_Zone | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_account_status | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…er_ISP_IPs_per_Zone | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Remo…_Datacenter_ISP_IPs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/zone-ip-denylist | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…rent_service_status | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/get-all-zones | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…onnectivity_problem | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…balance_through_API | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_Zone_info | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…network_per_country | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/zone-ip-allowlist | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_…ential_IPs_per_Zone | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Get_Zone_status | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api/Turn_on_off_Zone | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/marketplace-dataset-api/get-dataset-metadata | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/marketplace-dataset-api/filter-dataset | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/marketplace-dataset-api/deliver-snapshot | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/marketplace-dataset-api/get-snapshot-parts | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/marketplace-dataset-api/dow…file-by-snapshot_id | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/marketplace-dataset-api/troubleshooting | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/browser-api/get-sessions | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/marketplace-dataset-api/get-snapshot-meta | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/marketplace-dataset-api/fil…with-csv-json-files | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scrapers/scrapers-library/delivery-options | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scrapers/scrapers-library/custom-inputs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/scrapers | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scrapers/scrapers-library/working-with-sources | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scrapers/scrapers-library/faqs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scrapers/managed-services | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scrapers/scrapers-library/authentication-guide | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scrapers/scrapers-library/deadline-feature | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scrapers/scrapers-library/quickstart | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/policy/What_is_Bright_Data_platform | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/serp-api/get-started-google-serp-api | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/rest-api/unlocker/unlock-website | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/ai/mcp-server/remote/advanced | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/ai/mcp-server/local/quickstart | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/ai/mcp-server/local/advanced | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/SDK-PY | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/marketplace/dataset-view | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scrapers/custom-scrapers/custom-dataset-api | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/ai/mcp-server/integrations/overview | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/marketplace/purchase-options | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/marketplace/faqs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/marketplace/customization-and-filtering | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/marketplace/pricing | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/deep-lookup/code-examples | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/scraping-browser/faqs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/scraping-browser/quickstart | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/scraping-browser/code-examples | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/scraping-browser/five-minute-how-to | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/scraping-browser/configuration | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/integrations/bright-data | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/ai/cookbooks/data-enrichment | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/ai/mcp-server/integrations/cloudflare-agents | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/ai/mcp-server/integrations/claude | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/ai/mcp-server/integrations/cursor | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/proxy-networks/mobile/introduction | 403 | HTML | 9 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/introduction | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/marketplace/filter-dataset-by-api | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/cloud-providers/snowflake | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/account/billing-and-pricing/faqs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/account-management-api | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/account/billing-and-pricing/payment-verification | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/scraping-shield-api/all-classification-data | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/bright-shield/asset-shield | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/bright-shield/introduction | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/browser-extension/features | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/browser-extension/quickstart | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/browser-extension/faqs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/browser-extension/install | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/browser-extension/configuration | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/easy-scraper/faqs | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy/select_a_specific_ip | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy/send_requests_directly_from_super_proxy | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy/c-tag | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/scraping-shield-api/samples…classification-data | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy/keep_same_peer_in_session | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy/os_targeting | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy/select_a_specific_gip | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/proxy-networks/mobile/quickstart | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/proxy-networks/isp/faqs | -6:SKP | Other | 0 ms | 0 B | none | |
/proxy-networks/data-center/faqs | -6:SKP | Other | 0 ms | 0 B | none | |
/proxy-networks/isp/quickstart | -6:SKP | Other | 0 ms | 0 B | none | |
/proxy-networks/mobile/configure-your-proxy | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy-manager/allowlist-ips | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/proxy-networks/mobile/send-your-first-request | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/proxy-networks/data-center/quickstart | -6:SKP | Other | 0 ms | 0 B | none | |
/proxy-networks/isp/configure-your-proxy | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/proxy-networks/isp/send-your-first-request | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/proxy-networks/data-center/configure-your-proxy | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/proxy-networks/data-center/send-your-first-request | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy-manager/create_a_new_proxy_port | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy-manager/update_a_proxy_port | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/proxy-manager/get_the_lates…xy_manager_versions | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/account/billing-and-pricing/premium-ips | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/account/billing-and-pricing/costs-explorer | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/account/billing-and-pricing/payment-methods | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/account/billing-and-pricing/bright-rewards-program | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/account/billing-and-pricing/promo-codes | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/rest-api/serp/request | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/rest-api/serp/get-results | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/scraping-automation/serp-api/query-parameters | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/unlocker/sending_first_request | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/archive-api/get-snapshot-status | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/archive-api/deliver-to-cloud | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/archive-api/get-search-status | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/self-healing-tool | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/worker-types | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/functions/develop-a-scraper | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/best-practices | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/ai-agent | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/scraper-studio-ide-interface | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/features | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/functions | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/specifications | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/videos | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/initiate-collecti…nd-delivery-options | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/develop-a-scraper | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/datasets/scraper-studio/basics-of-web-scraping | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/scrapers/management-apis/monitor-progress | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/scrapers/management-apis/monitor-delivery | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/scrapers/management-apis | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/scrapers/management-apis/cancel-snapshot | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/api-reference/scrapers/management-apis/get-snapshots | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
/general/account/billing-and-pricing | 403 | HTML | 10 ms | 33 kB | 0 s | | 1/5
Skipped URLs Summary
--------------------
Reason | Domain | Unique URLs
-------------------------------------------------------------------
Not allowed host | brightdata.com | 91
Not allowed host | github.com | 14
Not allowed host | www.youtube.com | 8
Not allowed host | www.bing.com | 6
Not allowed host | chrome.google.com | 4
Not allowed host | api.brightdata.com | 3
Not allowed host | nodejs.org | 3
Not allowed host | apify.com | 2
Not allowed host | cloud.webscraper.io | 2
Not allowed host | addons.mozilla.org | 2
Not allowed host | bgp.potaroo.net | 2
Not allowed host | brd.superproxy.io | 2
Not allowed host | www.postman.com | 2
Not allowed host | www.google.com | 2
Not allowed host | docs.picaos.com | 2
Not allowed host | www.picaos.com | 2
Not allowed host | httpbin.org | 2
Not allowed host | app.xpander.ai | 2
Not allowed host | dolphin-anty.com | 1
Not allowed host | openai.com | 1
Not allowed host | dicloak.com | 1
Not allowed host | xlogin.us | 1
Not allowed host | learn.microsoft.com | 1
Not allowed host | www.octoparse.com | 1
Not allowed host | youtu.be | 1
Not allowed host | xpander.ai | 1
Not allowed host | chromewebstore.google.com | 1
Not allowed host | www.dynamicyield.com | 1
Not allowed host | www.marketerbrowser.com | 1
Not allowed host | developers.google.com | 1
Not allowed host | lumtest.com | 1
Not allowed host | www.vmlogin.us | 1
Not allowed host | undetectable.io | 1
Not allowed host | incogniton.com | 1
Not allowed host | vercel.link | 1
Not allowed host | www.goodreads.com | 1
Not allowed host | www.bitbrowser.net | 1
Not allowed host | community.n8n.io | 1
Not allowed host | trends.google.com | 1
Not allowed host | sys.smlogin.cc | 1
Not allowed host | hub.docker.com | 1
Not allowed host | www.maskfog.com | 1
Not allowed host | linkensphere.info | 1
Not allowed host | localhost | 1
Not allowed host | www.lalicat.com | 1
Not allowed host | www.adspower.com | 1
Not allowed host | www.python.org | 1
Not allowed host | http3check.net | 1
Not allowed host | www.mulogin.com | 1
Not allowed host | nginx.org | 1
Not allowed host | www.morelogin.com | 1
Not allowed host | hidemyacc.com | 1
Not allowed host | dashboard.mintlify.com | 1
Not allowed host | stabler.tech | 1
Not allowed host | changedetection.io | 1
Not allowed host | en.wikipedia.org | 1
Not allowed host | smithery.ai | 1
Not allowed host | kameleo.io | 1
Not allowed host | ghostbrowser.com | 1
Not allowed host | multilogin.com | 1
Not allowed host | www.make.com | 1
Not allowed host | easync.io | 1
Not allowed host | geelark.com | 1
Not allowed host | octobrowser.net | 1
Not allowed host | curl.se | 1
Not allowed host | gologin.com | 1
Not allowed host | account.aezakmi.run | 1
Not allowed host | gpt.brightdata.com | 1
Not allowed host | www.clonbrowser.com | 1
Not allowed host | www.capsolver.com | 1
Not allowed host | genlogin.com | 1
Not allowed host | www.proxifier.com | 1
Not allowed host | il.linkedin.com | 1
Not allowed host | app.arcade.software | 1
Not allowed host | developers.whatismybrowser.com | 1
Not allowed host | phantombuster.com | 1
Not allowed host | www.maxmind.com | 1
Not allowed host | antik.io | 1
Not allowed host | docs.npmjs.com | 1
Not allowed host | developer.chrome.com | 1
Not allowed host | aezakmi.run | 1
Not allowed host | your-domain.com | 1
Not allowed host | www.rfc-editor.org | 1
Not allowed host | www.heliumscraper.com | 1
Not allowed host | www.promptlayer.com | 1
Not allowed host | www.base64encode.org | 1
Not allowed host | marketplace.dify.ai | 1
Not allowed host | help.brightdata.com | 1
Not allowed host | texau.com | 1
Not allowed host | www.npmjs.com | 1
Not allowed host | vmlogin.us | 1
Not allowed host | ixbrowser.com | 1
Not allowed host | www.nationsonline.org | 1
Not allowed host | www.screamingfrog.co.uk | 1
Skipped URLs
------------
Reason | Skipped URL | Source | Found at URL
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Not allowed host | http://bgp.potaroo.net/cidr/autnums.html | | /api-reference/proxy/geolocation-targeting
Not allowed host | http://brd.superproxy.io/ | | /integrations/changedetection
Not allowed host | http://brd.superproxy.io/). | | /integrations/xlogin
Not allowed host | http://brightdata.com/ | | /proxy-networks/errorCatalog
Not allowed host | http://brightdata.com/cp/kyc | | /proxy-networks/errorCatalog
Not allowed host | http://httpbin.org/ip | | /integrations/marketerbrowser
Not allowed host | http://www.google.com/maps/place/data=!3m1!4b1!4m2!3m1!1s | | /scraping-automation/serp-api/query-parameters/google
Not allowed host | https://account.aezakmi.run/ | | /integrations/aezakmi
Not allowed host | https://addons.mozilla.org/en-US/firefox…foxyproxy-standard/ | | /integrations/foxyproxy
Not allowed host | https://addons.mozilla.org/en-US/firefox/addon/switchyomega | | /integrations/switchyomega
Not allowed host | https://aezakmi.run/ | | /integrations/aezakmi
Not allowed host | https://antik.io/ | | /integrations/antik
Not allowed host | https://api.brightdata.com/request | | /scraping-automation/serp-api/send-your-first-request
Not allowed host | https://api.brightdata.com/serp/duckduckgo/kad_values | | /scraping-automation/serp-api/query-parameters/duckduckgo
Not allowed host | https://api.brightdata.com/serp/duckduckgo/kl_values | | /scraping-automation/serp-api/query-parameters/duckduckgo
Not allowed host | https://apify.com/ | | /integrations/apify
Not allowed host | https://apify.com/apify/web-scraper | | /integrations/apify
Not allowed host | https://app.arcade.software/share/BPGoTdRmf89Ip1EQuIOW | | /datasets/scrapers/scrapers-library/overview
Not allowed host | https://app.xpander.ai/agents | | /integrations/xpander-ai
Not allowed host | https://app.xpander.ai/login | | /integrations/xpander-ai
Not allowed host | https://bgp.potaroo.net/cidr/autnums.html | | /proxy-networks/config-options
Not allowed host | https://brightdata.com/ | | /introduction
Not allowed host | https://brightdata.com/?hs_signup=1&utm_source=docs | | /introduction
Not allowed host | https://brightdata.com/?hs_signup=1&utm_…campaign=playground | | /api-reference/account-management-api/Get_active_Zones
Not allowed host | https://brightdata.com/?hs_signup=160692 | | /release-notes
Not allowed host | https://brightdata.com/acceptable-use-policy | | /proxy-networks/residential/network-access
Not allowed host | https://brightdata.com/affiliate | | /general/account/referral-program
Not allowed host | https://brightdata.com/ai/mcp-server | | /release-notes
Not allowed host | https://brightdata.com/ai/playground-chat | | /release-notes
Not allowed host | https://brightdata.com/ai/video-data | | /ai/training
Not allowed host | https://brightdata.com/blog/web-data/what-is-data-parsing | | /scraping-automation/serp-api/parsed-jso…sing-search-results
Not allowed host | https://brightdata.com/check_your_data | | /general/faqs
Not allowed host | https://brightdata.com/contact | | /ai/introduction
Not allowed host | https://brightdata.com/cp | | /integrations/make
Not allowed host | https://brightdata.com/cp/account_verification | | /proxy-networks/errorCatalog
Not allowed host | https://brightdata.com/cp/api_keys | | /api-reference/SDK
Not allowed host | https://brightdata.com/cp/billing/settings | | /general/account/faqs
Not allowed host | https://brightdata.com/cp/billing_flow | | /general/faqs
Not allowed host | https://brightdata.com/cp/data_api?search=facebook | | /general/websites
Not allowed host | https://brightdata.com/cp/data_api?search=glassdoor | | /general/websites
Not allowed host | https://brightdata.com/cp/data_collector/collectors/create | | /datasets/scraper-studio/faqs
Not allowed host | https://brightdata.com/cp/datasets/brows…d_lk122xxgf86xf97py | | /general/websites
Not allowed host | https://brightdata.com/cp/datasets/brows…ategory=real_estate | | /general/websites
Not allowed host | https://brightdata.com/cp/datasets/browse?search=amazon | | /general/websites
Not allowed host | https://brightdata.com/cp/datasets/browse?search=facebook | | /general/websites
Not allowed host | https://brightdata.com/cp/datasets/browse?search=g2 | | /general/websites
Not allowed host | https://brightdata.com/cp/datasets/browse?search=glassdoor | | /general/websites
Not allowed host | https://brightdata.com/cp/datasets/browse?search=homedepot | | /general/websites
Not allowed host | https://brightdata.com/cp/datasets/browse?search=shein | | /general/websites
Not allowed host | https://brightdata.com/cp/datasets/requests/services | | /datasets/scraper-studio/faqs
Not allowed host | https://brightdata.com/cp/deep_lookup | | /release-notes
Not allowed host | https://brightdata.com/cp/ips_availability | | /proxy-networks/residential/faqs
Not allowed host | https://brightdata.com/cp/kyc | | /proxy-networks/errorCatalog
Not allowed host | https://brightdata.com/cp/learn_more/serp-api | | /scraping-automation/serp-api/introduction
Not allowed host | https://brightdata.com/cp/lpm | | /proxy-networks/proxy-manager/faqs
Not allowed host | https://brightdata.com/cp/mcp | | /release-notes
Not allowed host | https://brightdata.com/cp/mcp/configure | | /release-notes
Not allowed host | https://brightdata.com/cp/scrapers/api/g…ew?nav_from=&id=all | | /release-notes
Not allowed host | https://brightdata.com/cp/scrapers/api/g…url/overview?id=all | | /release-notes
Not allowed host | https://brightdata.com/cp/scrapers/api/g…pdp/overview?id=all | | /release-notes
Not allowed host | https://brightdata.com/cp/scrapers/api/g…pdp/overview?id=all | | /release-notes
Not allowed host | https://brightdata.com/cp/scrapers/api/g…pdp/overview?id=all | | /release-notes
Not allowed host | https://brightdata.com/cp/scrapers/api/g…iew?nav_from&id=all | | /release-notes
Not allowed host | https://brightdata.com/cp/scrapers/api/g…pdp/overview?id=all | | /release-notes
Not allowed host | https://brightdata.com/cp/scrapers/api/g…iew?nav_from&id=all | | /release-notes
Not allowed host | https://brightdata.com/cp/scrapers/browse | | /datasets/scrapers/scrapers-library/overview
Not allowed host | https://brightdata.com/cp/scrapers/browse?category=all | | /datasets/scrapers/scrapers-library/overview
Not allowed host | https://brightdata.com/cp/scrapers/brows…lassdoor.com&id=all | | /release-notes
Not allowed host | https://brightdata.com/cp/serp_api/api/google/hotels | | /scraping-automation/serp-api/faqs
Not allowed host | https://brightdata.com/cp/setting | | /cli/installation
Not allowed host | https://brightdata.com/cp/setting/auth | | /general/account/faqs
Not allowed host | https://brightdata.com/cp/setting/billing | | /proxy-networks/errorCatalog
Not allowed host | https://brightdata.com/cp/setting/customer_details | | /general/faqs
Not allowed host | https://brightdata.com/cp/setting/logs_delivery | | /proxy-networks/faqs
Not allowed host | https://brightdata.com/cp/setting/users | | /api-reference/SDK-JS
Not allowed host | https://brightdata.com/cp/settings/billing | | /proxy-networks/errorCatalog
Not allowed host | https://brightdata.com/cp/start | | /scraping-automation/serp-api/introduction
Not allowed host | https://brightdata.com/cp/web_access/playground | | /release-notes
Not allowed host | https://brightdata.com/cp/zones | | /api-reference/authentication
Not allowed host | https://brightdata.com/cp/zones/ | | /proxy-networks/errorCatalog
Not allowed host | https://brightdata.com/cp/zones/dashboard | | /release-notes
Not allowed host | https://brightdata.com/cp/zones/lpm | | /proxy-networks/proxy-manager/quickstart
Not allowed host | https://brightdata.com/cp/zones/order_ips/new | | /release-notes
Not allowed host | https://brightdata.com/cp/zones/page/plans | | /integrations/proxifier
Not allowed host | https://brightdata.com/cp/zones/proxy_examples | | /proxy-networks/config-options
Not allowed host | https://brightdata.com/cp/zones/serp_playground | | /scraping-automation/serp-api/faqs
Not allowed host | https://brightdata.com/faq | | /proxy-networks/proxy-manager/integration
Not allowed host | https://brightdata.com/license | | /proxy-networks/residential/network-access
Not allowed host | https://brightdata.com/network-status | | /proxy-networks/errorCatalog
Not allowed host | https://brightdata.com/pricing | | /scraping-automation/web-unlocker/features
Not allowed host | https://brightdata.com/pricing/proxy-net…y&type=res_rotating | | /proxy-networks/proxy-manager/introduction
Not allowed host | https://brightdata.com/pricing/serp?utm_…mpaign=serp_pricing | | /scraping-automation/serp-api/pricing-and-billing
Not allowed host | https://brightdata.com/privacy | | /proxy-networks/residential/network-access
Not allowed host | https://brightdata.com/products/datasets | | /api-reference/terminology
Not allowed host | https://brightdata.com/products/proxy-manager | | /integrations/insomniac
Not allowed host | https://brightdata.com/products/scraping-browser | | /scraping-automation/web-unlocker/introduction
Not allowed host | https://brightdata.com/products/serp-api | | /scraping-automation/serp-api/quickstart
Not allowed host | https://brightdata.com/products/web-scraper | | /integrations/xpander-ai
Not allowed host | https://brightdata.com/products/web-unlocker | | /proxy-networks/data-center/introduction
Not allowed host | https://brightdata.com/proxy-types | | /proxy-networks/residential/introduction
Not allowed host | https://brightdata.com/proxy-types/ | | /integrations/xpander-ai
Not allowed host | https://brightdata.com/proxy-types/datacenter-proxies | | /proxy-networks/faqs
Not allowed host | https://brightdata.com/proxy-types/isp-proxies | | /proxy-networks/faqs
Not allowed host | https://brightdata.com/proxy-types/residential-proxies | | /proxy-networks/residential/introduction
Not allowed host | https://brightdata.com/referral/ | | /general/account/referral-program
Not allowed host | https://brightdata.com/solutions/socks5-proxies | | /proxy-networks/socks5
Not allowed host | https://brightdata.com/trustcenter | | /ai/training
Not allowed host | https://brightdata.com/use-cases | | /integrations/smlogin
Not allowed host | https://brightdata.com/video/unblock_error_codes | | /proxy-networks/proxy-manager/faqs
Not allowed host | https://brightdata.com/webinar/how-to-st…-data-proxy-manager | | /proxy-networks/proxy-manager/quickstart
Not allowed host | https://changedetection.io/ | | /integrations/changedetection
Not allowed host | https://chrome.google.com/webstore/detai…eppjpebenaool?hl=en | | /proxy-networks/website-blocking
Not allowed host | https://chrome.google.com/webstore/detai…ifijomclgjgif?hl=en | | /integrations/switchyomega
Not allowed host | https://chrome.google.com/webstore/detai…afknkgmokldgolkdfig | | /integrations/sessionbox
Not allowed host | https://chrome.google.com/webstore/detai…hllkliplmbmhn?hl=en | | /integrations/webscraper
Not allowed host | https://chromewebstore.google.com/detail…fmlnjonogaaifnjlfnp | | /integrations/foxyproxy
Not allowed host | https://cloud.webscraper.io/register?luminati | | /integrations/webscraper
Not allowed host | https://cloud.webscraper.io/subscription-manager?luminati | | /integrations/webscraper
Not allowed host | https://community.n8n.io/t/bright-data-c…ping-anything/92011 | | /integrations/n8n
Not allowed host | https://curl.se/ | | /scraping-automation/serp-api/your-first-async-request
Not allowed host | https://dashboard.mintlify.com/editor | | /proxy-networks/faqs
Not allowed host | https://developer.chrome.com/docs/chromedriver/ | | /integrations/selenium
Not allowed host | https://developers.google.com/adwords/ap…pendix/geotargeting | | /scraping-automation/serp-api/query-parameters/google
Not allowed host | https://developers.whatismybrowser.com/useragents/explore/ | | /proxy-networks/proxy-manager/configuration
Not allowed host | https://dicloak.com/download | | /integrations/dicloak
Not allowed host | https://docs.npmjs.com/about-npm | | /proxy-networks/proxy-manager/configuration
Not allowed host | https://docs.picaos.com/sdk/mcp | | /integrations/pica
Not allowed host | https://docs.picaos.com/sdk/vercel-ai | | /integrations/pica
Not allowed host | https://dolphin-anty.com/ | | /integrations/dolphin-anty
Not allowed host | https://easync.io/ | | /integrations/easync
Not allowed host | https://en.wikipedia.org/wiki/ISO_3166-2 | | /api-reference/proxy/geolocation-targeting
Not allowed host | https://geelark.com/ | | /integrations/geelark
Not allowed host | https://genlogin.com/ | | /integrations/genlogin
Not allowed host | https://ghostbrowser.com/download/ | | /integrations/ghost-browser
Not allowed host | https://github.com/MeirKaD/MCP_ADK | | /ai/mcp-server/usage-examples
Not allowed host | https://github.com/bitswired/jobwizard | | /ai/mcp-server/usage-examples
Not allowed host | https://github.com/brightdata/brightdata-mcp | | /ai/mcp-server/faqs
Not allowed host | https://github.com/brightdata/brightdata-mcp/tree/main | | /integrations/dify
Not allowed host | https://github.com/brightdata/brightdata…?tab=readme-ov-file | | /ai/mcp-server/faqs
Not allowed host | https://github.com/brightdata/skills | | /ai/for-agents/skills
Not allowed host | https://github.com/llSourcell/my_ai_intern | | /ai/mcp-server/usage-examples
Not allowed host | https://github.com/luminati-io | | /introduction
Not allowed host | https://github.com/luminati-io/luminati-proxy | | /proxy-networks/proxy-manager/introduction
Not allowed host | https://github.com/luminati-io/luminati-proxy/ | | /proxy-networks/proxy-manager/faqs
Not allowed host | https://github.com/luminati-io/luminati-proxy/tags | | /proxy-networks/proxy-manager/configuration
Not allowed host | https://github.com/openbullet/OpenBullet2 | | /integrations/openbullet
Not allowed host | https://github.com/techwithtim/BrightDataMCPServerAgent | | /ai/mcp-server/usage-examples
Not allowed host | https://github.com/vercel-labs/skills | | /ai/for-agents/skills
Not allowed host | https://gologin.com/ | | /integrations/gologin
Not allowed host | https://gpt.brightdata.com/link | | /release-notes
Not allowed host | https://help.brightdata.com/hc/en-us/requests/new | | /introduction
Not allowed host | https://hidemyacc.com/ | | /integrations/hidemyacc
Not allowed host | https://http3check.net/ | | /proxy-networks/faqs
Not allowed host | https://httpbin.org/ip | | /integrations/postman
Not allowed host | https://hub.docker.com/r/luminati/luminati-proxy/ | | /proxy-networks/proxy-manager/configuration
Not allowed host | https://il.linkedin.com/company/bright-data | | /introduction
Not allowed host | https://incogniton.com/ | | /integrations/incogniton
Not allowed host | https://ixbrowser.com/ | | /integrations/ixbrowser
Not allowed host | https://kameleo.io/downloads/ | | /integrations/kameleo
Not allowed host | https://learn.microsoft.com/en-us/lifecy…arch-api-retirement | | /scraping-automation/serp-api/parsed-jso…erp-migration-guide
Not allowed host | https://linkensphere.info/en/ | | /integrations/sphere-browser
Not allowed host | https://localhost:3000/api-reference/authentication | | /scraping-automation/serp-api/your-first-async-request
Not allowed host | https://lumtest.com/myip.json%E2%80%9D | | /proxy-networks/residential/send-your-first-request
Not allowed host | https://marketplace.dify.ai/plugins/idanvilenski/brightdata | | /integrations/dify
Not allowed host | https://multilogin.com/ | | /integrations/multilogin
Not allowed host | https://nginx.org/en/download.html | | /integrations/nginx
Not allowed host | https://nodejs.org/ | | /integrations/puppeteer
Not allowed host | https://nodejs.org/en/about/ | | /proxy-networks/proxy-manager/configuration
Not allowed host | https://nodejs.org/en/download | | /ai/mcp-server/faqs
Not allowed host | https://octobrowser.net/download/ | | /integrations/octobrowser
Not allowed host | https://openai.com/index/hello-gpt-4o/ | | /integrations/xpander-ai
Not allowed host | https://phantombuster.com/ | | /integrations/phantombuster
Not allowed host | https://smithery.ai/server/@luminati-io/brightdata-mcp/tools | | /integrations/dify
Not allowed host | https://stabler.tech/ | | /integrations/stablersolo
Not allowed host | https://sys.smlogin.cc/ | | /integrations/smlogin
Not allowed host | https://texau.com/ | | /integrations/texau
Not allowed host | https://trends.google.com/trends/api/exp…y?lang=en-US&tz=240 | | /scraping-automation/serp-api/query-parameters/google
Not allowed host | https://undetectable.io/ | | /integrations/undetectable
Not allowed host | https://vercel.link/security-checkpoint | | /general/usage-monitoring/serp-rate-limit
Not allowed host | https://vmlogin.us/?ref=luminati | | /proxy-networks/proxy-manager/integration
Not allowed host | https://www.adspower.com/download | | /integrations/adspower
Not allowed host | https://www.base64encode.org/ | | /proxy-networks/proxy-manager/faqs
Not allowed host | https://www.bing.com/search?q=YOUR_QUERY | | /scraping-automation/serp-api/faqs
Not allowed host | https://www.bing.com/search?q=YOUR_QUERY…ilters=ex1%3a%22ez1 | | /scraping-automation/serp-api/faqs
Not allowed host | https://www.bing.com/search?q=YOUR_QUERY…ilters=ex1%3a%22ez2 | | /scraping-automation/serp-api/faqs
Not allowed host | https://www.bing.com/search?q=YOUR_QUERY…ilters=ex1%3a%22ez3 | | /scraping-automation/serp-api/faqs
Not allowed host | https://www.bing.com/search?q=YOUR_QUERY…teSequence%E2%80%9D | | /scraping-automation/serp-api/faqs
Not allowed host | https://www.bing.com/search?q=pizza&filt…:%22ez5_19757_19773 | | /scraping-automation/serp-api/faqs
Not allowed host | https://www.bitbrowser.net/ | | /integrations/bitbrowser
Not allowed host | https://www.capsolver.com/ | | /integrations/capsolver
Not allowed host | https://www.clonbrowser.com/ | | /integrations/clonbrowser
Not allowed host | https://www.dynamicyield.com/glossary/product-detail-page/ | | /integrations/xpander-ai
Not allowed host | https://www.goodreads.com/ | | /release-notes
Not allowed host | https://www.google.com/search?q=hilton%2…ew%20york%20midtown | | /scraping-automation/serp-api/query-parameters/google
Not allowed host | https://www.heliumscraper.com/eng/download.php | | /integrations/helium-scraper
Not allowed host | https://www.lalicat.com/download | | /integrations/lalicat
Not allowed host | https://www.make.com/en/integrations/brightdata | | /integrations/make
Not allowed host | https://www.marketerbrowser.com/ | | /integrations/marketerbrowser
Not allowed host | https://www.maskfog.com/ | | /integrations/maskfog
Not allowed host | https://www.maxmind.com/en/geoip-demo | | /proxy-networks/mobile/faqs
External URLs
-------------
External URL | Pages | Found on URL (max 5)
-------------------------------------------------------------------------------------------------------------------------------------
http://bgp.potaroo.net/cidr/autnums.html | 1 | /api-reference/proxy/geolocation-targeting
http://brd.superproxy.io/ | 1 | /integrations/changedetection
http://brd.superproxy.io/). | 1 | /integrations/xlogin
http://brightdata.com/ | 1 | /proxy-networks/errorCatalog
http://brightdata.com/cp/kyc | 1 | /proxy-networks/errorCatalog
http://httpbin.org/ip | 1 | /integrations/marketerbrowser
http://www.google.com/maps/place/data=!3m1!4b1!4m2!3m1!1s | 1 | /scraping-automation/serp-api/query-parameters/google
https://account.aezakmi.run/ | 1 | /integrations/aezakmi
https://addons.mozilla.org/en-US/firefox…foxyproxy-standard/ | 1 | /integrations/foxyproxy
https://addons.mozilla.org/en-US/firefox/addon/switchyomega | 1 | /integrations/switchyomega
https://aezakmi.run/ | 1 | /integrations/aezakmi
https://antik.io/ | 1 | /integrations/antik
https://api.brightdata.com/request | 1 | /scraping-automation/serp-api/send-your-first-request
https://api.brightdata.com/serp/duckduckgo/kad_values | 1 | /scraping-automation/serp-api/query-parameters/duckduckgo
https://api.brightdata.com/serp/duckduckgo/kl_values | 1 | /scraping-automation/serp-api/query-parameters/duckduckgo
https://apify.com/ | 1 | /integrations/apify
https://apify.com/apify/web-scraper | 1 | /integrations/apify
https://app.arcade.software/share/BPGoTdRmf89Ip1EQuIOW | 1 | /datasets/scrapers/scrapers-library/overview
https://app.xpander.ai/agents | 1 | /integrations/xpander-ai
https://app.xpander.ai/login | 1 | /integrations/xpander-ai
https://bgp.potaroo.net/cidr/autnums.html | 1 | /proxy-networks/config-options
https://brightdata.com/ | 1 | /introduction
https://brightdata.com/?hs_signup=1&utm_source=docs | 1 | /introduction
https://brightdata.com/?hs_signup=1&utm_…campaign=playground | 1 | /api-reference/account-management-api/Get_active_Zones
https://brightdata.com/?hs_signup=160692 | 1 | /release-notes
https://brightdata.com/acceptable-use-policy | 1 | /proxy-networks/residential/network-access
https://brightdata.com/affiliate | 1 | /general/account/referral-program
https://brightdata.com/ai/mcp-server | 1 | /release-notes
https://brightdata.com/ai/playground-chat | 1 | /release-notes
https://brightdata.com/ai/video-data | 1 | /ai/training
https://brightdata.com/blog/web-data/what-is-data-parsing | 1 | /scraping-automation/serp-api/parsed-jso…sing-search-results
https://brightdata.com/check_your_data | 1 | /general/faqs
https://brightdata.com/contact | 1 | /ai/introduction
https://brightdata.com/cp | 1 | /integrations/make
https://brightdata.com/cp/account_verification | 1 | /proxy-networks/errorCatalog
https://brightdata.com/cp/api_keys | 1 | /api-reference/SDK
https://brightdata.com/cp/billing/settings | 1 | /general/account/faqs
https://brightdata.com/cp/billing_flow | 1 | /general/faqs
https://brightdata.com/cp/data_api?search=facebook | 1 | /general/websites
https://brightdata.com/cp/data_api?search=glassdoor | 1 | /general/websites
https://brightdata.com/cp/data_collector/collectors/create | 1 | /datasets/scraper-studio/faqs
https://brightdata.com/cp/datasets/brows…d_lk122xxgf86xf97py | 1 | /general/websites
https://brightdata.com/cp/datasets/brows…ategory=real_estate | 1 | /general/websites
https://brightdata.com/cp/datasets/browse?search=amazon | 1 | /general/websites
https://brightdata.com/cp/datasets/browse?search=facebook | 1 | /general/websites
https://brightdata.com/cp/datasets/browse?search=g2 | 1 | /general/websites
https://brightdata.com/cp/datasets/browse?search=glassdoor | 1 | /general/websites
https://brightdata.com/cp/datasets/browse?search=homedepot | 1 | /general/websites
https://brightdata.com/cp/datasets/browse?search=shein | 1 | /general/websites
https://brightdata.com/cp/datasets/requests/services | 1 | /datasets/scraper-studio/faqs
https://brightdata.com/cp/deep_lookup | 1 | /release-notes
https://brightdata.com/cp/ips_availability | 1 | /proxy-networks/residential/faqs
https://brightdata.com/cp/kyc | 1 | /proxy-networks/errorCatalog
https://brightdata.com/cp/learn_more/serp-api | 1 | /scraping-automation/serp-api/introduction
https://brightdata.com/cp/lpm | 1 | /proxy-networks/proxy-manager/faqs
https://brightdata.com/cp/mcp | 1 | /release-notes
https://brightdata.com/cp/mcp/configure | 1 | /release-notes
https://brightdata.com/cp/scrapers/api/g…ew?nav_from=&id=all | 1 | /release-notes
https://brightdata.com/cp/scrapers/api/g…url/overview?id=all | 1 | /release-notes
https://brightdata.com/cp/scrapers/api/g…pdp/overview?id=all | 1 | /release-notes
https://brightdata.com/cp/scrapers/api/g…pdp/overview?id=all | 1 | /release-notes
https://brightdata.com/cp/scrapers/api/g…pdp/overview?id=all | 1 | /release-notes
https://brightdata.com/cp/scrapers/api/g…iew?nav_from&id=all | 1 | /release-notes
https://brightdata.com/cp/scrapers/api/g…pdp/overview?id=all | 1 | /release-notes
https://brightdata.com/cp/scrapers/api/g…iew?nav_from&id=all | 1 | /release-notes
https://brightdata.com/cp/scrapers/browse | 1 | /datasets/scrapers/scrapers-library/overview
https://brightdata.com/cp/scrapers/browse?category=all | 1 | /datasets/scrapers/scrapers-library/overview
https://brightdata.com/cp/scrapers/brows…lassdoor.com&id=all | 1 | /release-notes
https://brightdata.com/cp/serp_api/api/google/hotels | 1 | /scraping-automation/serp-api/faqs
https://brightdata.com/cp/setting | 1 | /cli/installation
https://brightdata.com/cp/setting/auth | 1 | /general/account/faqs
https://brightdata.com/cp/setting/billing | 1 | /proxy-networks/errorCatalog
https://brightdata.com/cp/setting/customer_details | 1 | /general/faqs
https://brightdata.com/cp/setting/logs_delivery | 1 | /proxy-networks/faqs
https://brightdata.com/cp/setting/users | 1 | /api-reference/SDK-JS
https://brightdata.com/cp/settings/billing | 1 | /proxy-networks/errorCatalog
https://brightdata.com/cp/start | 1 | /scraping-automation/serp-api/introduction
https://brightdata.com/cp/web_access/playground | 1 | /release-notes
https://brightdata.com/cp/zones | 1 | /api-reference/authentication
https://brightdata.com/cp/zones/ | 1 | /proxy-networks/errorCatalog
https://brightdata.com/cp/zones/dashboard | 1 | /release-notes
https://brightdata.com/cp/zones/lpm | 1 | /proxy-networks/proxy-manager/quickstart
https://brightdata.com/cp/zones/order_ips/new | 1 | /release-notes
https://brightdata.com/cp/zones/page/plans | 1 | /integrations/proxifier
https://brightdata.com/cp/zones/proxy_examples | 1 | /proxy-networks/config-options
https://brightdata.com/cp/zones/serp_playground | 1 | /scraping-automation/serp-api/faqs
https://brightdata.com/faq | 1 | /proxy-networks/proxy-manager/integration
https://brightdata.com/license | 1 | /proxy-networks/residential/network-access
https://brightdata.com/network-status | 1 | /proxy-networks/errorCatalog
https://brightdata.com/pricing | 1 | /scraping-automation/web-unlocker/features
https://brightdata.com/pricing/proxy-net…y&type=res_rotating | 1 | /proxy-networks/proxy-manager/introduction
https://brightdata.com/pricing/serp?utm_…mpaign=serp_pricing | 1 | /scraping-automation/serp-api/pricing-and-billing
https://brightdata.com/privacy | 1 | /proxy-networks/residential/network-access
https://brightdata.com/products/datasets | 1 | /api-reference/terminology
https://brightdata.com/products/proxy-manager | 1 | /integrations/insomniac
https://brightdata.com/products/scraping-browser | 1 | /scraping-automation/web-unlocker/introduction
https://brightdata.com/products/serp-api | 1 | /scraping-automation/serp-api/quickstart
https://brightdata.com/products/web-scraper | 1 | /integrations/xpander-ai
https://brightdata.com/products/web-unlocker | 1 | /proxy-networks/data-center/introduction
https://brightdata.com/proxy-types | 1 | /proxy-networks/residential/introduction
https://brightdata.com/proxy-types/ | 1 | /integrations/xpander-ai
https://brightdata.com/proxy-types/datacenter-proxies | 1 | /proxy-networks/faqs
https://brightdata.com/proxy-types/isp-proxies | 1 | /proxy-networks/faqs
https://brightdata.com/proxy-types/residential-proxies | 1 | /proxy-networks/residential/introduction
https://brightdata.com/referral/ | 1 | /general/account/referral-program
https://brightdata.com/solutions/socks5-proxies | 1 | /proxy-networks/socks5
https://brightdata.com/trustcenter | 1 | /ai/training
https://brightdata.com/use-cases | 1 | /integrations/smlogin
https://brightdata.com/video/unblock_error_codes | 1 | /proxy-networks/proxy-manager/faqs
https://brightdata.com/webinar/how-to-st…-data-proxy-manager | 1 | /proxy-networks/proxy-manager/quickstart
https://changedetection.io/ | 1 | /integrations/changedetection
https://chrome.google.com/webstore/detai…eppjpebenaool?hl=en | 1 | /proxy-networks/website-blocking
https://chrome.google.com/webstore/detai…ifijomclgjgif?hl=en | 1 | /integrations/switchyomega
https://chrome.google.com/webstore/detai…afknkgmokldgolkdfig | 1 | /integrations/sessionbox
https://chrome.google.com/webstore/detai…hllkliplmbmhn?hl=en | 1 | /integrations/webscraper
https://chromewebstore.google.com/detail…fmlnjonogaaifnjlfnp | 1 | /integrations/foxyproxy
https://cloud.webscraper.io/register?luminati | 1 | /integrations/webscraper
https://cloud.webscraper.io/subscription-manager?luminati | 1 | /integrations/webscraper
https://community.n8n.io/t/bright-data-c…ping-anything/92011 | 1 | /integrations/n8n
https://curl.se/ | 1 | /scraping-automation/serp-api/your-first-async-request
https://dashboard.mintlify.com/editor | 1 | /proxy-networks/faqs
https://developer.chrome.com/docs/chromedriver/ | 1 | /integrations/selenium
https://developers.google.com/adwords/ap…pendix/geotargeting | 1 | /scraping-automation/serp-api/query-parameters/google
https://developers.whatismybrowser.com/useragents/explore/ | 1 | /proxy-networks/proxy-manager/configuration
https://dicloak.com/download | 1 | /integrations/dicloak
https://docs.npmjs.com/about-npm | 1 | /proxy-networks/proxy-manager/configuration
https://docs.picaos.com/sdk/mcp | 1 | /integrations/pica
https://docs.picaos.com/sdk/vercel-ai | 1 | /integrations/pica
https://dolphin-anty.com/ | 1 | /integrations/dolphin-anty
https://easync.io/ | 1 | /integrations/easync
https://en.wikipedia.org/wiki/ISO_3166-2 | 1 | /api-reference/proxy/geolocation-targeting
https://geelark.com/ | 1 | /integrations/geelark
https://genlogin.com/ | 1 | /integrations/genlogin
https://ghostbrowser.com/download/ | 1 | /integrations/ghost-browser
https://github.com/MeirKaD/MCP_ADK | 1 | /ai/mcp-server/usage-examples
https://github.com/bitswired/jobwizard | 1 | /ai/mcp-server/usage-examples
https://github.com/brightdata/brightdata-mcp | 1 | /ai/mcp-server/faqs
https://github.com/brightdata/brightdata-mcp/tree/main | 1 | /integrations/dify
https://github.com/brightdata/brightdata…?tab=readme-ov-file | 1 | /ai/mcp-server/faqs
https://github.com/brightdata/skills | 1 | /ai/for-agents/skills
https://github.com/llSourcell/my_ai_intern | 1 | /ai/mcp-server/usage-examples
https://github.com/luminati-io | 1 | /introduction
https://github.com/luminati-io/luminati-proxy | 1 | /proxy-networks/proxy-manager/introduction
https://github.com/luminati-io/luminati-proxy/ | 1 | /proxy-networks/proxy-manager/faqs
https://github.com/luminati-io/luminati-proxy/tags | 1 | /proxy-networks/proxy-manager/configuration
https://github.com/openbullet/OpenBullet2 | 1 | /integrations/openbullet
https://github.com/techwithtim/BrightDataMCPServerAgent | 1 | /ai/mcp-server/usage-examples
https://github.com/vercel-labs/skills | 1 | /ai/for-agents/skills
https://gologin.com/ | 1 | /integrations/gologin
https://gpt.brightdata.com/link | 1 | /release-notes
https://help.brightdata.com/hc/en-us/requests/new | 1 | /introduction
https://hidemyacc.com/ | 1 | /integrations/hidemyacc
https://http3check.net/ | 1 | /proxy-networks/faqs
https://httpbin.org/ip | 1 | /integrations/postman
https://hub.docker.com/r/luminati/luminati-proxy/ | 1 | /proxy-networks/proxy-manager/configuration
https://il.linkedin.com/company/bright-data | 1 | /introduction
https://incogniton.com/ | 1 | /integrations/incogniton
https://ixbrowser.com/ | 1 | /integrations/ixbrowser
https://kameleo.io/downloads/ | 1 | /integrations/kameleo
https://learn.microsoft.com/en-us/lifecy…arch-api-retirement | 1 | /scraping-automation/serp-api/parsed-jso…erp-migration-guide
https://linkensphere.info/en/ | 1 | /integrations/sphere-browser
https://localhost:3000/api-reference/authentication | 1 | /scraping-automation/serp-api/your-first-async-request
https://lumtest.com/myip.json%E2%80%9D | 1 | /proxy-networks/residential/send-your-first-request
https://marketplace.dify.ai/plugins/idanvilenski/brightdata | 1 | /integrations/dify
https://multilogin.com/ | 1 | /integrations/multilogin
https://nginx.org/en/download.html | 1 | /integrations/nginx
https://nodejs.org/ | 1 | /integrations/puppeteer
https://nodejs.org/en/about/ | 1 | /proxy-networks/proxy-manager/configuration
https://nodejs.org/en/download | 1 | /ai/mcp-server/faqs
https://octobrowser.net/download/ | 1 | /integrations/octobrowser
https://openai.com/index/hello-gpt-4o/ | 1 | /integrations/xpander-ai
https://phantombuster.com/ | 1 | /integrations/phantombuster
https://smithery.ai/server/@luminati-io/brightdata-mcp/tools | 1 | /integrations/dify
https://stabler.tech/ | 1 | /integrations/stablersolo
https://sys.smlogin.cc/ | 1 | /integrations/smlogin
https://texau.com/ | 1 | /integrations/texau
https://trends.google.com/trends/api/exp…y?lang=en-US&tz=240 | 1 | /scraping-automation/serp-api/query-parameters/google
https://undetectable.io/ | 1 | /integrations/undetectable
https://vercel.link/security-checkpoint | 1 | /general/usage-monitoring/serp-rate-limit
https://vmlogin.us/?ref=luminati | 1 | /proxy-networks/proxy-manager/integration
https://www.adspower.com/download | 1 | /integrations/adspower
https://www.base64encode.org/ | 1 | /proxy-networks/proxy-manager/faqs
https://www.bing.com/search?q=YOUR_QUERY | 1 | /scraping-automation/serp-api/faqs
https://www.bing.com/search?q=YOUR_QUERY…ilters=ex1%3a%22ez1 | 1 | /scraping-automation/serp-api/faqs
https://www.bing.com/search?q=YOUR_QUERY…ilters=ex1%3a%22ez2 | 1 | /scraping-automation/serp-api/faqs
https://www.bing.com/search?q=YOUR_QUERY…ilters=ex1%3a%22ez3 | 1 | /scraping-automation/serp-api/faqs
https://www.bing.com/search?q=YOUR_QUERY…teSequence%E2%80%9D | 1 | /scraping-automation/serp-api/faqs
https://www.bing.com/search?q=pizza&filt…:%22ez5_19757_19773 | 1 | /scraping-automation/serp-api/faqs
https://www.bitbrowser.net/ | 1 | /integrations/bitbrowser
https://www.capsolver.com/ | 1 | /integrations/capsolver
https://www.clonbrowser.com/ | 1 | /integrations/clonbrowser
https://www.dynamicyield.com/glossary/product-detail-page/ | 1 | /integrations/xpander-ai
https://www.goodreads.com/ | 1 | /release-notes
https://www.google.com/search?q=hilton%2…ew%20york%20midtown | 1 | /scraping-automation/serp-api/query-parameters/google
https://www.heliumscraper.com/eng/download.php | 1 | /integrations/helium-scraper
https://www.lalicat.com/download | 1 | /integrations/lalicat
https://www.make.com/en/integrations/brightdata | 1 | /integrations/make
https://www.marketerbrowser.com/ | 1 | /integrations/marketerbrowser
https://www.maskfog.com/ | 1 | /integrations/maskfog
https://www.maxmind.com/en/geoip-demo | 1 | /proxy-networks/mobile/faqs
Redirected URLs
---------------
Status | Redirected URL | Target URL | Found at URL
--------------------------------------------------------------------------------------------------------------------------------------
308 | / | /introduction |
308 | /api-reference/proxy/ | /api-reference/proxy | /proxy-networks/config-options
307 | /datasets/archive/api-reference | /api-reference/archive-api/run-a-search | /datasets/archive/overview
308 | /datasets/functions/introduction | /datasets/scraper-studio/introduction | /api-reference/authentication
308 | /datasets/functions/warc-ide | /datasets/scraper-studio/warc-ide | /release-notes
307 | /datasets/marketplace | /datasets/marketplace/overview | /api-reference/authentication
307 | /integrations | /integrations/ai-integrations | /proxy-networks/faqs
307 | /proxy-networks | /proxy-networks/introduction | /api-reference/authentication
307 | /scraping-automation/browser-extension | /scraping-automation/brows…introduction | /scraping-automation/introduction
307 | /scraping-automation/scraping-browser | /scraping-automation/scrap…introduction | /api-reference/authentication
307 | /scraping-automation/serp-api | /scraping-automation/serp-…introduction | /api-reference/authentication
307 | /scraping-automation/web-unlocker | /scraping-automation/web-u…introduction | /api-reference/authentication
404 URLs
--------
Status | URL 404 | Found at URL
----------------------------------------------------------------------------------------------------------------------------------------
404 | /%20 | /release-notes
404 | /datasets/scrapers/custom-scrapers/scrape-any-web | /release-notes
404 | /integrations/browserscan | /proxy-networks/faqs
404 | /integrations/llamaindex | /release-notes
SSL/TLS info
------------
Info | Text
---------------------------------------------------------------------------------------------------------------------------------------
Issuer | C = US, O = Let's Encrypt, CN = R12
Subject | CN = docs.brightdata.com
Valid from | Feb 27 04:24:51 2026 GMT (VALID already 25.4 day(s))
Valid to | May 28 04:24:50 2026 GMT (VALID still for 64.6 day(s))
Supported protocols | TLSv1.2, TLSv1.3
RAW certificate output | Certificate:
Data:
Version: 3 (0x2)
Serial Number:…3:6f:d1:b8:65:
a6:21:a8:8a
RAW protocols output | === ssl2 ===
s_client: Unknown option: -ssl2
s_client: Use -help for su…Max Early Data: 0
---
read R BLOCK
TOP fastest URLs
----------------
Time | Status | Fast URL
------------------------------------------------------------------------------------------------------------------------------------------
74 ms | 200 | /datasets/archive/overview
76 ms | 200 | /proxy-networks/isp/introduction
76 ms | 200 | /integrations/proxifier
78 ms | 200 | /api-reference/proxy/geolocation-targeting
80 ms | 200 | /api-reference/proxy/rotate_ips
80 ms | 200 | /scraping-automation/bright-shield/scraping-shield
83 ms | 200 | /general/faqs
83 ms | 200 | /proxy-networks/proxy-manager/configuration
84 ms | 200 | /scraping-automation/scraping-browser/introduction
85 ms | 200 | /api-reference/account-management-api/Get_active_Zones
85 ms | 200 | /general/account/referral-program
86 ms | 200 | /integrations/ai-integrations
86 ms | 200 | /integrations/chrome
87 ms | 200 | /ai/agents
88 ms | 200 | /scraping-automation/serp-api/pricing-and-billing
88 ms | 200 | /scraping-automation/serp-api/asynchronous-requests
90 ms | 200 | /proxy-networks/residential/configure-your-proxy
91 ms | 200 | /integrations/n8n
91 ms | 200 | /api-reference/marketplace-dataset-api/get-dataset-list
91 ms | 200 | /proxy-networks/residential/introduction
TOP slowest URLs
----------------
Time | Status | Slow URL
-------------------------------------------------------------------------------------------------------------------------------------
866 ms | 404 | /%20
756 ms | 200 | /general/webhook_notifications
608 ms | 200 | /integrations/postman
508 ms | 200 | /integrations/gologin
494 ms | 404 | /integrations/llamaindex
494 ms | 200 | /integrations/lindy-ai
482 ms | 200 | /datasets/scrapers/overview
463 ms | 404 | /integrations/browserscan
446 ms | 200 | /integrations/maskfog
440 ms | 200 | /scraping-automation/serp-api/quickstart
439 ms | 200 | /api-reference/account-management-api/denylist-ip
387 ms | 404 | /datasets/scrapers/custom-scrapers/scrape-any-web
386 ms | 200 | /integrations/salefreaks
335 ms | 200 | /datasets/scraper-studio/faqs
310 ms | 200 | /proxy-networks/mobile/faqs
307 ms | 200 | /integrations/capsolver
305 ms | 200 | /integrations/webscraper
298 ms | 200 | /api-reference/account-management-api/Refresh_Static_Datacenter_ISP_IPs
296 ms | 200 | /api-reference/account-management-api/get-proxies-pending-replacement
294 ms | 200 | /integrations/selenium
SEO metadata
------------
This table contains large data and shows max 10 rows. To see them all, use output to HTML using `--output-html-report=tmp/myreport.html`.
URL | Indexing | Title | H1 | Description | Keywords
---------------------------------------------------------------------------------------------------------------------------------------
/ai/agents | Allowed | Agent We…ocs | Agent We…ess | Complete…ss. |
/ai/deep-research | Allowed | Deep Res…ocs | Deep Res…rch | Build AI…ch. |
/ai/enrichment | Allowed | Data Enr…ocs | Data Enr…ent | Build AI…ns. |
/ai/for-agents/docs-mcp | Allowed | Docs MCP…ocs | Docs MCP…ent | Connect…ed. |
/ai/for-agents/llm-references | Allowed | LLM-Frie…ocs | LLM-Frie…ces | Plain-te…on. |
/ai/for-agents/overview | Allowed | Bright D…ocs | Bright D…nts | Everythi…es. |
/ai/for-agents/skills | Allowed | Bright D…ocs | Bright D…nts | Install…ly. |
/ai/introduction | Allowed | Web Data…ocs | Web Data…AI | Real-tim…Ms. |
/ai/llm-grounding | Allowed | LLM Grou…ocs | LLM Grou…ion | Build AI…ta. |
/ai/mcp-server/faqs | Allowed | FAQ: MCP…ocs | FAQ: MCP | Find ans…er. |
OpenGraph metadata
------------------
This table contains large data and shows max 10 rows. To see them all, use output to HTML using `--output-html-report=tmp/myreport.html`.
URL | OG Title | OG Description | OG Image | Twitter Title | Twitter Description | Twitter Image
--------------------------------------------------------------------------------------------------------------------------------------------------
/ai/agents | Agent W…cs | Complet…s. | https://brig…q=100 | Agent W…cs | Complet…s. | https://brig…q=100
/ai/deep-research | Deep Re…cs | Build A…h. | https://brig…q=100 | Deep Re…cs | Build A…h. | https://brig…q=100
/ai/enrichment | Data En…cs | Build A…s. | https://brig…q=100 | Data En…cs | Build A…s. | https://brig…q=100
/ai/for-agents/docs-mcp | Docs MC…cs | Connect…d. | https://brig…q=100 | Docs MC…cs | Connect…d. | https://brig…q=100
/ai/for-agents/llm-references | LLM-Fri…cs | Plain-t…n. | https://brig…q=100 | LLM-Fri…cs | Plain-t…n. | https://brig…q=100
/ai/for-agents/overview | Bright…cs | Everyth…s. | https://brig…q=100 | Bright…cs | Everyth…s. | https://brig…q=100
/ai/for-agents/skills | Bright…cs | Install…y. | https://brig…q=100 | Bright…cs | Install…y. | https://brig…q=100
/ai/introduction | Web Dat…cs | Real-ti…s. | https://brig…q=100 | Web Dat…cs | Real-ti…s. | https://brig…q=100
/ai/llm-grounding | LLM Gro…cs | Build A…a. | https://brig…q=100 | LLM Gro…cs | Build A…a. | https://brig…q=100
/ai/mcp-server/faqs | FAQ: MC…cs | Find an…r. | https://brig…q=100 | FAQ: MC…cs | Find an…r. | https://brig…q=100
Heading structure
-----------------
This table contains large data and shows max 10 rows. To see them all, use output to HTML using `--output-html-report=tmp/myreport.html`.
Heading structure | Count | Errors | URL
----------------------------------------------------------------------------------------------------------------------------------------
Python SDK [#page-title] Installation and set…0.0 [#what’s-new-in-v2-0-0] | 15 | 10 | /api-reference/SDK
JavaScript SDK [#page-title] Install the pack…es [#resources] GitHub | 7 | 5 | /api-reference/SDK-JS
How to Integrate Bright Data with StablerSOLO [#pag…> Conclusion [#conclusion] | 11 | 5 | /integrations/stablersolo
How to Use Bright Data With MarketerBrowser [#page-…-data-with-marketerbrowser] | 8 | 5 | /integrations/marketerbrowser
How to Set Up Bright Data With Easync [#page-title]…> Conclusion [#conclusion] | 16 | 5 | /integrations/easync
How to Use Bright Data on macOS [#page-title] …> Conclusion [#conclusion] | 10 | 5 | /integrations/macos
How to Set Up Bright Data With SMLogin [#page-title…le [#launching-the-profile] | 19 | 5 | /integrations/smlogin
How to Set Up Bright Data With MoreLogin [#page-tit…orelogin-proxy-integration] | 8 | 5 | /integrations/morelogin
How to Set Up Bright Data With Lalicat [#page-title…#lalicat-proxy-integration] | 8 | 5 | /integrations/lalicat
How to Configure Bright Data With Proxifier [#page-…h-proxifier-and-brightdata] | 9 | 5 | /integrations/proxifier
HTTP headers
------------
Header | Occurs | Unique | Values preview | Min value | Max value
--------------------------------------------------------------------------------------------------------------------------
Age | 119 | - | [ignored generic values] | 11.8 hour(s) | 12.5 hour(s)
Cache-Control | 373 | 3 | [see values below] | |
Cf-Cache-Status | 211 | 2 | HIT (204) / MISS (7) | |
Cf-Ray | 211 | - | [ignored generic values] | |
Content-Security-Policy | 211 | 1 | worker-src * blob: data: 'unsafe…codesandbox.io; | |
Content-Type | 373 | 2 | text/html; charset=utf-8 (361) / text/html (12) | |
Date | 373 | - | [ignored generic values] | 2026-03-24 | 2026-03-24
Expires | 211 | - | [ignored generic values] | |
Link | 211 | 1 | ; rel="llms-txt", ; rel="llms-txt", ; rel="llms-full-txt"
Location | 1 | /scraping-automation/scraping-browser/introduction
Location | 1 | /introduction
Location | 1 | /scraping-automation/web-unlocker/introduction
Location | 1 | /api-reference/proxy
Location | 1 | /scraping-automation/serp-api/introduction
Location | 1 | /datasets/marketplace/overview
Location | 1 | /datasets/scraper-studio/warc-ide
Location | 1 | /datasets/scraper-studio/introduction
Location | 1 | /scraping-automation/browser-extension/introduction
Location | 1 | /api-reference/archive-api/run-a-search
Location | 1 | /integrations/ai-integrations
Location | 1 | /proxy-networks/introduction
Pragma | 211 | no-cache
Refresh | 1 | 0;url=/api-reference/proxy
Server | 373 | Vercel
Strict-Transport-Security | 212 | max-age=63072000
Vary | 211 | rsc, next-router-state-tree, next-router-prefetch, next…-prefetch, Accept-Encoding
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/ai/mcp-server/overview#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/scrapin…ion/introduction#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/general/account/overview#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/datasets/introduction#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/api-ref…e/authentication#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/proxy-n…website-blocking#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/api-reference/SDK#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/cli/overview#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/scrapin…rowser-extension#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/proxy-n…rks/introduction#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/ai/introduction#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/proxy-n…rks/errorCatalog#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/api-reference/SDK-JS#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/integra…ons/introduction#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/release-notes#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/introduction#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/scrapin…g-async-requests#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/scraping-automation/faqs#html=html
X-Cache-Key | 1 | brightdata/412/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/proxy-n…s/config-options#html=html
X-Frame-Options | 211 | DENY
X-Llms-Txt | 211 | /llms.txt
X-Matched-Path | 211 | /_sites/[subdomain]/[[...slug]]
X-Mint-Proxy-Version | 211 | 1.0.0-prod
X-Mintlify-Client-Version | 211 | 0.0.2698
X-Nextjs-Prerender | 211 | 1
X-Nextjs-Stale-Time | 211 | 60
X-Served-Version | 211 | dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2
X-Vercel-Cache | 204 | MISS
X-Vercel-Cache | 7 | HIT
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…a0b5cd20211f40da671f301d3c
X-Vercel-Challenge-Token | 1 | 2.1774362775.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…5f1102ebbd27a4a190a3efc70a
X-Vercel-Challenge-Token | 1 | 2.1774362777.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…fae96dfd8c9e4ec16689557ee7
X-Vercel-Challenge-Token | 1 | 2.1774362775.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…9f94cae484d15b2b0811ddb6bb
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…3c610f8999af171474efc94b6e
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…00e7697f10a6961dbd0757ad3f
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…08195ea0390c357aa7e81af5f4
X-Vercel-Challenge-Token | 1 | 2.1774362777.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…ac0aca5b5b7a38614092035b0b
X-Vercel-Challenge-Token | 1 | 2.1774362777.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…8519282ba6b626c74128334495
X-Vercel-Challenge-Token | 1 | 2.1774362777.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…e25380ab48a58f7950f13c1e3d
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…40ee0bc1d08a25226a974bb688
X-Vercel-Challenge-Token | 1 | 2.1774362777.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…1cc0305b98f4ab964ecad30cba
X-Vercel-Challenge-Token | 1 | 2.1774362777.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…d9b83977ef746dcd1256534677
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…c2a97386eb8807f9222691e235
X-Vercel-Challenge-Token | 1 | 2.1774362777.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…32accda13310047e887d3bc01b
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…4e93e2e19721eb66f121150718
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…c5c07c2ea454f98741124d94a3
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…279ec866994beb576cd03d142b
X-Vercel-Challenge-Token | 1 | 2.1774362776.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…ca5f1ba547cac438896e650c6a
X-Vercel-Challenge-Token | 1 | 2.1774362777.60.ZjFiNmU3NDYzZTZlNzMwNWM1ZmIxN2I4MWU3YTI…472a0c3327d4ce1cd2cd6fc0af
X-Vercel-Id | 1 | arn1:iad1::iad1::jmgm5-1774362756316-81136dd63d8d
X-Vercel-Id | 1 | arn1:iad1::iad1::r6ffb-1774362755015-d702ce76ebf8
X-Vercel-Id | 1 | arn1:iad1::iad1::gqdc5-1774362755515-aceacdcae177
X-Vercel-Id | 1 | arn1:iad1::iad1::r6ffb-1774362755462-b4bcf9658391
X-Vercel-Id | 1 | arn1:iad1::iad1::5825v-1774362755715-829ee43be22b
X-Vercel-Id | 1 | arn1:sin1:iad1::iad1::dd6mg-1774362754391-ff9c0f469fb5
X-Vercel-Id | 1 | arn1:iad1::iad1::r6ffb-1774362754916-9ffc313e8406
X-Vercel-Id | 1 | arn1:iad1::iad1::mtfg5-1774362756015-b6bb5c34218f
X-Vercel-Id | 1 | arn1:iad1::iad1::d5rt9-1774362756528-c87a08233899
X-Vercel-Id | 1 | arn1:iad1::iad1::xfvst-1774362756215-43cf82a8f4cb
X-Vercel-Id | 1 | arn1:iad1:iad1::iad1::9kvnj-1774362756117-45b41a99b59a
X-Vercel-Id | 1 | arn1:iad1::iad1::45qvs-1774362755115-4e27955b4375
X-Vercel-Id | 1 | arn1:iad1::iad1::r6ffb-1774362754814-b16a3d960725
X-Vercel-Id | 1 | arn1:iad1::iad1::dd6mg-1774362755815-fca943ad0b20
X-Vercel-Id | 1 | arn1:iad1::iad1::7vgmg-1774362754664-e29f8e77fc68
X-Vercel-Id | 1 | arn1:iad1::iad1::crb6t-1774362756416-552f94b79e86
X-Vercel-Id | 1 | arn1:iad1::iad1::r6ffb-1774362755286-6afee499343b
X-Vercel-Id | 1 | arn1:iad1::iad1::dd6mg-1774362755915-b03bd2e1313e
X-Vercel-Id | 1 | arn1:iad1::iad1::dd6mg-1774362755656-a9104bb352fd
X-Vercel-Id | 1 | arn1:iad1::iad1::47b7z-1774362755347-a7cd918414ef
X-Vercel-Mitigated | 161 | challenge
X-Vercel-Project-Id | 211 | prj_3kakCEKDVpOxnQIJmKyTWs83RXEa
X-Version | 211 | dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2
HTTP Caching by content type (only from crawlable domains)
----------------------------------------------------------
Content type | Cache type | URLs | AVG lifetime | MIN lifetime | MAX lifetime
----------------------------------------------------------------------------
HTML | Cache-Control | 361 | 0 s | 0 s | 0 s
Redirect | Cache-Control | 12 | 0 s | 0 s | 0 s
Other | No cache headers | 4 | - | - | -
HTTP Caching by domain
----------------------
Domain | Cache type | URLs | AVG lifetime | MIN lifetime | MAX lifetime
------------------------------------------------------------------------------------
docs.brightdata.com | Cache-Control | 373 | 0 s | 0 s | 0 s
docs.brightdata.com | No cache headers | 4 | - | - | -
HTTP Caching by domain and content type
---------------------------------------
Domain | Content type | Cache type | URLs | AVG lifetime | MIN lifetime | MAX lifetime
---------------------------------------------------------------------------------------------------
docs.brightdata.com | HTML | Cache-Control | 361 | 0 s | 0 s | 0 s
docs.brightdata.com | Redirect | Cache-Control | 12 | 0 s | 0 s | 0 s
docs.brightdata.com | Other | No cache headers | 4 | - | - | -
TOP non-unique titles
---------------------
Count | Title
------------------------------------------------------------------------------------------------------------------------------------------
3 | Overview - Bright Data Docs
2 | FAQs - Bright Data Docs
TOP non-unique descriptions
---------------------------
Count | Description
------------------------------------------------------------------------------------------------------------------------------------------
40 |
Best practices
--------------
Analysis name | OK | Notice | Warning | Critical
--------------------------------------------------------------------------------
Invalid inline SVGs | 238 | 0 | 0 | 0
Duplicate inline SVGs (> 5 and > 1024 B) | 238 | 0 | 0 | 0
Heading structure | 196 | 165 | 288 | 10
DOM depth (> 30) | 361 | 0 | 0 | 0
Large inline SVGs (> 5120 B) | 238 | 0 | 0 | 0
Title uniqueness (> 10%) | 193 | 0 | 0 | 0
Description uniqueness (> 10%) | 156 | 0 | 1 | 0
Brotli support | 0 | 0 | 196 | 0
WebP support | 0 | 0 | 1 | 0
AVIF support | 0 | 0 | 1 | 0
Accessibility
-------------
Analysis name | OK | Notice | Warning | Critical
--------------------------------------------------------------------
Missing aria labels | 117 | 0 | 210 | 0
Missing image alt attributes | 228 | 0 | 132 | 0
Missing html lang attribute | 1 | 0 | 0 | 0
Missing roles | 0 | 0 | 3 | 0
Source domains
--------------
Domain | Totals | HTML | Redirect
-------------------------------------------------------------------
docs.brightdata.com | 373/150MB/44s | 361/150MB/41s | 12/2kB/2.9s
Content types
-------------
Content type | URLs | Total size | Total time | Avg time | Status 20x | Status 30x | Status 40x
--------------------------------------------------------------------------------------------------
HTML | 361 | 150 MB | 41 s | 114 ms | 196 | 0 | 165
Redirect | 12 | 2 kB | 2.9 s | 238 ms | 0 | 12 | 0
Content types (MIME types)
--------------------------
Content type | URLs | Total size | Total time | Avg time | Status 20x | Status 30x | Status 40x
----------------------------------------------------------------------------------------------------------------
text/html; charset=utf-8 | 361 | 150 MB | 41 s | 114 ms | 196 | 0 | 165
text/html | 12 | 2 kB | 2.9 s | 238 ms | 0 | 12 | 0
DNS info
--------
DNS resolving tree
------------------------------------------------------------------------
docs.brightdata.com
cname.vercel-dns.com
IPv4: cname.vercel-dns.com.
IPv4: 66.33.60.193
IPv4: 76.76.21.241
DNS server: 127.0.0.53
Security
--------
Header | OK | Notice | Warning | Critical | Recommendation
-----------------------------------------------------------------------------------------------------------------------------------------
Strict-Transport-Security | 200 | 0 | 0 | 161 | Strict-Transport-Security header is not set. I…against MITM attacks.
Content-Security-Policy | 200 | 0 | 0 | 161 | Content-Security-Policy header is not set. It…prevents XSS attacks.
X-Frame-Options | 200 | 0 | 161 | 0 | X-Frame-Options header is not set. It prevents…deny' or 'sameorigin.
X-Content-Type-Options | 0 | 0 | 361 | 0 | X-Content-Type-Options header is not set. It s…content type attacks.
Referrer-Policy | 0 | 0 | 361 | 0 | Referrer-Policy header is not set. It controls…privacy and security.
Feature-Policy | 0 | 0 | 361 | 0 | Feature-Policy header is not set. It allows en…ssions-Policy is set.
Permissions-Policy | 0 | 0 | 361 | 0 | Permissions-Policy header is not set. It allow…eatures for security.
Server | 0 | 361 | 0 | 0 | Server header is set to 'Vercel'. It is better…al used technologies.
X-XSS-Protection | 361 | 0 | 0 | 0 |
Analysis stats
--------------
Class::method | Exec time | Exec count
-------------------------------------------------------------------------------
BestPracticeAnalyzer::checkHeadingStructure | 1.3 s | 361
BestPracticeAnalyzer::checkNonClickablePhoneNumbers | 1.2 s | 361
AccessibilityAnalyzer::checkMissingLabels | 765 ms | 196
AccessibilityAnalyzer::checkMissingAriaLabels | 693 ms | 196
AccessibilityAnalyzer::checkMissingRoles | 582 ms | 196
BestPracticeAnalyzer::checkMaxDOMDepth | 539 ms | 361
AccessibilityAnalyzer::checkMissingLang | 516 ms | 196
SslTlsAnalyzer::getTLSandSSLCertificateInfo | 411 ms | 1
BestPracticeAnalyzer::checkInlineSvg | 171 ms | 361
BestPracticeAnalyzer::checkMissingQuotesOnAttributes | 58 ms | 361
AccessibilityAnalyzer::checkImageAltAttributes | 26 ms | 196
SeoAndOpenGraphAnalyzer::analyzeHeadings | 25 ms | 1
SecurityAnalyzer::checkHtmlSecurity | 18 ms | 361
SecurityAnalyzer::checkHeaders | 8 ms | 361
SeoAndOpenGraphAnalyzer::analyzeSeo | 0 ms | 1
SeoAndOpenGraphAnalyzer::analyzeOpenGraph | 0 ms | 1
BestPracticeAnalyzer::checkTitleUniqueness | 0 ms | 1
BestPracticeAnalyzer::checkMetaDescriptionUniqueness | 0 ms | 1
BestPracticeAnalyzer::checkBrotliSupport | 0 ms | 1
BestPracticeAnalyzer::checkWebpSupport | 0 ms | 1
BestPracticeAnalyzer::checkAvifSupport | 0 ms | 1
Content processor stats
-----------------------
Class::method | Exec time | Exec count
-----------------------------------------------------------------------------------
NextJsProcessor::applyContentChangesBeforeUrlParsing | 1.5 s | 361
JavaScriptProcessor::findUrls | 807 ms | 361
HtmlProcessor::findUrls | 496 ms | 373
AstroProcessor::findUrls | 72 ms | 361
CssProcessor::findUrls | 37 ms | 361
AstroProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 361
NextJsProcessor::findUrls | 0 ms | 361
JavaScriptProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 361
SvelteProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 361
HtmlProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 373
SvelteProcessor::findUrls | 0 ms | 361
CssProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 361