Summary
Website Quality Score
Performance 10.0
SEO 9.0
Security 8.5
Accessibility 5.0
Best Practices 8.9
- ⛔ Skipped URLs - 244 skipped URLs found.
- ⚠️ The description '' exceeds the allowed 10% duplicity. 38% of pages have this same description.
- ⚠️ 138 page(s) do not support Brotli compression.
- ⚠️ No WebP image found on the website.
- ⚠️ No AVIF image found on the website.
- ⚠️ 138 page(s) with skipped heading levels.
- ⚠️ 1 page(s) with non-clickable (non-interactive) phone numbers.
- ⚠️ 138 page(s) without aria labels.
- ⚠️ 138 page(s) without role attributes.
- ⚠️ Security - 556 pages(s) with warning(s).
- ⏩ Loaded robots.txt for domain 'docs.firecrawl.dev': status code 200, size 81 B and took 103 ms.
- ⏩ External URLs - 244 external URL(s) found.
- ⏩ Redirects - 1 redirect(s) found.
- ⏩ 404 NOTICE - 1 non-existent page(s) found.
- ⏩ DNS IPv6: domain docs.firecrawl.dev does not support IPv6 (DNS server: 127.0.0.53).
- ✅ SSL/TLS certificate is valid until May 29 05:37:33 2026 GMT. Issued by C = US, O = Let's Encrypt, CN = R12. Subject is CN = docs.firecrawl.dev.
- ✅ SSL/TLS certificate issued by 'C = US, O = Let's Encrypt, CN = R12'.
- ✅ Performance OK - all non-media URLs are faster than 3 seconds.
- ✅ HTTP headers - found 27 unique headers.
- ✅ All 118 unique title(s) are within the allowed 10% duplicity. Highest duplicity title has 1%.
- ✅ All pages have quoted attributes.
- ✅ All pages have inline SVGs smaller than 5120 bytes.
- ✅ All pages have inline SVGs with less than 5 duplicates.
- ✅ All pages have valid or none inline SVGs.
- ✅ All pages without multiple <h1> headings.
- ✅ All pages have <h1> heading.
- ✅ All pages have DOM depth less than 30.
- ✅ All pages have valid HTML.
- ✅ All pages have image alt attributes.
- ✅ All pages have form labels.
- ✅ All pages have lang attribute.
- ✅ DNS IPv4 OK: domain docs.firecrawl.dev resolved to cname.vercel-dns.com., 76.76.21.22, 66.33.60.129 (DNS server: 127.0.0.53).
- 📌 DNS Aliases: IP(s) for domain docs.firecrawl.dev were resolved by CNAME chain docs.firecrawl.dev > cname.vercel-dns.com.
Visited URLs
Found 140 row(s).
Best practices
Found 11 row(s).
| Analysis name | OK | Notice | Warning | Critical |
|---|---|---|---|---|
| Heading structure | 138 | 1 | 193 | 0 |
| Duplicate inline SVGs (> 5 and > 1024 B) | 167 | 0 | 0 | 0 |
| Invalid inline SVGs | 167 | 0 | 0 | 0 |
| Non-clickable phone numbers | 11 | 0 | 1 | 0 |
| DOM depth (> 30) | 139 | 0 | 0 | 0 |
| Large inline SVGs (> 5120 B) | 167 | 0 | 0 | 0 |
| Title uniqueness (> 10%) | 118 | 0 | 0 | 0 |
| Description uniqueness (> 10%) | 85 | 0 | 1 | 0 |
| Brotli support | 0 | 0 | 138 | 0 |
| WebP support | 0 | 0 | 1 | 0 |
| AVIF support | 0 | 0 | 1 | 0 |
| No rows found, please edit your search term. | ||||
Large inline SVGs
No problems found.
Duplicate inline SVGs
No problems found.
Invalid inline SVGs
No problems found.
Missing quotes on attributes
No problems found.
DOM depth
No problems found.
Heading structure
| Severity | Occurs | Detail | Affected URLs (max 5) |
|---|---|---|---|
| warning | 138 | Heading structure is skipping levels: found an <h5> without a previous higher heading. | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 51 | Heading structure is skipping levels: found an <h4> after an <h1>. | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 3 | Heading structure is skipping levels: found an <h4> after an <h2>. | URL 1, URL 2, URL 3 |
| warning | 1 | Heading structure is skipping levels: found an <h3> after an <h1>. | /agents/fire-1 |
| notice | 1 | No headings found in the HTML content. | /pricing |
Non-clickable phone numbers
| Severity | Occurs | Detail | Affected URLs (max 5) |
|---|---|---|---|
| warning | 1 | 1234-5678-9101 | /advanced-scraping-guide |
Title uniqueness
No problems found.
Description uniqueness
No problems found.
Accessibility
| Analysis name | OK | Notice | Warning | Critical |
|---|---|---|---|---|
| Missing aria labels | 36 | 0 | 209 | 0 |
| Missing image alt attributes | 58 | 0 | 0 | 0 |
| Missing html lang attribute | 1 | 0 | 0 | 0 |
| Missing roles | 0 | 0 | 3 | 0 |
Valid HTML
No problems found.
Missing image alt attributes
No problems found.
Missing form labels
No problems found.
Missing aria labels
Found 79 row(s).
| Severity | Occurs | Detail | Affected URLs (max 5) |
|---|---|---|---|
| warning | 2121 | <a class="group flex items-* pr-* py-* cursor-* gap-* text-* rounded-* w-* outline-* hover:bg-* dark:hover:bg-* text-* hover:text-* dark:text-* dark:hover:text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 1336 | <a class="group flex items-* pr-* py-* cursor-* gap-* text-* break-* hyphens-* rounded-* w-* outline-* hover:bg-* dark:hover:bg-* text-* hover:text-* dark:text-* dark:hover:text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 548 | <a class="link nav-* pl-* group flex items-* lg:text-* lg:leading-* mb-* gap-* text-* hover:text-* dark:text-* dark:hover:text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 434 | <a class="group flex items-* break-* py-* whitespace-* text-* hover:text-* dark:text-* dark:hover:text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 414 | <a class="flex items-* whitespace-* font-* gap-* text-* dark:text-* hover:text-* dark:hover:text-* bg-* dark:bg-* hover:bg-* dark:hover:bg-* rounded-* px-* py-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 414 | <a class="h-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 414 | <a class="link nav-* group relative h-* gap-* flex items-* font-* hover:text-* dark:hover:text-* text-* dark:text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 409 | <a class="link" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 372 | <button class="group disabled:pointer-* [& *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 306 | <a class="break-* py-* block font-* border-* pl-* border-* dark:border-* hover:border-* dark:hover:border-* hover:text-* dark:text-* dark:hover:text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 276 | <a class="h-* whitespace-* px-* py-* flex flex-* gap-* items-* border-* rounded-* text-* dark:text-* hover:text-* dark:hover:text-* bg-* dark:bg-* hover:border-* hover:dark:border-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 276 | <a class="group flex items-* rounded-* hover:text-* dark:hover:text-* min-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 266 | <a class="border border-* dark:border-* group flex items-* rounded-* py-* px-* hover:border-* dark:hover:border-* justify-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 151 | <a class="break-* py-* block border-* pl-* border-* dark:border-* hover:border-* dark:hover:border-* hover:text-* dark:text-* dark:hover:text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 149 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_2islubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 149 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_kl4slubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 138 | <a class="group flex items-* gap-* text-* text-* dark:text-* hover:text-* dark:hover:text-* text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 138 | <a class="sr-* focus:not-* focus:fixed focus:top-* focus:left-* focus:z-* focus:p-* focus:text-* focus:bg-* dark:focus:bg-* focus:rounded-* focus:outline-* dark:focus:outline-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 138 | <a class="select-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 138 | <a class="link nav-* group relative h-* gap-* flex items-* font-* [text-* text-* dark:text-* hover:text-* dark:hover:text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 138 | <button class="flex items-* h-* py-* px-* lg:hidden focus:outline-* w-* text-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 92 | <a class="group flex items-* pr-* py-* cursor-* gap-* text-* rounded-* w-* outline-* bg-* text-* [text-* dark:text-* dark:bg-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 84 | <button class="group group overflow-* rounded-* disabled:pointer-* [& *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 78 | <button class="text-* dark:text-* font-* flex items-* space-* hover:text-* dark:hover:text-* transition-* cursor-*"> | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 45 | <a class="group flex items-* pr-* py-* cursor-* gap-* text-* break-* hyphens-* rounded-* w-* outline-* bg-* text-* [text-* dark:text-* dark:bg-*" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 24 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_8lcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 21 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_alcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 12 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_ilcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3, URL 4 |
| warning | 11 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_cl4slubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 11 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1islubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 10 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_slcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3 |
| warning | 10 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_6lcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3 |
| warning | 10 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_19lcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3 |
| warning | 10 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_15lcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3 |
| warning | 9 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_blcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3 |
| warning | 9 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_nlcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3 |
| warning | 9 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_clcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3 |
| warning | 8 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_tlcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3 |
| warning | 8 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1blcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 8 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1hlcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 8 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_klcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2, URL 3 |
| warning | 7 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1clcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 7 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1jlcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 7 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_jlcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 7 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_7lcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 6 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1elcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 6 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_17lcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 6 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_plcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 6 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_dlcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 5 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_glcslubracf99absnpfdb_-trigger-***" *** > | /features/browser |
| warning | 5 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_13lcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 5 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1mlcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 5 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_rlcslubracf99absnpfdb_-trigger-***" *** > | URL 1, URL 2 |
| warning | 4 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_ulcslubracf99absnpfdb_-trigger-***" *** > | /features/crawl |
| warning | 4 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_elcslubracf99absnpfdb_-trigger-***" *** > | /features/crawl |
| warning | 4 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_mlcslubracf99absnpfdb_-trigger-***" *** > | /features/interact |
| warning | 4 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_olcslubracf99absnpfdb_-trigger-***" *** > | /introduction |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1qlcslubracf99absnpfdb_-trigger-***" *** > | /features/search |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_2elcslubracf99absnpfdb_-trigger-***" *** > | /features/scrape |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1klcslubracf99absnpfdb_-trigger-***" *** > | /features/scrape |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_27lcslubracf99absnpfdb_-trigger-***" *** > | /features/scrape |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_11lcslubracf99absnpfdb_-trigger-***" *** > | /features/extract |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1ulcslubracf99absnpfdb_-trigger-***" *** > | /features/search |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1vlcslubracf99absnpfdb_-trigger-***" *** > | /features/scrape |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1olcslubracf99absnpfdb_-trigger-***" *** > | /features/change-tracking |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_12lcslubracf99absnpfdb_-trigger-***" *** > | /developer-guides/usage-guides/choosing-the-data-extractor |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_25lcslubracf99absnpfdb_-trigger-***" *** > | /features/scrape |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_1rlcslubracf99absnpfdb_-trigger-***" *** > | /features/browser |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_16lcslubracf99absnpfdb_-trigger-***" *** > | /features/change-tracking |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_9lcslubracf99absnpfdb_-trigger-***" *** > | /features/map |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_hlcslubracf99absnpfdb_-trigger-***" *** > | /features/batch-scrape |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_18lcslubracf99absnpfdb_-trigger-***" *** > | /features/interact |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_10lcslubracf99absnpfdb_-trigger-***" *** > | /features/browser |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_4lcslubracf99absnpfdb_-trigger-***" *** > | /features/crawl |
| warning | 3 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_3lcslubracf99absnpfdb_-trigger-***" *** > | /advanced-scraping-guide |
| warning | 2 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_5d6lcslubracf99absnpfdb_-trigger-***" *** > | /use-cases/deep-research |
| warning | 2 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_5e6lcslubracf99absnpfdb_-trigger-***" *** > | /use-cases/deep-research |
| warning | 2 | <button class="group flex items-* relative gap-* my-* mb-* outline-* whitespace-* font-* !ml-* first:!ml-* focus:outline-* text-* dark:text-*" id="radix-_R_20lcslubracf99absnpfdb_-trigger-***" *** > | /features/change-tracking |
| warning | 1 | <a ***> | /mcp-server |
| No rows found, please edit your search term. | |||
Missing roles
| Severity | Occurs | Detail | Affected URLs (max 5) |
|---|---|---|---|
| warning | 138 | <nav class="text-*"> | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 138 | <footer class="flex gap-* justify-* pt-* border-* border-* sm:flex dark:border-* pb-*" id="footer"> | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 138 | <header class="relative leading-*" id="header"> | URL 1, URL 2, URL 3, URL 4, URL 5 |
Missing html lang attribute
No problems found.
Security
| Header | OK | Notice | Warning | Critical | Recommendation |
|---|---|---|---|---|---|
| X-Content-Type-Options | 0 | 0 | 139 | 0 | X-Content-Type-Options header is not set. It stops MIME type sniffing and mitigates content type attacks. |
| Referrer-Policy | 0 | 0 | 139 | 0 | Referrer-Policy header is not set. It controls referrer header sharing and enhances privacy and security. |
| Feature-Policy | 0 | 0 | 139 | 0 | Feature-Policy header is not set. It allows enabling/disabling browser APIs and features for security. Not important if Permissions-Policy is set. |
| Permissions-Policy | 0 | 0 | 139 | 0 | Permissions-Policy header is not set. It allows enabling/disabling browser APIs and features for security. |
| Server | 0 | 139 | 0 | 0 | Server header is set to 'Vercel'. It is better not to reveal used technologies. |
| Strict-Transport-Security | 139 | 0 | 0 | 0 | |
| X-Frame-Options | 139 | 0 | 0 | 0 | |
| X-XSS-Protection | 139 | 0 | 0 | 0 | |
| Content-Security-Policy | 139 | 0 | 0 | 0 |
Security headers
| Severity | Occurs | Detail | Affected URLs (max 5) |
|---|---|---|---|
| warning | 139 | Referrer-Policy header is not set. It controls referrer header sharing and enhances privacy and security. | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 139 | X-Content-Type-Options header is not set. It stops MIME type sniffing and mitigates content type attacks. | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 139 | Permissions-Policy header is not set. It allows enabling/disabling browser APIs and features for security. | URL 1, URL 2, URL 3, URL 4, URL 5 |
| warning | 139 | Feature-Policy header is not set. It allows enabling/disabling browser APIs and features for security. Not important if Permissions-Policy is set. | URL 1, URL 2, URL 3, URL 4, URL 5 |
| notice | 139 | Server header is set to 'Vercel'. It is better not to reveal used technologies. | URL 1, URL 2, URL 3, URL 4, URL 5 |
TOP non-unique titles
Found 10 row(s).
| Count 🔽 | Title |
|---|---|
| 2 | Queue Status - Firecrawl Docs |
| 2 | Cancel Batch Scrape - Firecrawl Docs |
| 2 | Get Active Crawls - Firecrawl Docs |
| 2 | Get Crawl Status - Firecrawl Docs |
| 2 | Get Batch Scrape Status - Firecrawl Docs |
| 2 | Crawl - Firecrawl Docs |
| 2 | Scrape - Firecrawl Docs |
| 2 | Historical Credit Usage - Firecrawl Docs |
| 2 | Get Crawl Errors - Firecrawl Docs |
| 2 | Batch Scrape - Firecrawl Docs |
| No rows found, please edit your search term. | |
TOP non-unique descriptions
| Count 🔽 | Description |
|---|---|
| 53 |
SEO metadata
Found 138 row(s).
| URL 🔼 | Indexing | Title | H1 | Description | Keywords |
|---|---|---|---|---|---|
| /advanced-scraping-guide | Allowed | Advanced Scraping Guide | Firecrawl | Advanced Scraping Guide | Configure scrape options, browser actions, crawling, mapping, and the agent endpoint with Firecrawl's full API surface. | |
| /agents/fire-1 | Allowed | FIRE-1 AI Agent (Beta) | Firecrawl | FIRE-1 Agent (Beta) | AI agent that enables intelligent navigation and interaction with web pages | |
| /api-reference/endpoint/agent | Allowed | Agent - Firecrawl Docs | Agent | ||
| /api-reference/endpoint/agent-delete | Allowed | Cancel Agent - Firecrawl Docs | Cancel Agent | ||
| /api-reference/endpoint/agent-get | Allowed | Get Agent Status - Firecrawl Docs | Get Agent Status | ||
| /api-reference/endpoint/batch-scrape | Allowed | Batch Scrape - Firecrawl Docs | Batch Scrape | ||
| /api-reference/endpoint/batch-scrape-delete | Allowed | Cancel Batch Scrape - Firecrawl Docs | Cancel Batch Scrape | ||
| /api-reference/endpoint/batch-scrape-get | Allowed | Get Batch Scrape Status - Firecrawl Docs | Get Batch Scrape Status | ||
| /api-reference/endpoint/batch-scrape-get-errors | Allowed | Get Batch Scrape Errors - Firecrawl Docs | Get Batch Scrape Errors | ||
| /api-reference/endpoint/browser-create | Allowed | Create Browser Session - Firecrawl Docs | Create Browser Session | Launch a new cloud browser session in a sandboxed environment. | |
| /api-reference/endpoint/browser-delete | Allowed | Delete Browser Session - Firecrawl Docs | Delete Browser Session | Destroy an active cloud browser session and release its resources. | |
| /api-reference/endpoint/browser-execute | Allowed | Execute Browser Code - Firecrawl Docs | Execute Browser Code | Execute code in a sandboxed browser environment. | |
| /api-reference/endpoint/browser-list | Allowed | List Browser Sessions - Firecrawl Docs | List Browser Sessions | Retrieve a list of all browser sessions, optionally filtered by status. | |
| /api-reference/endpoint/crawl-active | Allowed | Get Active Crawls - Firecrawl Docs | Get Active Crawls | ||
| /api-reference/endpoint/crawl-delete | Allowed | Cancel Crawl - Firecrawl Docs | Cancel Crawl | ||
| /api-reference/endpoint/crawl-get | Allowed | Get Crawl Status - Firecrawl Docs | Get Crawl Status | ||
| /api-reference/endpoint/crawl-get-errors | Allowed | Get Crawl Errors - Firecrawl Docs | Get Crawl Errors | ||
| /api-reference/endpoint/crawl-params-preview | Allowed | Crawl Params Preview - Firecrawl Docs | Crawl Params Preview | ||
| /api-reference/endpoint/crawl-post | Allowed | Crawl - Firecrawl Docs | Crawl | ||
| /api-reference/endpoint/credit-usage | Allowed | Credit Usage - Firecrawl Docs | Credit Usage | ||
| /api-reference/endpoint/credit-usage-historical | Allowed | Historical Credit Usage - Firecrawl Docs | Historical Credit Usage | ||
| /api-reference/endpoint/extract | Allowed | Extract - Firecrawl Docs | Extract | ||
| /api-reference/endpoint/extract-get | Allowed | Get Extract Status - Firecrawl Docs | Get Extract Status | ||
| /api-reference/endpoint/map | Allowed | Map - Firecrawl Docs | Map | ||
| /api-reference/endpoint/queue-status | Allowed | Queue Status - Firecrawl Docs | Queue Status | ||
| /api-reference/endpoint/scrape | Allowed | Scrape - Firecrawl Docs | Scrape | ||
| /api-reference/endpoint/scrape-browser-delete | Allowed | Stop Interacting - Firecrawl Docs | Stop Interacting | Stop the interactive browser session associated with a scrape job. | |
| /api-reference/endpoint/scrape-execute | Allowed | Interact with the page - Firecrawl Docs | Interact with the page | Execute code or an AI prompt in the browser session bound to a scrape job. | |
| /api-reference/endpoint/search | Allowed | Search - Firecrawl Docs | Search | ||
| /api-reference/endpoint/token-usage | Allowed | Token Usage - Firecrawl Docs | Token Usage | ||
| /api-reference/endpoint/token-usage-historical | Allowed | Historical Token Usage - Firecrawl Docs | Historical Token Usage | ||
| /api-reference/endpoint/webhook-agent-action | Allowed | Agent Action - Firecrawl Docs | Agent Action | ||
| /api-reference/endpoint/webhook-agent-cancelled | Allowed | Agent Cancelled - Firecrawl Docs | Agent Cancelled | ||
| /api-reference/endpoint/webhook-agent-completed | Allowed | Agent Completed - Firecrawl Docs | Agent Completed | ||
| /api-reference/endpoint/webhook-agent-failed | Allowed | Agent Failed - Firecrawl Docs | Agent Failed | ||
| /api-reference/endpoint/webhook-agent-started | Allowed | Agent Started - Firecrawl Docs | Agent Started | ||
| /api-reference/endpoint/webhook-batch-scrape-completed | Allowed | Batch Scrape Completed - Firecrawl Docs | Batch Scrape Completed | ||
| /api-reference/endpoint/webhook-batch-scrape-page | Allowed | Batch Scrape Page - Firecrawl Docs | Batch Scrape Page | ||
| /api-reference/endpoint/webhook-batch-scrape-started | Allowed | Batch Scrape Started - Firecrawl Docs | Batch Scrape Started | ||
| /api-reference/endpoint/webhook-crawl-completed | Allowed | Crawl Completed - Firecrawl Docs | Crawl Completed | ||
| /api-reference/endpoint/webhook-crawl-page | Allowed | Crawl Page - Firecrawl Docs | Crawl Page | ||
| /api-reference/endpoint/webhook-crawl-started | Allowed | Crawl Started - Firecrawl Docs | Crawl Started | ||
| /api-reference/v1-endpoint/batch-scrape | Allowed | Batch Scrape - Firecrawl Docs | Batch Scrape | ||
| /api-reference/v1-endpoint/batch-scrape-delete | Allowed | Cancel Batch Scrape - Firecrawl Docs | Cancel Batch Scrape | ||
| /api-reference/v1-endpoint/batch-scrape-get | Allowed | Get Batch Scrape Status - Firecrawl Docs | Get Batch Scrape Status | ||
| /api-reference/v1-endpoint/batch-scrape-get-errors | Allowed | Get Batch Scrape Errors - Firecrawl Docs | Get Batch Scrape Errors | ||
| /api-reference/v1-endpoint/crawl-active | Allowed | Get Active Crawls - Firecrawl Docs | Get Active Crawls | ||
| /api-reference/v1-endpoint/crawl-delete | Allowed | Cancel Crawl - Firecrawl Docs | Cancel Crawl | ||
| /api-reference/v1-endpoint/crawl-get | Allowed | Get Crawl Status - Firecrawl Docs | Get Crawl Status | ||
| /api-reference/v1-endpoint/crawl-get-errors | Allowed | Get Crawl Errors - Firecrawl Docs | Get Crawl Errors | ||
| /api-reference/v1-endpoint/crawl-post | Allowed | Crawl - Firecrawl Docs | Crawl | ||
| /api-reference/v1-endpoint/credit-usage | Allowed | Credit Usage - Firecrawl Docs | Credit Usage | ||
| /api-reference/v1-endpoint/credit-usage-historical | Allowed | Historical Credit Usage - Firecrawl Docs | Historical Credit Usage | ||
| /api-reference/v1-endpoint/extract | Allowed | Extract - Firecrawl Docs | Extract | ||
| /api-reference/v1-endpoint/extract-get | Allowed | Get Extract Status - Firecrawl Docs | Get Extract Status | ||
| /api-reference/v1-endpoint/map | Allowed | Map - Firecrawl Docs | Map | ||
| /api-reference/v1-endpoint/queue-status | Allowed | Queue Status - Firecrawl Docs | Queue Status | ||
| /api-reference/v1-endpoint/scrape | Allowed | Scrape - Firecrawl Docs | Scrape | ||
| /api-reference/v1-endpoint/search | Allowed | Search - Firecrawl Docs | Search | ||
| /api-reference/v1-endpoint/token-usage | Allowed | Token Usage - Firecrawl Docs | Token Usage | ||
| /api-reference/v1-endpoint/token-usage-historical | Allowed | Historical Token Usage - Firecrawl Docs | Historical Token Usage | ||
| /api-reference/v2-introduction | Allowed | Introduction - Firecrawl Docs | Introduction | Firecrawl API Reference (v2) | |
| /billing | Allowed | Billing | Firecrawl | Billing | How Firecrawl billing, credits, and plans work | |
| /contributing/guide | Allowed | Running Locally | Firecrawl | Running Locally | Set up Firecrawl on your local machine for development and contribution. | |
| /contributing/open-source-or-cloud | Allowed | Open Source vs Cloud | Firecrawl | Open Source vs Cloud | Understand the differences between Firecrawl's open-source and cloud offerings | |
| /contributing/self-host | Allowed | Self-hosting | Firecrawl | Self-hosting | Learn how to self-host Firecrawl to run on your own and contribute to the project. | |
| /dashboard | Allowed | Dashboard | Firecrawl | Dashboard | Overview of the Firecrawl dashboard and its key features | |
| /developer-guides/common-sites/amazon | Allowed | Scraping Amazon - Firecrawl Docs | Scraping Amazon | Extract product data, prices, and reviews from Amazon using Firecrawl | |
| /developer-guides/common-sites/etsy | Allowed | Scraping Etsy - Firecrawl Docs | Scraping Etsy | Extract handmade products, shop data, and pricing from Etsy marketplace | |
| /developer-guides/common-sites/github | Allowed | Scraping GitHub - Firecrawl Docs | Scraping GitHub | Learn how to scrape GitHub using Firecrawl's core features | |
| /developer-guides/common-sites/wikipedia | Allowed | Scraping Wikipedia - Firecrawl Docs | Scraping Wikipedia | Extract articles, infoboxes, and build knowledge graphs from Wikipedia | |
| /developer-guides/cookbooks/ai-research-assistant-cookbook | Allowed | Building an AI Research Assistant with Firecrawl and AI SDK - Firecrawl Docs | Building an AI Research Assistant with Firecrawl and AI SDK | Build a complete AI-powered research assistant with web scraping and search capabilities | |
| /developer-guides/cookbooks/brand-style-guide-generator-cookbook | Allowed | Building a Brand Style Guide Generator with Firecrawl - Firecrawl Docs | Building a Brand Style Guide Generator with Firecrawl | Generate professional PDF brand style guides by extracting design systems from any website using Firecrawl's branding format | |
| /developer-guides/examples | Allowed | Full-Stack Templates - Firecrawl Docs | Full-Stack Templates | Explore real-world examples and tutorials for Firecrawl | |
| /developer-guides/llm-sdks-and-frameworks/anthropic | Allowed | Anthropic - Firecrawl Docs | Anthropic | Use Firecrawl with Claude for web scraping + AI workflows | |
| /developer-guides/llm-sdks-and-frameworks/gemini | Allowed | Gemini - Firecrawl Docs | Gemini | Use Firecrawl with Google's Gemini AI for web scraping + AI workflows | |
| /developer-guides/llm-sdks-and-frameworks/google-adk | Allowed | Agent Development Kit (ADK) - Firecrawl Docs | Agent Development Kit (ADK) | Integrate Firecrawl with Google's ADK using MCP for advanced agent workflows | |
| /developer-guides/llm-sdks-and-frameworks/langchain | Allowed | LangChain - Firecrawl Docs | LangChain | Use Firecrawl with LangChain for web scraping + AI workflows | |
| /developer-guides/llm-sdks-and-frameworks/langgraph | Allowed | LangGraph - Firecrawl Docs | LangGraph | Integrate Firecrawl with LangGraph for building agent workflows | |
| /developer-guides/llm-sdks-and-frameworks/llamaindex | Allowed | LlamaIndex - Firecrawl Docs | LlamaIndex | Use Firecrawl with LlamaIndex for RAG applications | |
| /developer-guides/llm-sdks-and-frameworks/mastra | Allowed | Mastra - Firecrawl Docs | Mastra | Use Firecrawl with Mastra for building AI workflows | |
| /developer-guides/llm-sdks-and-frameworks/openai | Allowed | OpenAI - Firecrawl Docs | OpenAI | Use Firecrawl with OpenAI for web scraping + AI workflows | |
| /developer-guides/llm-sdks-and-frameworks/vercel-ai-sdk | Allowed | Vercel AI SDK - Firecrawl Docs | Vercel AI SDK | Firecrawl tools for Vercel AI SDK. Web scraping, search, browsing, and data extraction for AI applications. | |
| /developer-guides/mcp-setup-guides/chatgpt | Allowed | MCP Web Search & Scrape in ChatGPT - Firecrawl Docs | MCP Web Search & Scrape in ChatGPT | Add web scraping and search to ChatGPT in 2 minutes | |
| /developer-guides/mcp-setup-guides/claude-code | Allowed | MCP Web Search & Scrape in Claude Code - Firecrawl Docs | MCP Web Search & Scrape in Claude Code | Add web scraping and search to Claude Code in 2 minutes | |
| /developer-guides/mcp-setup-guides/cursor | Allowed | MCP Web Search & Scrape in Cursor - Firecrawl Docs | MCP Web Search & Scrape in Cursor | Add web scraping and search to Cursor in 2 minutes | |
| /developer-guides/mcp-setup-guides/factory-ai | Allowed | MCP Web Search & Scrape in Factory AI - Firecrawl Docs | MCP Web Search & Scrape in Factory AI | Add web scraping and search to Factory AI in 2 minutes | |
| /developer-guides/mcp-setup-guides/windsurf | Allowed | MCP Web Search & Scrape in Windsurf - Firecrawl Docs | MCP Web Search & Scrape in Windsurf | Add web scraping and search to Windsurf in 2 minutes | |
| /developer-guides/openclaw | Allowed | Using OpenClaw with Firecrawl | OpenClaw | Use Firecrawl with OpenClaw to give your agents web scraping, search, and browser automation capabilities. | |
| /developer-guides/usage-guides/choosing-the-data-extractor | Allowed | Choosing the Data Extractor | Firecrawl | Choosing the Data Extractor | Compare /agent, /extract, and /scrape (JSON mode) to pick the right tool for structured data extraction | |
| /developer-guides/workflow-automation/dify | Allowed | Firecrawl + Dify - Firecrawl Docs | Firecrawl + Dify | Official plugin for Firecrawl + Dify AI workflow automation | |
| /developer-guides/workflow-automation/make | Allowed | Firecrawl + Make - Firecrawl Docs | Firecrawl + Make | Official integration and workflow automation for Firecrawl + Make | |
| /developer-guides/workflow-automation/n8n | Allowed | Firecrawl + n8n - Firecrawl Docs | Firecrawl + n8n | Learn how to use Firecrawl with n8n for web scraping automation, a complete step-by-step guide. | |
| /developer-guides/workflow-automation/zapier | Allowed | Firecrawl + Zapier - Firecrawl Docs | Firecrawl + Zapier | Official tutorials and Zapier integration templates for Firecrawl + Zapier automation | |
| /features/agent | Allowed | Agent | Firecrawl | Agent | Gather data wherever it lives on the web. | |
| /features/batch-scrape | Allowed | Batch Scrape | Firecrawl | Batch Scrape | Scrape multiple URLs in a single batch job | |
| /features/browser | Allowed | Browser | Firecrawl | Browser Sandbox | A secure browser sandbox where agents can interact with the web. | |
| /features/change-tracking | Allowed | Change Tracking | Firecrawl | Change Tracking | Detect and monitor changes in web content between scrapes | |
| /features/crawl | Allowed | Crawl | Firecrawl | Crawl | Recursively crawl a website and extract content from every page | |
| /features/document-parsing | Allowed | Document Parsing | Firecrawl | Document Parsing | Learn about document parsing capabilities. | |
| /features/enhanced-mode | Allowed | Enhanced Mode | Firecrawl | Enhanced Mode | Use enhanced proxies for reliable scraping on complex sites | |
| /features/extract | Allowed | Extract | Firecrawl | Extract | Extract structured data from pages using LLMs | |
| /features/fast-scraping | Allowed | Faster Scraping | Firecrawl | Faster Scraping | Speed up your scrapes by 500% with the maxAge parameter | |
| /features/interact | Allowed | Interact | Firecrawl | Interact after scraping | Interact with a page you fetched by prompting or running code. | |
| /features/llm-extract | Allowed | JSON mode | Firecrawl | JSON mode - Structured result | Extract structured data from pages via LLMs | |
| /features/map | Allowed | Map | Firecrawl | Map | Input a website and get all the urls on the website - extremely fast | |
| /features/models | Allowed | Agent Models | Firecrawl | Models | Choose the right model for your agent extraction tasks. | |
| /features/proxies | Allowed | Proxies | Firecrawl | Proxies | Learn about proxy types, locations, and how Firecrawl selects proxies for your requests. | |
| /features/scrape | Allowed | Scrape | Firecrawl | Scrape | Turn any url into clean data | |
| /features/search | Allowed | Search | Firecrawl | Search | Search the web and get full content from results | |
| /introduction | Allowed | Quickstart | Firecrawl | Quickstart | Search the web, scrape any page, and interact with it — all through one API. | |
| /mcp-server | Allowed | Firecrawl MCP Server | Firecrawl MCP Server | Use Firecrawl's API through the Model Context Protocol | |
| /migrate-to-v2 | Allowed | Migrating from v1 to v2 | Firecrawl | Migrating from v1 to v2 | Key changes, mappings, and before/after snippets to upgrade your integration to v2. | |
| /rate-limits | Allowed | Rate Limits | Firecrawl | Rate Limits | Rate limits for different pricing plans and API requests | |
| /sdks/cli | Allowed | CLI | Firecrawl | Skill + CLI | Firecrawl Skill is an easy way for AI agents such as Claude Code, Antigravity and OpenCode to use Firecrawl through the CLI. | |
| /sdks/go | Allowed | Go SDK | Firecrawl | Go | Firecrawl Go SDK is a wrapper around the Firecrawl API to help you easily turn websites into markdown. | |
| /sdks/java | Allowed | Java SDK | Firecrawl | Java | Firecrawl Java SDK is a wrapper around the Firecrawl API to help you easily turn websites into markdown. | |
| /sdks/node | Allowed | Node SDK | Firecrawl | Node | Firecrawl Node SDK is a wrapper around the Firecrawl API to help you easily turn websites into markdown. | |
| /sdks/overview | Allowed | SDKs | Firecrawl | Overview | Firecrawl SDKs are wrappers around the Firecrawl API to help you easily extract data from websites. | |
| /sdks/python | Allowed | Python SDK | Firecrawl | Python | Firecrawl Python SDK is a wrapper around the Firecrawl API to help you easily turn websites into markdown. | |
| /sdks/rust | Allowed | Rust SDK | Firecrawl | Rust | Firecrawl Rust SDK is a library to help you easily scrape and crawl websites, and output the data in a format ready for use with language models (LLMs). | |
| /use-cases/ai-platforms | Allowed | AI Platforms - Firecrawl Docs | AI Platforms | Power AI assistants and let customers build AI apps | |
| /use-cases/competitive-intelligence | Allowed | Competitive Intelligence - Firecrawl Docs | Competitive Intelligence | Monitor competitor websites and track changes in real-time | |
| /use-cases/content-generation | Allowed | Content Generation - Firecrawl Docs | Content Generation | Generate AI content based on website data, images, and news | |
| /use-cases/data-migration | Allowed | Data Migration - Firecrawl Docs | Data Migration | Transfer web data efficiently between platforms and systems | |
| /use-cases/deep-research | Allowed | Deep Research - Firecrawl Docs | Deep Research | Build agentic research tools with deep web search capabilities | |
| /use-cases/developers-mcp | Allowed | Developers & MCP - Firecrawl Docs | Developers & MCP | Build powerful integrations with Model Context Protocol support | |
| /use-cases/investment-finance | Allowed | Investment & Finance - Firecrawl Docs | Investment & Finance | Track companies and extract financial insights from web data | |
| /use-cases/lead-enrichment | Allowed | Lead Enrichment - Firecrawl Docs | Lead Enrichment | Extract and filter leads from websites to power your sales pipeline | |
| /use-cases/observability | Allowed | Observability & Monitoring - Firecrawl Docs | Observability & Monitoring | Monitor websites, track uptime, and detect changes in real-time | |
| /use-cases/overview | Allowed | Use Cases - Firecrawl Docs | Use Cases | Transform web data into powerful features for your applications | |
| /use-cases/product-ecommerce | Allowed | Product & E-commerce - Firecrawl Docs | Product & E-commerce | Monitor pricing and track inventory across e-commerce sites | |
| /use-cases/seo-platforms | Allowed | SEO Platforms - Firecrawl Docs | SEO Platforms | Optimize websites for AI assistants and search engines | |
| /v1/api-reference/introduction | Allowed | Introduction - Firecrawl Docs | Introduction | Firecrawl API Reference | |
| /webhooks/events | Allowed | Webhook Event Types | Firecrawl | Event Types | Webhook event reference | |
| /webhooks/overview | Allowed | Webhooks | Firecrawl | Overview | Real-time notifications for your Firecrawl operations | |
| /webhooks/security | Allowed | Webhook Security | Firecrawl | Security | Verify webhook authenticity | |
| /webhooks/testing | Allowed | Webhook Testing | Firecrawl | Testing | Test and debug webhooks | |
| No rows found, please edit your search term. | |||||
OpenGraph metadata
Found 138 row(s).
Heading structure
Found 138 row(s).
| Heading structure | Count | Errors 🔽 | URL |
|---|---|---|---|
| 5 | 1 | /agents/fire-1 |
| 24 | 0 | /introduction |
| 25 | 0 | /advanced-scraping-guide |
| 15 | 0 | /use-cases/lead-enrichment |
| 24 | 0 | /features/interact |
| 12 | 0 | /features/map |
| 30 | 0 | /features/scrape |
| 12 | 0 | /use-cases/overview |
| 30 | 0 | /sdks/cli |
| 9 | 0 | /webhooks/security |
| 9 | 0 | /sdks/overview |
| 8 | 0 | /developer-guides/openclaw |
| 11 | 0 | /developer-guides/examples |
| 11 | 0 | /contributing/guide |
| 10 | 0 | /use-cases/seo-platforms |
| 10 | 0 | /dashboard |
| 40 | 0 | /mcp-server |
| 13 | 0 | /api-reference/v2-introduction |
| 3 | 0 | /contributing/open-source-or-cloud |
| 26 | 0 | /features/search |
| 11 | 0 | /use-cases/ai-platforms |
| 12 | 0 | /use-cases/deep-research |
| 12 | 0 | /contributing/self-host |
| 22 | 0 | /webhooks/events |
| 7 | 0 | /webhooks/testing |
| 7 | 0 | /webhooks/overview |
| 17 | 0 | /features/crawl |
| 1 | 0 | /api-reference/endpoint/map |
| 17 | 0 | /billing |
| 2 | 0 | /api-reference/endpoint/scrape |
| 9 | 0 | /use-cases/investment-finance |
| 8 | 0 | /use-cases/competitive-intelligence |
| 6 | 0 | /api-reference/endpoint/scrape-browser-delete |
| 9 | 0 | /api-reference/endpoint/scrape-execute |
| 7 | 0 | /features/document-parsing |
| 22 | 0 | /features/browser |
| 4 | 0 | /features/proxies |
| 20 | 0 | /features/change-tracking |
| 3 | 0 | /features/enhanced-mode |
| 11 | 0 | /features/batch-scrape |
| 8 | 0 | /features/llm-extract |
| 8 | 0 | /features/fast-scraping |
| 21 | 0 | /sdks/python |
| 10 | 0 | /sdks/rust |
| 22 | 0 | /sdks/java |
| 20 | 0 | /sdks/node |
| 9 | 0 | /features/models |
| 22 | 0 | /features/agent |
| 8 | 0 | /sdks/go |
| 22 | 0 | /developer-guides/usage-guides/choosing-the-data-extractor |
| 10 | 0 | /use-cases/content-generation |
| 10 | 0 | /use-cases/observability |
| 1 | 0 | /api-reference/endpoint/agent-get |
| 1 | 0 | /api-reference/endpoint/extract |
| 1 | 0 | /api-reference/endpoint/crawl-delete |
| 7 | 0 | /api-reference/endpoint/browser-execute |
| 1 | 0 | /api-reference/endpoint/agent |
| 1 | 0 | /api-reference/endpoint/token-usage-historical |
| 1 | 0 | /api-reference/endpoint/crawl-params-preview |
| 7 | 0 | /api-reference/endpoint/browser-list |
| 1 | 0 | /api-reference/endpoint/batch-scrape |
| 1 | 0 | /api-reference/endpoint/batch-scrape-get |
| 1 | 0 | /api-reference/endpoint/extract-get |
| 1 | 0 | /api-reference/endpoint/queue-status |
| 1 | 0 | /api-reference/endpoint/token-usage |
| 1 | 0 | /api-reference/endpoint/crawl-get-errors |
| 1 | 0 | /api-reference/endpoint/agent-delete |
| 1 | 0 | /api-reference/endpoint/batch-scrape-get-errors |
| 1 | 0 | /api-reference/endpoint/crawl-get |
| 1 | 0 | /api-reference/endpoint/crawl-post |
| 1 | 0 | /api-reference/endpoint/crawl-active |
| 8 | 0 | /api-reference/endpoint/search |
| 1 | 0 | /api-reference/endpoint/credit-usage-historical |
| 6 | 0 | /api-reference/endpoint/browser-create |
| 6 | 0 | /api-reference/endpoint/browser-delete |
| 1 | 0 | /api-reference/endpoint/credit-usage |
| 1 | 0 | /api-reference/endpoint/batch-scrape-delete |
| 12 | 0 | /rate-limits |
| 13 | 0 | /use-cases/developers-mcp |
| 10 | 0 | /use-cases/product-ecommerce |
| 17 | 0 | /developer-guides/workflow-automation/dify |
| 10 | 0 | /use-cases/data-migration |
| 16 | 0 | /developer-guides/llm-sdks-and-frameworks/vercel-ai-sdk |
| 51 | 0 | /developer-guides/workflow-automation/n8n |
| 13 | 0 | /features/extract |
| 7 | 0 | /developer-guides/llm-sdks-and-frameworks/openai |
| 1 | 0 | /api-reference/endpoint/webhook-crawl-started |
| 23 | 0 | /developer-guides/workflow-automation/zapier |
| 27 | 0 | /developer-guides/workflow-automation/make |
| 4 | 0 | /developer-guides/llm-sdks-and-frameworks/langgraph |
| 6 | 0 | /developer-guides/llm-sdks-and-frameworks/langchain |
| 3 | 0 | /developer-guides/llm-sdks-and-frameworks/mastra |
| 5 | 0 | /developer-guides/llm-sdks-and-frameworks/anthropic |
| 3 | 0 | /developer-guides/llm-sdks-and-frameworks/llamaindex |
| 15 | 0 | /developer-guides/llm-sdks-and-frameworks/google-adk |
| 5 | 0 | /developer-guides/llm-sdks-and-frameworks/gemini |
| 9 | 0 | /developer-guides/common-sites/wikipedia |
| 12 | 0 | /v1/api-reference/introduction |
| 13 | 0 | /migrate-to-v2 |
| 1 | 0 | /api-reference/endpoint/webhook-crawl-page |
| 1 | 0 | /api-reference/endpoint/webhook-crawl-completed |
| 24 | 0 | /developer-guides/cookbooks/ai-research-assistant-cookbook |
| 9 | 0 | /developer-guides/common-sites/github |
| 9 | 0 | /developer-guides/common-sites/etsy |
| 9 | 0 | /developer-guides/common-sites/amazon |
| 1 | 0 | /api-reference/v1-endpoint/crawl-delete |
| 1 | 0 | /api-reference/v1-endpoint/crawl-post |
| 1 | 0 | /api-reference/v1-endpoint/extract-get |
| 1 | 0 | /api-reference/v1-endpoint/batch-scrape-get-errors |
| 1 | 0 | /api-reference/v1-endpoint/crawl-active |
| 1 | 0 | /api-reference/v1-endpoint/batch-scrape-get |
| 1 | 0 | /api-reference/v1-endpoint/extract |
| 1 | 0 | /api-reference/v1-endpoint/token-usage |
| 1 | 0 | /api-reference/v1-endpoint/credit-usage |
| 1 | 0 | /api-reference/v1-endpoint/queue-status |
| 1 | 0 | /api-reference/v1-endpoint/batch-scrape |
| 1 | 0 | /api-reference/v1-endpoint/crawl-get-errors |
| 1 | 0 | /api-reference/v1-endpoint/map |
| 4 | 0 | /api-reference/v1-endpoint/search |
| 1 | 0 | /api-reference/v1-endpoint/credit-usage-historical |
| 1 | 0 | /api-reference/v1-endpoint/batch-scrape-delete |
| 1 | 0 | /api-reference/v1-endpoint/crawl-get |
| 1 | 0 | /api-reference/v1-endpoint/scrape |
| 1 | 0 | /api-reference/v1-endpoint/token-usage-historical |
| 1 | 0 | /api-reference/endpoint/webhook-batch-scrape-started |
| 23 | 0 | /developer-guides/cookbooks/brand-style-guide-generator-cookbook |
| 7 | 0 | /developer-guides/mcp-setup-guides/factory-ai |
| 1 | 0 | /api-reference/endpoint/webhook-batch-scrape-page |
| 1 | 0 | /api-reference/endpoint/webhook-batch-scrape-completed |
| 9 | 0 | /developer-guides/mcp-setup-guides/chatgpt |
| 7 | 0 | /developer-guides/mcp-setup-guides/cursor |
| 6 | 0 | /developer-guides/mcp-setup-guides/windsurf |
| 1 | 0 | /api-reference/endpoint/webhook-agent-started |
| 5 | 0 | /developer-guides/mcp-setup-guides/claude-code |
| 1 | 0 | /api-reference/endpoint/webhook-agent-cancelled |
| 1 | 0 | /api-reference/endpoint/webhook-agent-failed |
| 1 | 0 | /api-reference/endpoint/webhook-agent-completed |
| 1 | 0 | /api-reference/endpoint/webhook-agent-action |
| No rows found, please edit your search term. | |||
404 URLs
| Status | URL 404 🔼 | Found at URL |
|---|---|---|
| 404 | /pricing | /features/document-parsing |
Redirected URLs
| Status | Redirected URL 🔼 | Target URL | Found at URL |
|---|---|---|---|
| 308 | / | /introduction |
Skipped URLs Summary
Found 35 row(s).
| Reason | Domain | Unique URLs 🔽 |
|---|---|---|
| Not allowed host | github.com | 164 |
| Not allowed host | www.firecrawl.dev | 20 |
| Not allowed host | zapier.com | 14 |
| Not allowed host | firecrawl.dev | 6 |
| Not allowed host | ai-sdk.dev | 6 |
| Not allowed host | insiders.vscode.dev | 2 |
| Not allowed host | localhost | 2 |
| Not allowed host | platform.openai.com | 2 |
| Not allowed host | docs.n8n.io | 2 |
| Not allowed host | docs.anthropic.com | 1 |
| Not allowed host | smithery.ai | 1 |
| Not allowed host | json-schema.org | 1 |
| Not allowed host | nodejs.org | 1 |
| Not allowed host | www.make.com | 1 |
| Not allowed host | playwright.dev | 1 |
| Not allowed host | mcp.firecrawl.dev | 1 |
| Not allowed host | langchain-ai.github.io | 1 |
| Not allowed host | chatgpt.com | 1 |
| Not allowed host | mastra.ai | 1 |
| Not allowed host | www.docker.com | 1 |
| Not allowed host | redis.io | 1 |
| Not allowed host | ai.google.dev | 1 |
| Not allowed host | vercel.com | 1 |
| Not allowed host | docs.cursor.com | 1 |
| Not allowed host | js.langchain.com | 1 |
| Not allowed host | x.com | 1 |
| Not allowed host | help.openai.com | 1 |
| Not allowed host | discord.gg | 1 |
| Not allowed host | ts.llamaindex.ai | 1 |
| Not allowed host | pnpm.io | 1 |
| Not allowed host | docs.docker.com | 1 |
| Not allowed host | marketplace.dify.ai | 1 |
| Not allowed host | community.n8n.io | 1 |
| Not allowed host | www.linkedin.com | 1 |
| Not allowed host | docs.factory.ai | 1 |
| No rows found, please edit your search term. | ||
Skipped URLs
Found 200 row(s).
External URLs
244 external URL(s) Found 200 row(s).
TOP fastest URLs
Found 20 row(s).
| Time 🔼 | Status | Fast URL |
|---|---|---|
| 71 ms | 200 | /api-reference/endpoint/token-usage-historical |
| 72 ms | 200 | /use-cases/deep-research |
| 75 ms | 200 | /api-reference/endpoint/webhook-agent-started |
| 75 ms | 200 | /api-reference/v1-endpoint/queue-status |
| 75 ms | 200 | /api-reference/v1-endpoint/crawl-delete |
| 75 ms | 200 | /api-reference/v1-endpoint/map |
| 76 ms | 200 | /api-reference/v1-endpoint/extract-get |
| 76 ms | 200 | /api-reference/v1-endpoint/batch-scrape |
| 76 ms | 200 | /developer-guides/workflow-automation/make |
| 76 ms | 200 | /developer-guides/llm-sdks-and-frameworks/mastra |
| 77 ms | 200 | /developer-guides/mcp-setup-guides/windsurf |
| 77 ms | 200 | /features/enhanced-mode |
| 77 ms | 200 | /api-reference/v1-endpoint/crawl-get-errors |
| 77 ms | 200 | /use-cases/observability |
| 79 ms | 200 | /api-reference/v1-endpoint/crawl-active |
| 79 ms | 200 | /developer-guides/common-sites/wikipedia |
| 79 ms | 200 | /api-reference/endpoint/batch-scrape |
| 80 ms | 200 | /agents/fire-1 |
| 80 ms | 200 | /v1/api-reference/introduction |
| 81 ms | 200 | /developer-guides/mcp-setup-guides/cursor |
| No rows found, please edit your search term. | ||
TOP slowest URLs
Found 20 row(s).
| Time 🔽 | Status | Slow URL |
|---|---|---|
| 394 ms | 200 | /api-reference/endpoint/crawl-post |
| 342 ms | 200 | /sdks/go |
| 302 ms | 200 | /sdks/rust |
| 269 ms | 404 | /pricing |
| 267 ms | 200 | /api-reference/v1-endpoint/scrape |
| 213 ms | 200 | /api-reference/endpoint/credit-usage-historical |
| 200 ms | 200 | /developer-guides/mcp-setup-guides/claude-code |
| 181 ms | 200 | /developer-guides/mcp-setup-guides/factory-ai |
| 174 ms | 200 | /features/interact |
| 174 ms | 200 | /sdks/node |
| 173 ms | 200 | /sdks/java |
| 167 ms | 200 | /api-reference/endpoint/scrape-browser-delete |
| 166 ms | 200 | /api-reference/v1-endpoint/token-usage |
| 165 ms | 200 | /api-reference/v1-endpoint/token-usage-historical |
| 163 ms | 200 | /developer-guides/common-sites/github |
| 162 ms | 200 | /contributing/self-host |
| 162 ms | 200 | /developer-guides/cookbooks/brand-style-guide-generator-cookbook |
| 156 ms | 200 | /use-cases/ai-platforms |
| 153 ms | 200 | /contributing/open-source-or-cloud |
| 152 ms | 200 | /use-cases/data-migration |
| No rows found, please edit your search term. | ||
Content types
| Content type | URLs 🔽 | Total size | Total time | Avg time | Status 20x | Status 30x | Status 40x |
|---|---|---|---|---|---|---|---|
| HTML | 139 | 121 MB | 16 s | 116 ms | 138 | 0 | 1 |
| Redirect | 1 | 91 B | 264 ms | 264 ms | 0 | 1 | 0 |
Content types (MIME types)
| Content type | URLs 🔽 | Total size | Total time | Avg time | Status 20x | Status 30x | Status 40x |
|---|---|---|---|---|---|---|---|
| text/html; charset=utf-8 | 139 | 121 MB | 16 s | 116 ms | 138 | 0 | 1 |
| text / html | 1 | 91 B | 264 ms | 264 ms | 0 | 1 | 0 |
Source domains
| Domain | Totals | HTML | Redirect |
|---|---|---|---|
| docs.firecrawl.dev | 140 / 121MB / 16s | 139 / 121MB / 16s | 1 / 91B / 264ms |
HTTP headers
Found 27 row(s).
| Header 🔼 | Occurs | Unique | Values preview | Min value | Max value |
|---|---|---|---|---|---|
| Age | 137 | - | [ignored generic values] | 10.3 hour(s) | 11.5 hour(s) |
| Cache-Control | 140 | 1 | no-store, no-cache, must-revalidate, proxy-revalidate, max-age=0 | ||
| Cf-Cache-Status | 140 | 2 | HIT (138) / MISS (2) | ||
| Cf-Ray | 140 | - | [ignored generic values] | ||
| Content-Security-Policy | 140 | 1 | worker-src * blob: data: 'unsafe-eval' 'unsafe-inline'; object-src data: ; base-…m-action 'self' https://codesandbox.io; | ||
| Content-Type | 140 | 2 | text/html; charset=utf-8 (139) / text/html (1) | ||
| Date | 140 | - | [ignored generic values] | 2026-03-24 | 2026-03-24 |
| Expires | 140 | - | [ignored generic values] | ||
| Link | 140 | 1 | ; rel="llms-txt", ; rel="llms-full-txt" | ||
| Location | 1 | 1 | /introduction | ||
| Pragma | 140 | 1 | no-cache | ||
| Server | 140 | 1 | Vercel | ||
| Strict-Transport-Security | 140 | 1 | max-age=63072000 | ||
| Vary | 140 | 2 | [see values below] | ||
| X-Cache-Key | 140 | 20+ | [see values below] | ||
| X-Frame-Options | 140 | 1 | DENY | ||
| X-Llms-Txt | 140 | 1 | /llms.txt | ||
| X-Matched-Path | 140 | 1 | /_sites/[subdomain]/[[...slug]] | ||
| X-Mint-Proxy-Version | 140 | 1 | 1.0.0-prod | ||
| X-Mintlify-Client-Version | 140 | 1 | 0.0.2698 | ||
| X-Nextjs-Prerender | 140 | 1 | 1 | ||
| X-Nextjs-Stale-Time | 140 | 1 | 60 | ||
| X-Served-Version | 140 | 1 | dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2 | ||
| X-Vercel-Cache | 140 | 2 | MISS (137) / HIT (3) | ||
| X-Vercel-Id | 140 | 20+ | [see values below] | ||
| X-Vercel-Project-Id | 140 | 1 | prj_3kakCEKDVpOxnQIJmKyTWs83RXEa | ||
| X-Version | 140 | 1 | dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2 | ||
| No rows found, please edit your search term. | |||||
HTTP header values
Found 65 row(s).
| Header | Occurs | Value |
|---|---|---|
| Cache-Control | 140 | no-store, no-cache, must-revalidate, proxy-revalidate, max-age=0 |
| Cf-Cache-Status | 138 | HIT |
| Cf-Cache-Status | 2 | MISS |
| Content-Security-Policy | 140 | worker-src * blob: data: 'unsafe-eval' 'unsafe-inline'; object-src data: ; base-uri 'self'; upgrade-insecure-requests; frame-ancestors 'self' https://dashboard.mintlify.com; form-action 'self' https://codesandbox.io; |
| Content-Type | 139 | text/html; charset=utf-8 |
| Content-Type | 1 | text / html |
| Link | 140 | </llms.txt>; rel="llms-txt", </llms-full.txt>; rel="llms-full-txt" |
| Location | 1 | /introduction |
| Pragma | 140 | no-cache |
| Server | 140 | Vercel |
| Strict-Transport-Security | 140 | max-age=63072000 |
| Vary | 139 | rsc, next-router-state-tree, next-router-prefetch, next-router-segment-prefetch, Accept-Encoding |
| Vary | 1 | rsc, next-router-state-tree, next-router-prefetch, next-router-segment-prefetch, accept-encoding |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/sdks/overview#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/contributing/open-source-or-cloud#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/introduction#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/contributing/guide#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/advanced-scraping-guide#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/sdks/cli#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/features/search#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/use-cases/overview#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/webhooks/security#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/dashboard#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/developer-guides/examples#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/features/interact#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/features/scrape#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/use-cases/lead-enrichment#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/developer-guides/openclaw#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/features/map#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/use-cases/seo-platforms#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/mcp-server#html=html |
| X-Cache-Key | 1 | firecrawl/491/dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2/api-reference/v2-introduction#html=html |
| X-Frame-Options | 140 | DENY |
| X-Llms-Txt | 140 | /llms.txt |
| X-Matched-Path | 140 | /_sites/[subdomain]/[[...slug]] |
| X-Mint-Proxy-Version | 140 | 1.0.0-prod |
| X-Mintlify-Client-Version | 140 | 0.0.2698 |
| X-Nextjs-Prerender | 140 | 1 |
| X-Nextjs-Stale-Time | 140 | 60 |
| X-Served-Version | 140 | dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2 |
| X-Vercel-Cache | 137 | MISS |
| X-Vercel-Cache | 3 | HIT |
| X-Vercel-Id | 1 | arn1:cle1:iad1::iad1::k88sj-1774362870770-f021b7a0cd10 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::4x4xm-1774362872067-97e115368499 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::dxhhq-1774362871758-854811a703b0 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::mdjvm-1774362871256-dbf62b9ebefe |
| X-Vercel-Id | 1 | arn1:iad1::iad1::wwn2q-1774362871957-8811960de8a6 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::ffxww-1774362872256-3a0f0e6b13e7 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::k88sj-1774362871694-55fea7b466b3 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::wkjgd-1774362872208-f579b5239a1c |
| X-Vercel-Id | 1 | arn1:iad1::iad1::wwn2q-1774362872854-a4aae6956d6a |
| X-Vercel-Id | 1 | arn1:iad1::iad1::gjrxr-1774362872857-49e54dc7ea2f |
| X-Vercel-Id | 1 | arn1:iad1::iad1::dxhhq-1774362871033-b824ae12fb3c |
| X-Vercel-Id | 1 | arn1:iad1::iad1::dxhhq-1774362871436-af8d8bb347c0 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::ffxww-1774362871597-69aeefbf692b |
| X-Vercel-Id | 1 | arn1:iad1::iad1::ffxww-1774362872592-32dc3597d975 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::4x4xm-1774362873011-85d00b785d05 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::bq9ct-1774362872657-8fb19b8c2eaa |
| X-Vercel-Id | 1 | arn1:iad1::iad1::4x4xm-1774362872370-4acb3f38cac2 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::dxhhq-1774362872459-02f499274b49 |
| X-Vercel-Id | 1 | arn1:iad1::iad1::gjrxr-1774362871902-4d4625f8bb7e |
| X-Vercel-Id | 1 | arn1:iad1::iad1::4x4xm-1774362871458-ec9c79f63785 |
| X-Vercel-Project-Id | 140 | prj_3kakCEKDVpOxnQIJmKyTWs83RXEa |
| X-Version | 140 | dpl_Cy2pZ1YHL7un8yN36DStGn7XHFL2 |
| No rows found, please edit your search term. | ||
HTTP Caching by content type (only from crawlable domains)
| Content type | Cache type | URLs 🔽 | AVG lifetime | MIN lifetime | MAX lifetime |
|---|---|---|---|---|---|
| HTML | Cache-Control | 139 | 0 s | 0 s | 0 s |
| Redirect | Cache-Control | 1 | 0 s | 0 s | 0 s |
HTTP Caching by domain
| Domain | Cache type | URLs 🔽 | AVG lifetime | MIN lifetime | MAX lifetime |
|---|---|---|---|---|---|
| docs.firecrawl.dev | Cache-Control | 140 | 0 s | 0 s | 0 s |
HTTP Caching by domain and content type
| Domain | Content type | Cache type | URLs 🔽 | AVG lifetime | MIN lifetime | MAX lifetime |
|---|---|---|---|---|---|---|
| docs.firecrawl.dev | HTML | Cache-Control | 139 | 0 s | 0 s | 0 s |
| docs.firecrawl.dev | Redirect | Cache-Control | 1 | 0 s | 0 s | 0 s |
DNS info
| DNS resolving tree |
|---|
| docs.firecrawl.dev |
| cname.vercel-dns.com |
| IPv4: cname.vercel-dns.com. |
| IPv4: 76.76.21.22 |
| IPv4: 66.33.60.129 |
| DNS server: 127.0.0.53 |
SSL/TLS info
| Info | Text |
|---|---|
| Issuer | C = US, O = Let's Encrypt, CN = R12 |
| Subject | CN = docs.firecrawl.dev |
| Valid from | Feb 28 05:37:34 2026 GMT (VALID already 24.4 day(s)) |
| Valid to | May 29 05:37:33 2026 GMT (VALID still for 65.6 day(s)) |
| Supported protocols | TLSv1.2, TLSv1.3 |
| RAW certificate output | Certificate: Data: Version: 3 (0x2) Serial Number: 05:40:df:ea:ac:89:72:c1:2a:69:a3:35:56:6b:54:0e:97:6c Signature Algorithm: sha256WithRSAEncryption Issuer: C = US, O = Let's Encrypt, CN = R12 Validity Not Before: Feb 28 05:37:34 2026 GMT Not After : May 29 05:37:33 2026 GMT Subject: CN = docs.firecrawl.dev Subject Public Key Info: Public Key Algorithm: rsaEncryption Public-Key: (2048 bit) Modulus: 00:d6:fd:26:a0:a4:04:a6:0e:c4:6e:93:04:14:f0: 36:86:df:ce:58:66:8c:70:39:5f:7e:dd:70:77:28: 8f:eb:85:4e:52:be:18:20:63:8a:8c:32:9f:27:1f: ca:86:e7:aa:3a:e7:6c:d9:b7:27:6d:20:f3:3d:90: a1:4d:4f:3c:52:41:48:19:ec:f1:d2:0a:87:bd:16: 6e:97:95:cd:4b:a2:97:77:8e:30:ad:ca:04:64:2b: 29:8e:21:f7:66:9b:01:b3:77:be:2c:5d:88:ad:97: c8:e3:97:fd:66:6d:74:98:78:d9:4b:8f:ba:ad:b0: 69:7a:1c:9b:39:61:3c:1d:c8:e2:c8:d5:de:fc:84: 52:ec:7d:71:a1:c6:29:ef:58:f1:45:0c:80:b7:7f: a0:aa:d7:b8:6f:a5:90:72:1d:1e:ae:2d:43:1d:51: 6d:62:70:a5:37:89:8f:fc:d6:33:a5:63:23:95:bc: b9:c5:2c:dd:ec:69:26:a6:0a:7c:05:97:1f:b3:bd: 23:bb:af:15:d6:1f:83:e8:97:82:f5:a7:1c:ae:e4: b7:03:de:7e:aa:9e:c9:67:35:d3:da:8f:08:f6:35: 21:79:94:5a:dd:73:5d:d4:c2:97:fe:25:e8:43:49: 31:48:de:d6:cf:f8:17:9a:5a:7d:4f:0d:c7:77:aa: 15:d3 Exponent: 65537 (0x10001) X509v3 extensions: X509v3 Key Usage: critical Digital Signature, Key Encipherment X509v3 Extended Key Usage: TLS Web Server Authentication X509v3 Basic Constraints: critical CA:FALSE X509v3 Subject Key Identifier: E5:2F:E1:CF:FA:CA:D1:02:71:06:C0:F0:B8:2C:8B:CD:83:0E:15:40 X509v3 Authority Key Identifier: 00:B5:29:F2:2D:8E:6F:31:E8:9B:4C:AD:78:3E:FA:DC:E9:0C:D1:D2 Authority Information Access: CA Issuers - URI:http://r12.i.lencr.org/ X509v3 Subject Alternative Name: DNS:docs.firecrawl.dev X509v3 Certificate Policies: Policy: 2.23.140.1.2.1 X509v3 CRL Distribution Points: Full Name: URI:http://r12.c.lencr.org/109.crl CT Precertificate SCTs: Signed Certificate Timestamp: Version : v1 (0x0) Log ID : 0E:57:94:BC:F3:AE:A9:3E:33:1B:2C:99:07:B3:F7:90: DF:9B:C2:3D:71:32:25:DD:21:A9:25:AC:61:C5:4E:21 Timestamp : Feb 28 06:36:04.610 2026 GMT Extensions: none Signature : ecdsa-with-SHA256 30:44:02:20:4A:EB:E3:24:58:D1:9B:F3:3E:88:62:B4: C7:4E:F8:85:A3:1C:32:F5:DF:27:D6:A6:7A:A1:0B:82: 83:0C:82:4D:02:20:03:F5:6B:4F:EB:96:9A:38:4E:6F: CF:06:7A:49:C0:6F:02:CD:7A:B6:4D:6F:0C:B0:8F:20: FC:D6:42:7E:5B:1D Signed Certificate Timestamp: Version : v1 (0x0) Log ID : D1:6E:A9:A5:68:07:7E:66:35:A0:3F:37:A5:DD:BC:03: A5:3C:41:12:14:D4:88:18:F5:E9:31:B3:23:CB:95:04 Timestamp : Feb 28 06:36:04.843 2026 GMT Extensions: none Signature : ecdsa-with-SHA256 30:45:02:20:22:E0:3F:A9:FD:F2:BA:77:36:6D:C9:B5: 30:5C:66:8C:23:14:4E:02:CF:0E:5D:21:26:48:22:F6: 02:F3:46:FF:02:21:00:90:FD:BE:46:48:3D:91:03:35: BF:BE:7B:B9:B5:CB:8D:85:8B:D5:74:4D:1E:CA:1D:4C: A8:E4:14:F7:6C:FB:9E Signature Algorithm: sha256WithRSAEncryption Signature Value: 11:f6:27:50:a3:85:45:b1:76:8f:eb:8c:fc:e5:66:04:97:4c: a8:5e:88:4e:76:4d:0c:07:8d:09:cd:4b:a0:7e:f0:53:5d:c8: 13:53:a0:df:74:18:e6:22:43:98:88:13:59:29:63:51:f8:f1: 72:cf:b3:34:28:84:4f:24:31:5f:68:4c:c8:22:cb:88:2c:57: 04:5b:b2:c9:50:ce:b7:bc:7c:34:ae:d3:ff:67:d7:b8:eb:0d: 95:a7:3c:92:30:2b:37:c2:54:e0:ce:03:6d:63:5d:a6:08:e5: 51:43:9a:1d:61:48:c7:86:b0:2e:76:ee:1a:02:75:f2:44:1a: 62:b2:d0:34:6c:ed:dd:0a:3c:17:94:5c:e2:58:e5:58:2b:df: 59:06:90:ad:13:76:98:dd:80:e3:32:6a:5e:df:4a:b5:8e:85: 13:52:94:50:79:8b:21:a3:08:16:99:94:12:03:bf:3a:cf:cd: 33:99:87:33:d0:b2:32:df:86:65:a1:01:07:6f:a9:2c:ee:03: 0c:0d:19:64:71:25:b4:4b:8e:54:44:b4:21:ff:73:a5:17:bb: db:fc:7f:b5:c6:57:d5:e5:42:98:30:12:cf:17:42:e7:bb:78: 71:17:c2:cf:af:19:a4:50:14:12:b3:f7:3d:56:bc:a4:91:0a: f9:92:38:1a |
| RAW protocols output | === ssl2 === s_client: Unknown option: -ssl2 s_client: Use -help for summary. === ssl3 === s_client: Unknown option: -ssl3 s_client: Use -help for summary. === tls1 === 401766D861740000:error:0A0000BF:SSL routines:tls_setup_handshake:no protocols available:../ssl/statem/statem_lib.c:104: CONNECTED(00000003) --- no peer certificate available --- No client certificate CA names sent --- SSL handshake has read 0 bytes and written 7 bytes Verification: OK --- New, (NONE), Cipher is (NONE) Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) --- === tls1_1 === 40C74EAE39740000:error:0A0000BF:SSL routines:tls_setup_handshake:no protocols available:../ssl/statem/statem_lib.c:104: CONNECTED(00000003) --- no peer certificate available --- No client certificate CA names sent --- SSL handshake has read 0 bytes and written 7 bytes Verification: OK --- New, (NONE), Cipher is (NONE) Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) --- === tls1_2 === depth=2 C = US, O = Internet Security Research Group, CN = ISRG Root X1 verify return:1 depth=1 C = US, O = Let's Encrypt, CN = R12 verify return:1 depth=0 CN = docs.firecrawl.dev verify return:1 CONNECTED(00000003) --- Certificate chain 0 s:CN = docs.firecrawl.dev i:C = US, O = Let's Encrypt, CN = R12 a:PKEY: rsaEncryption, 2048 (bit); sigalg: RSA-SHA256 v:NotBefore: Feb 28 05:37:34 2026 GMT; NotAfter: May 29 05:37:33 2026 GMT 1 s:C = US, O = Let's Encrypt, CN = R12 i:C = US, O = Internet Security Research Group, CN = ISRG Root X1 a:PKEY: rsaEncryption, 2048 (bit); sigalg: RSA-SHA256 v:NotBefore: Mar 13 00:00:00 2024 GMT; NotAfter: Mar 12 23:59:59 2027 GMT --- Server certificate -----BEGIN CERTIFICATE----- MIIE9jCCA96gAwIBAgISBUDf6qyJcsEqaaM1VmtUDpdsMA0GCSqGSIb3DQEBCwUA MDMxCzAJBgNVBAYTAlVTMRYwFAYDVQQKEw1MZXQncyBFbmNyeXB0MQwwCgYDVQQD EwNSMTIwHhcNMjYwMjI4MDUzNzM0WhcNMjYwNTI5MDUzNzMzWjAdMRswGQYDVQQD ExJkb2NzLmZpcmVjcmF3bC5kZXYwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEK AoIBAQDW/SagpASmDsRukwQU8DaG385YZoxwOV9+3XB3KI/rhU5SvhggY4qMMp8n H8qG56o652zZtydtIPM9kKFNTzxSQUgZ7PHSCoe9Fm6Xlc1Lopd3jjCtygRkKymO IfdmmwGzd74sXYitl8jjl/1mbXSYeNlLj7qtsGl6HJs5YTwdyOLI1d78hFLsfXGh xinvWPFFDIC3f6Cq17hvpZByHR6uLUMdUW1icKU3iY/81jOlYyOVvLnFLN3saSam CnwFlx+zvSO7rxXWH4Pol4L1pxyu5LcD3n6qnslnNdPajwj2NSF5lFrdc13Uwpf+ JehDSTFI3tbP+BeaWn1PDcd3qhXTAgMBAAGjggIYMIICFDAOBgNVHQ8BAf8EBAMC BaAwEwYDVR0lBAwwCgYIKwYBBQUHAwEwDAYDVR0TAQH/BAIwADAdBgNVHQ4EFgQU 5S/hz/rK0QJxBsDwuCyLzYMOFUAwHwYDVR0jBBgwFoAUALUp8i2ObzHom0yteD76 3OkM0dIwMwYIKwYBBQUHAQEEJzAlMCMGCCsGAQUFBzAChhdodHRwOi8vcjEyLmku bGVuY3Iub3JnLzAdBgNVHREEFjAUghJkb2NzLmZpcmVjcmF3bC5kZXYwEwYDVR0g BAwwCjAIBgZngQwBAgEwLwYDVR0fBCgwJjAkoCKgIIYeaHR0cDovL3IxMi5jLmxl bmNyLm9yZy8xMDkuY3JsMIIBAwYKKwYBBAHWeQIEAgSB9ASB8QDvAHUADleUvPOu qT4zGyyZB7P3kN+bwj1xMiXdIaklrGHFTiEAAAGcovYeggAABAMARjBEAiBK6+Mk WNGb8z6IYrTHTviFoxwy9d8n1qZ6oQuCgwyCTQIgA/VrT+uWmjhOb88GeknAbwLN erZNbwywjyD81kJ+Wx0AdgDRbqmlaAd+ZjWgPzel3bwDpTxBEhTUiBj16TGzI8uV BAAAAZyi9h9rAAAEAwBHMEUCICLgP6n98rp3Nm3JtTBcZowjFE4Czw5dISZIIvYC 80b/AiEAkP2+Rkg9kQM1v757ubXLjYWL1XRNHsodTKjkFPds+54wDQYJKoZIhvcN AQELBQADggEBABH2J1CjhUWxdo/rjPzlZgSXTKheiE52TQwHjQnNS6B+8FNdyBNT oN90GOYiQ5iIE1kpY1H48XLPszQohE8kMV9oTMgiy4gsVwRbsslQzre8fDSu0/9n 17jrDZWnPJIwKzfCVODOA21jXaYI5VFDmh1hSMeGsC527hoCdfJEGmKy0DRs7d0K PBeUXOJY5Vgr31kGkK0TdpjdgOMyal7fSrWOhRNSlFB5iyGjCBaZlBIDvzrPzTOZ hzPQsjLfhmWhAQdvqSzuAwwNGWRxJbRLjlREtCH/c6UXu9v8f7XGV9XlQpgwEs8X Que7eHEXws+vGaRQFBKz9z1WvKSRCvmSOBo= -----END CERTIFICATE----- subject=CN = docs.firecrawl.dev issuer=C = US, O = Let's Encrypt, CN = R12 --- No client certificate CA names sent Peer signing digest: SHA256 Peer signature type: RSA-PSS Server Temp Key: X25519, 253 bits --- SSL handshake has read 3157 bytes and written 308 bytes Verification: OK --- New, TLSv1.2, Cipher is ECDHE-RSA-AES128-GCM-SHA256 Server public key is 2048 bit Secure Renegotiation IS supported Compression: NONE Expansion: NONE No ALPN negotiated SSL-Session: Protocol : TLSv1.2 Cipher : ECDHE-RSA-AES128-GCM-SHA256 Session-ID: E4FAA6F50185859A5251546C99CA8AC48099923A7CD1E17C513EC8CEEB67F179 Session-ID-ctx: Master-Key: 6E18ACF66A86179A119A5CA0C347ECE986B73CB4C2D16854214607E10E83EA1A14634E60A9BE7C4A15763A13424CDB0A PSK identity: None PSK identity hint: None SRP username: None TLS session ticket: 0000 - 8c 75 35 18 ec c3 ac 67-b5 c5 0f 1f b1 d2 b4 2c .u5....g......., 0010 - 42 3b d5 c1 05 11 62 a2-e1 df 5f b1 a2 81 9b cc B;....b..._..... 0020 - 20 0c 86 7e bf 9a a5 e7-26 d1 13 d0 b7 6c 18 8d ..~....&....l.. 0030 - fc 67 9a 1f 00 18 02 02-4c b5 fb 83 58 6d 62 be .g......L...Xmb. 0040 - a3 a3 ec 75 11 1d 2c 1f-09 29 a7 86 cd 84 78 78 ...u..,..)....xx 0050 - 24 01 82 05 5c 6a 0e f9-c7 22 a2 cb 93 c7 4f 2d $...\j..."....O- 0060 - 9a cb 82 79 d6 0d e9 3b-c2 db e6 48 a0 0b 2c e6 ...y...;...H..,. 0070 - 80 86 60 68 09 f5 fb c5-89 c8 e1 ..`h....... Start Time: 1774362885 Timeout : 7200 (sec) Verify return code: 0 (ok) Extended master secret: yes --- DONE === tls1_3 === depth=2 C = US, O = Internet Security Research Group, CN = ISRG Root X1 verify return:1 depth=1 C = US, O = Let's Encrypt, CN = R12 verify return:1 depth=0 CN = docs.firecrawl.dev verify return:1 CONNECTED(00000003) --- Certificate chain 0 s:CN = docs.firecrawl.dev i:C = US, O = Let's Encrypt, CN = R12 a:PKEY: rsaEncryption, 2048 (bit); sigalg: RSA-SHA256 v:NotBefore: Feb 28 05:37:34 2026 GMT; NotAfter: May 29 05:37:33 2026 GMT 1 s:C = US, O = Let's Encrypt, CN = R12 i:C = US, O = Internet Security Research Group, CN = ISRG Root X1 a:PKEY: rsaEncryption, 2048 (bit); sigalg: RSA-SHA256 v:NotBefore: Mar 13 00:00:00 2024 GMT; NotAfter: Mar 12 23:59:59 2027 GMT --- Server certificate -----BEGIN CERTIFICATE----- MIIE9jCCA96gAwIBAgISBUDf6qyJcsEqaaM1VmtUDpdsMA0GCSqGSIb3DQEBCwUA MDMxCzAJBgNVBAYTAlVTMRYwFAYDVQQKEw1MZXQncyBFbmNyeXB0MQwwCgYDVQQD EwNSMTIwHhcNMjYwMjI4MDUzNzM0WhcNMjYwNTI5MDUzNzMzWjAdMRswGQYDVQQD ExJkb2NzLmZpcmVjcmF3bC5kZXYwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEK AoIBAQDW/SagpASmDsRukwQU8DaG385YZoxwOV9+3XB3KI/rhU5SvhggY4qMMp8n H8qG56o652zZtydtIPM9kKFNTzxSQUgZ7PHSCoe9Fm6Xlc1Lopd3jjCtygRkKymO IfdmmwGzd74sXYitl8jjl/1mbXSYeNlLj7qtsGl6HJs5YTwdyOLI1d78hFLsfXGh xinvWPFFDIC3f6Cq17hvpZByHR6uLUMdUW1icKU3iY/81jOlYyOVvLnFLN3saSam CnwFlx+zvSO7rxXWH4Pol4L1pxyu5LcD3n6qnslnNdPajwj2NSF5lFrdc13Uwpf+ JehDSTFI3tbP+BeaWn1PDcd3qhXTAgMBAAGjggIYMIICFDAOBgNVHQ8BAf8EBAMC BaAwEwYDVR0lBAwwCgYIKwYBBQUHAwEwDAYDVR0TAQH/BAIwADAdBgNVHQ4EFgQU 5S/hz/rK0QJxBsDwuCyLzYMOFUAwHwYDVR0jBBgwFoAUALUp8i2ObzHom0yteD76 3OkM0dIwMwYIKwYBBQUHAQEEJzAlMCMGCCsGAQUFBzAChhdodHRwOi8vcjEyLmku bGVuY3Iub3JnLzAdBgNVHREEFjAUghJkb2NzLmZpcmVjcmF3bC5kZXYwEwYDVR0g BAwwCjAIBgZngQwBAgEwLwYDVR0fBCgwJjAkoCKgIIYeaHR0cDovL3IxMi5jLmxl bmNyLm9yZy8xMDkuY3JsMIIBAwYKKwYBBAHWeQIEAgSB9ASB8QDvAHUADleUvPOu qT4zGyyZB7P3kN+bwj1xMiXdIaklrGHFTiEAAAGcovYeggAABAMARjBEAiBK6+Mk WNGb8z6IYrTHTviFoxwy9d8n1qZ6oQuCgwyCTQIgA/VrT+uWmjhOb88GeknAbwLN erZNbwywjyD81kJ+Wx0AdgDRbqmlaAd+ZjWgPzel3bwDpTxBEhTUiBj16TGzI8uV BAAAAZyi9h9rAAAEAwBHMEUCICLgP6n98rp3Nm3JtTBcZowjFE4Czw5dISZIIvYC 80b/AiEAkP2+Rkg9kQM1v757ubXLjYWL1XRNHsodTKjkFPds+54wDQYJKoZIhvcN AQELBQADggEBABH2J1CjhUWxdo/rjPzlZgSXTKheiE52TQwHjQnNS6B+8FNdyBNT oN90GOYiQ5iIE1kpY1H48XLPszQohE8kMV9oTMgiy4gsVwRbsslQzre8fDSu0/9n 17jrDZWnPJIwKzfCVODOA21jXaYI5VFDmh1hSMeGsC527hoCdfJEGmKy0DRs7d0K PBeUXOJY5Vgr31kGkK0TdpjdgOMyal7fSrWOhRNSlFB5iyGjCBaZlBIDvzrPzTOZ hzPQsjLfhmWhAQdvqSzuAwwNGWRxJbRLjlREtCH/c6UXu9v8f7XGV9XlQpgwEs8X Que7eHEXws+vGaRQFBKz9z1WvKSRCvmSOBo= -----END CERTIFICATE----- subject=CN = docs.firecrawl.dev issuer=C = US, O = Let's Encrypt, CN = R12 --- No client certificate CA names sent Peer signing digest: SHA256 Peer signature type: RSA-PSS Server Temp Key: X25519, 253 bits --- SSL handshake has read 3113 bytes and written 316 bytes Verification: OK --- New, TLSv1.3, Cipher is TLS_AES_128_GCM_SHA256 Server public key is 2048 bit Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) --- DONE --- Post-Handshake New Session Ticket arrived: SSL-Session: Protocol : TLSv1.3 Cipher : TLS_AES_128_GCM_SHA256 Session-ID: 0F828A84CF83AFE63774E53A4803D43C83CA74A4FB908C865ACB684AC3148145 Session-ID-ctx: Resumption PSK: 7B5E0489636DF12F2C92DE75A21C77CDAB45E03D106EB1BFF2C5FCB5C53C80E8 PSK identity: None PSK identity hint: None SRP username: None TLS session ticket lifetime hint: 604800 (seconds) TLS session ticket: 0000 - e4 02 98 22 fc dc 93 64-ca 94 de 3a 7b 1d ea 6d ..."...d...:{..m 0010 - 6f 30 1b 25 b8 e1 d9 42-43 09 2b ea ad d0 6c e4 o0.%...BC.+...l. 0020 - 5a 67 08 34 e6 17 e5 e1-66 9f 13 2f e7 61 0f b5 Zg.4....f../.a.. 0030 - 9c 79 a6 4b c7 d7 92 91-2e 49 d1 1f ac 55 88 43 .y.K.....I...U.C 0040 - 3b 44 2a 2c 7b 75 24 ee-10 33 7f 0b ac 34 e2 8a ;D*,{u$..3...4.. 0050 - 87 7a 70 b7 2f 88 23 f7-c1 fa ad d0 15 e0 36 67 .zp./.#.......6g 0060 - 02 04 73 40 31 93 fb 62-66 ..s@1..bf Start Time: 1774362885 Timeout : 7200 (sec) Verify return code: 0 (ok) Extended master secret: no Max Early Data: 0 --- read R BLOCK |
Crawler stats
| Basic stats | |
|---|---|
| Total execution time | 17 s |
| Total URLs | 140 |
| Total size | 121 MB |
| Requests - total time | 16 s |
| Requests - avg time | 118 ms |
| Requests - min time | 71 ms |
| Requests - max time | 395 ms |
| Requests by status | 200: 138 308: 1 404: 1 |
Analysis stats
Found 21 row(s).
| Class::method | Exec time 🔽 | Exec count |
|---|---|---|
| BestPracticeAnalyzer::checkNonClickablePhoneNumbers | 977 ms | 139 |
| BestPracticeAnalyzer::checkHeadingStructure | 955 ms | 139 |
| AccessibilityAnalyzer::checkMissingLabels | 585 ms | 138 |
| AccessibilityAnalyzer::checkMissingAriaLabels | 543 ms | 138 |
| AccessibilityAnalyzer::checkMissingRoles | 455 ms | 138 |
| AccessibilityAnalyzer::checkMissingLang | 401 ms | 138 |
| BestPracticeAnalyzer::checkMaxDOMDepth | 383 ms | 139 |
| SslTlsAnalyzer::getTLSandSSLCertificateInfo | 330 ms | 1 |
| BestPracticeAnalyzer::checkInlineSvg | 107 ms | 139 |
| BestPracticeAnalyzer::checkMissingQuotesOnAttributes | 44 ms | 139 |
| SeoAndOpenGraphAnalyzer::analyzeHeadings | 16 ms | 1 |
| AccessibilityAnalyzer::checkImageAltAttributes | 15 ms | 138 |
| SecurityAnalyzer::checkHtmlSecurity | 14 ms | 139 |
| SecurityAnalyzer::checkHeaders | 3 ms | 139 |
| SeoAndOpenGraphAnalyzer::analyzeSeo | 0 ms | 1 |
| SeoAndOpenGraphAnalyzer::analyzeOpenGraph | 0 ms | 1 |
| BestPracticeAnalyzer::checkTitleUniqueness | 0 ms | 1 |
| BestPracticeAnalyzer::checkMetaDescriptionUniqueness | 0 ms | 1 |
| BestPracticeAnalyzer::checkBrotliSupport | 0 ms | 1 |
| BestPracticeAnalyzer::checkWebpSupport | 0 ms | 1 |
| BestPracticeAnalyzer::checkAvifSupport | 0 ms | 1 |
| No rows found, please edit your search term. | ||
Content processor stats
Found 12 row(s).
| Class::method | Exec time 🔽 | Exec count |
|---|---|---|
| NextJsProcessor::applyContentChangesBeforeUrlParsing | 1.1 s | 139 |
| JavaScriptProcessor::findUrls | 596 ms | 139 |
| HtmlProcessor::findUrls | 337 ms | 140 |
| CssProcessor::findUrls | 32 ms | 139 |
| AstroProcessor::findUrls | 12 ms | 139 |
| AstroProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 139 |
| NextJsProcessor::findUrls | 0 ms | 139 |
| JavaScriptProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 139 |
| SvelteProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 139 |
| SvelteProcessor::findUrls | 0 ms | 139 |
| HtmlProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 140 |
| CssProcessor::applyContentChangesBeforeUrlParsing | 0 ms | 139 |
| No rows found, please edit your search term. | ||
Crawler info
| Version | 2.1.0.20260317 |
|---|---|
| Executed At | 2026-03-24 14:34:28 |
| Command | siteone-crawler --url=https://docs.firecrawl.dev --markdown-export-dir=/tmp/siteone-firecrawl --markdown-exclude-selector=header,footer,nav,.sidebar,.menu,.breadcrumb,script,style --timeout=30 --workers=5 --disable-javascript --disable-styles --disable-fonts --disable-images --disable-files --no-color --hide-progress-bar --output=text |
| Hostname | ubuntu-8gb-hel1-1 |
| User-Agent | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/26.0.0.0 Safari/537.36 siteone-crawler/2.1.0.20260317 |