The focused-crawling MCP server for AI agents. Rank a whole site by your topic,
The focused-crawling MCP server for AI agents. Rank a whole site by your topic, read any page as clean Markdown, extract anything
active Production-safe Score 78/100 http no auth
At a glance
| Endpoint | https://bytecrawl.vercel.app/mcp |
|---|---|
| Source | https://github.com/abrahamperz/ByteCrawl |
| Transport | http |
| Tools | 6 |
| Auth | none |
| First seen | 2026-09-09 23:08:04 |
| Last checked | 2026-11-17 05:51:15 |
Observed reliability
| 7-day uptime | 100% |
|---|---|
| 24-hour uptime | 100% |
| Handshake success | 100% |
| Latency p50 / p95 | 2496 / 3056 ms |
| Last successful check | 2026-11-17 05:51:15 |
Measured by Arclan's validator via repeated live MCP handshakes. How this is computed →
Tools (6)
fetch_markdown— Fetch a public web page and return it as clean Markdown for LLM consumption, with tokens_estimate against tokens_html so you can state the sextract— Extract data from a public page with CSS selectors. Call it with ONLY the url to discover what is extractable — it returns the page's repeatlist_links— Every outbound link on a public page as an absolute, deduplicated URL (#fragments, mailto: and asset files dropped). raw=true returns the unfocused_crawl— Focused crawl of a public site: visit the pages most relevant to 'query' first. strategy: shark (default) | opic | bfs. Capped at 8 pages pecompare_strategies— Run Shark-Search, OPIC and BFS over the same public site on the same budget and return them side by side with a winner. Three crawls in onefetch_json_api— Fetch a public JSON API endpoint.
Validation history
| Checked | Reachable | Handshake | Latency | Score | State |
|---|---|---|---|---|---|
| 2026-11-17 05:51:15 | ✓ | ✓ | 220 ms | 92 | active |
| 2026-11-17 05:17:35 | ✓ | ✓ | 2473 ms | 85 | active |
| 2026-11-17 04:16:38 | ✓ | ✓ | 2594 ms | 85 | active |
| 2026-11-17 01:55:52 | ✓ | ✓ | 2226 ms | 85 | active |
| 2026-11-17 00:27:57 | ✓ | ✓ | 2176 ms | 85 | active |
| 2026-11-16 10:26:36 | ✓ | ✓ | 2499 ms | 85 | active |
| 2026-11-16 09:59:47 | ✓ | ✓ | 2605 ms | 85 | active |
| 2026-11-16 09:41:38 | ✓ | ✓ | 2544 ms | 85 | active |
| 2026-11-16 09:23:30 | ✓ | ✓ | 2498 ms | 85 | active |
| 2026-11-16 07:23:20 | ✓ | ✓ | 2460 ms | 85 | active |
| 2026-11-16 05:23:02 | ✓ | ✓ | 2880 ms | 85 | active |
| 2026-11-16 03:22:52 | ✓ | ✓ | 2390 ms | 85 | active |
| 2026-11-16 01:22:43 | ✓ | ✓ | 2498 ms | 85 | active |
| 2026-11-15 23:22:17 | ✓ | ✓ | 2320 ms | 85 | active |
| 2026-11-15 21:21:45 | ✓ | ✓ | 2011 ms | 85 | active |
Query this programmatically
Agents can pull this record live over the MCP protocol or REST:
get_server("https://bytecrawl.vercel.app/mcp") # via the Arclan MCP endpoint https://arclan.ai/mcp
GET https://arclan.ai/api/registry/bytecrawl-vercel-app-mcp # JSON