Crawl

Fetch a web page and return clean, readable content for agents, summarization, and retrieval workflows.

/crawl

bearerAuth

AuthorizationBearer <token>

In: header

application/json

URL for crawling

TypeScript Definitions

Use the request body type in TypeScript.

Crawl a single webpage

url*string

The URL to crawl

curl -X POST "https://example.com/crawl" \  -H "Content-Type: application/json" \  -d '{    "url": "https://search1api.com"  }'

{  "crawlParameters": {    "url": "https://search1api.com"  },  "results": {    "title": "string",    "link": "string",    "content": "string"  }}

{  "error": 0,  "message": "string"}