Create crawl job
请求头
请求
Maximum number of pages to crawl (1-10,000), defaults to 1000.
List of URLs to crawl from sitemap (optional, overrides automatic URL discovery).
Whether to enable auto-sync for this URL document.
Whether to automatically remove the document if the URL becomes unavailable. Only applicable when auto-sync is enabled.
Automatically discover and add new pages linked from already-crawled pages during auto-sync. Requires enable_auto_sync=true.
Minimum frequency (in days) at which the underlying eligible documents are refreshed. The actual interval may be shorter, never longer. Defaults to 7, tightened to the parent folder’s frequency if that is stricter. Only applicable when auto-sync is enabled.
Deprecated - this field is a no-op and will be removed in a future version.