Skip to content

qc crawler

Manage QuantCDN crawlers for the active project. Crawlers walk a remote site and import discovered content into QuantCDN — useful for migrations and scheduled re-syncs.

Command Description
qc crawler list List crawlers for the active project.
qc crawler run Run a crawler, optionally limited to specific URLs.

List crawlers configured for the active project.

Terminal window
qc crawler list [options]
Flag Description
--project <project> Project name. Defaults to the active project.
--org <org> Override the active organization.
--platform <platform> Override the active platform.
Terminal window
qc crawler list

Run a crawler. Without --urls, the crawler runs against its configured URL set; with --urls, it runs against just the listed URLs.

Terminal window
qc crawler run [crawlerId] [options]
Name Description
crawlerId The crawler to run.
Flag Description
--project <project> Project name. Defaults to the active project.
--urls <urls...> Specific URLs to crawl (space-separated).
--org <org> Override the active organization.
--platform <platform> Override the active platform.
Terminal window
# Run with the crawler's configured URLs
qc crawler run my-crawler-id
# Run against specific URLs only
qc crawler run my-crawler-id --urls https://example.com/page1 https://example.com/page2