Manage QuantCDN crawlers for the active project. Crawlers walk a remote site and import discovered content into QuantCDN — useful for migrations and scheduled re-syncs.
List crawlers configured for the active project.
qc crawler list [options]
Flag
Description
--project <project>
Project name. Defaults to the active project.
--org <org>
Override the active organization.
--platform <platform>
Override the active platform.
Run a crawler. Without --urls, the crawler runs against its configured URL set; with --urls, it runs against just the listed URLs.
qc crawler run [crawlerId] [options]
Name
Description
crawlerId
The crawler to run.
Flag
Description
--project <project>
Project name. Defaults to the active project.
--urls <urls...>
Specific URLs to crawl (space-separated).
--org <org>
Override the active organization.
--platform <platform>
Override the active platform.
# Run with the crawler's configured URLs
qc crawler run my-crawler-id
# Run against specific URLs only
qc crawler run my-crawler-id --urls https://example.com/page1 https://example.com/page2