The AI agents web crawler integration follows robots.txt, does not crawl JavaScript dynamically generated pages, accepts a seed URL plus up to 9 additional source URLs, and stops a crawl after a default one-hour timeout.
Checked 2026-10-01
- Vendor
- Amazon Web Services
- Product
- Amazon Connect
- Subsystem
- AI agents knowledge base
- Deployment
- multi-tenant
- Region
- not restricted
- Release range
- current as of 2026-10-01
- Checked
- 2026-10-01
Sources
- Initial set-up for AI agents — Amazon Web Services · tier 2 current vendor documentation · Step 3 > Create a web crawler integration > Prerequisites and Connection configuration step 3
Cite this note
APA
WarmTransfer. (2026, October 1). Setting up Amazon Q in Connect for agent assist and self-service: source note amazon-connect-q-setup-web-crawler-limits. WarmTransfer. https://warmtransfer.net/knowledge/claims/amazon-connect-q-setup-web-crawler-limits
BibTeX
@misc{warmtransfer-claim-amazon-connect-q-setup-web-crawler-limits,
title = {Setting up Amazon Q in Connect for agent assist and self-service: source note amazon-connect-q-setup-web-crawler-limits},
author = {{WarmTransfer}},
year = {2026},
url = {https://warmtransfer.net/knowledge/claims/amazon-connect-q-setup-web-crawler-limits},
note = {Source note amazon-connect-q-setup-web-crawler-limits, checked 2026-10-01}
}