Website Crawling / Import

If you have an existing help center, FAQ page, or documentation site, Ticket0 can crawl it and import the content as knowledge base articles automatically.

Starting a crawl

1. Go to Knowledge base → Import → Crawl website
2. Enter your help center URL (e.g. https://help.yourcompany.com)
3. Configure crawl settings:
   • Depth: How many link levels to follow (default: 2)
   • Max pages: Upper limit on pages to import (default: 200)
   • Include paths: Only crawl URLs matching these patterns (e.g. /articles/)
   • Exclude paths: Skip URLs matching these patterns (e.g. /login, /account)
4. Click Start crawl

What gets imported

Ticket0 extracts the main content from each page, strips navigation and boilerplate, and creates a draft article for each page. You can review and edit articles before publishing.

Reviewing imported articles

After the crawl completes:

1. Go to Knowledge base → Drafts
2. Review each imported article for accuracy
3. Edit if needed, then click Publish

Don't publish articles blindly — crawled content sometimes includes navigation text, footers, or outdated information.

Re-crawling

To keep your knowledge base in sync with your help center, set up a scheduled re-crawl:

1. Go to Knowledge base → Import → [your crawl]
2. Enable Scheduled re-crawl
3. Set the frequency (daily, weekly, or monthly)

Re-crawls update existing articles if the source page has changed and add new articles for new pages. Deleted pages are not automatically removed — you must archive them manually.

Supported platforms

The crawler works on any publicly accessible website. It has enhanced support for:

• Intercom articles
• Zendesk Help Center
• Freshdesk Knowledge Base
• Notion public pages
• GitBook
• Confluence (public spaces)