Use Discourse as a Content Source

This article outlines how to crawl and index your data hosted on a Discourse platform.

PERMISSIONS.

SearchUnify ignores user permissions during searches. All indexed files can be search by all users.

Establish a Connection

  1. Navigate to Content Sources and click Add New Content Sources.

  1. Find Discourse and click Add.

  2. Enter the required details like Name, the web URL of your Discourse instance in Client URL, and select the Language of discussions, emails, and other data.

  3. After entering the required details, click Connect.

Once the connection has been set up successfully, you will be prompted to the next action - Set Frequency.

Set Up Crawl Frequency

The first crawl is always manual and is performed after configuring the content source. In Choose A Date, select a date to start crawling; the data created after the selected date will be crawled. For now, keep the frequency to its default value Never and click Set and move to the next section.

NOTE.

Frequency crawl works from the second crawl onwards. For the first time, always set Frequency to Never and start a crawl from the Actions column on the Content Sources screen.

Select Types and Fields for Indexing

Currently, SearchUnify supports topics object in Discourse. It can index the data from topics and all of its related fields. In the Rules tab, click EDIT  to see the pre-configured fields.

Note. You can edit or remove any of the pre-configured fields but it is only advised for Admins to do that.

Press Save to complete the process.

You have successfully added Jira as a content source in SearchUnify. Perform a manual crawl to start indexing data in SearchUnify.

Related

Difference between Manual and Frequency Crawls

After the First Crawl

Return to the Content Sources screen and click in Actions. The number of indexed documents is updated after the crawl is complete. You can view crawl progress in in Actions. Documentation on crawl progress is in View Crawl Logs.

Once the first crawl is complete, click in Actions open the content source for editing, and set a crawl frequency.

  1. In Choose a Date, click to fire up a calendar and select a date. Only the data after the selected date is indexed.

  2. Use the Frequency dropdown to select how often SearchUnify should index the data. For illustration, the frequency has been set to Weekly and Tuesday has been chosen as the crawling day. Whenever the Frequency is other than Never, a third dropdown appears where you can specify the interval. Also, whenever Frequency is set to Hourly, then manual crawls are disabled.

  3. Click Set to save crawl frequency settings. On clicking Set, you are taken to the Rules tab.