C# Class Rock.UniversalSearch.Crawler.Crawler

Crawler
显示文件 Open project: NewSpring/Rock Class Usage Examples

Public Methods

Method Description
CrawlSite ( Rock.Web.Cache.Site site ) : int

Crawls a site.

Crawler ( ) : System

Initializes a new instance of the Crawler class.

Crawler ( Rock.Web.Cache.Site site ) : System

Initializes a new instance of the Crawler class.

Private Methods

Method Description
AddRangeButNoDuplicates ( List targetList, List sourceList ) : void

Merges a two lists of strings.

CrawlPage ( string url ) : void

Crawls a page.

GetNodeText ( HtmlNode node, StringBuilder cleanText ) : void

Gets the node text.

GetPageText ( HtmlAgilityPack.HtmlDocument page ) : string

Gets the page text.

GetWebText ( string url ) : string

Gets the response text for a given url.

PageHasBeenCrawled ( string url ) : bool

Checks to see if the page has been crawled.

Method Details

CrawlSite() public method

Crawls a site.
public CrawlSite ( Rock.Web.Cache.Site site ) : int
site Rock.Web.Cache.Site
return int

Crawler() public method

Initializes a new instance of the Crawler class.
public Crawler ( ) : System
return System

Crawler() public method

Initializes a new instance of the Crawler class.
public Crawler ( Rock.Web.Cache.Site site ) : System
site Rock.Web.Cache.Site The site.
return System