C# Class Rock.UniversalSearch.Crawler.Crawler

Crawler

显示文件 Open project: NewSpring/Rock Class Usage Examples

Public Methods

Method	Description
CrawlSite ( Rock.Web.Cache.Site site ) : int	Crawls a site.
Crawler ( ) : System	Initializes a new instance of the Crawler class.
Crawler ( Rock.Web.Cache.Site site ) : System	Initializes a new instance of the Crawler class.

Private Methods

Method	Description
AddRangeButNoDuplicates ( List targetList, List sourceList ) : void	Merges a two lists of strings.
CrawlPage ( string url ) : void	Crawls a page.
GetNodeText ( HtmlNode node, StringBuilder cleanText ) : void	Gets the node text.
GetPageText ( HtmlAgilityPack.HtmlDocument page ) : string	Gets the page text.
GetWebText ( string url ) : string	Gets the response text for a given url.
PageHasBeenCrawled ( string url ) : bool	Checks to see if the page has been crawled.

Method Details

CrawlSite() public method

Crawls a site.

public CrawlSite ( Rock.Web.Cache.Site site ) : int
site	Rock.Web.Cache.Site
return	int

Crawler() public method

Initializes a new instance of the Crawler class.

public Crawler ( ) : System
return	System

Crawler() public method

Initializes a new instance of the Crawler class.

public Crawler ( Rock.Web.Cache.Site site ) : System
site	Rock.Web.Cache.Site	The site.
return	System