|
Class Summary |
| Http |
Holds the HTTP protocol-specific options. |
| HttpBase |
Common configurations and methods for HTTP protocol. |
| HttpOutput |
Class that represents HTTP response information. |
| HttpResponse |
Retrieves page checks content-type filters and performs HTML form authentication if needed. |
| HttpStatus |
Set of status codes for retrieved URL. |
| RobotRulesParser |
This class handles the parsing of robots.txt files. |
| RobotRulesParser.RobotRuleSet |
This class holds the rules which were parsed from a robots.txt file, and can test paths against those rules. |
| SitemapParser |
This class handles the parsing of sitemap.xml files. |