org.eclipse.smila.importing.crawler.web.utils
Class UriHelper

java.lang.Object
  org.eclipse.smila.importing.crawler.web.utils.UriHelper

public class UriHelper
extends java.lang.Object

helper class for working with URLs.

Constructor Summary

UriHelper()

Method Summary

static java.lang.String	makeAbsolute(java.lang.String baseUriString, java.lang.String uriString)
static java.lang.String	normalizeUrl(java.lang.String urlString) URI normalization: normalize path (host/path/..

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UriHelper

public UriHelper()

Method Detail

makeAbsolute

public static java.lang.String makeAbsolute(java.lang.String baseUriString,
                                            java.lang.String uriString)
                                     throws java.net.URISyntaxException

Returns:

absolute URI from given URI by using base URI. The base URI is expected to be absolute!

Throws:

java.net.URISyntaxException

normalizeUrl

public static java.lang.String normalizeUrl(java.lang.String urlString)
                                     throws java.net.URISyntaxException

URI normalization:

• normalize path (host/path/../path2 -> host/path2)
• convert scheme and host to lower case (HTTP -> http, WWW.Host.de -> www.host.de)
• remove fragment parts (...#fragment)
• remove default port 80 (host:80 -> host)
• filter out 'opaque' URIs (e.g. mailto:...@...)

Returns:

'null' if urlString couldn't be normalized.

Throws:

java.net.URISyntaxException