public interface URLExemptionFilter extends Pluggable, Configurable
db.ignore.external.links
.
This is useful when the crawl is focused to a domain but resources like images are hosted on CDN.Modifier and Type | Field and Description |
---|---|
static String |
X_POINT_ID
The name of the extension point.
|
Modifier and Type | Method and Description |
---|---|
boolean |
filter(String fromUrl,
String toUrl)
Checks if toUrl is exempted when the ignore external is enabled
|
getConf, setConf
static final String X_POINT_ID
boolean filter(String fromUrl, String toUrl)
fromUrl
- : the source url which generated the outlinktoUrl
- : the destination url which needs to be checked for exemptionCopyright © 2021 The Apache Software Foundation