public class DomainDenylistURLFilter extends Object implements URLFilter
Filters URLs based on a file containing domain suffixes, domain names, and hostnames. A URL that matches one of the suffixes, domains, or hosts present in the file is filtered out.
URLs are checked in order of domain suffix, domain name, and hostname against entries in the domain file. The domain file would be setup as follows with one entry per line:
com apache.org www.apache.org
The first line is an example of a filter that would exclude all .com domains. The second line excludes all URLs from apache.org and all of its subdomains such as lucene.apache.org and hadoop.apache.org. The third line would exclude only URLs from www.apache.org. There is no specific ordering to entries. The entries are from more general to more specific with the more general overriding the more specific.
The domain file defaults to domaindenylist-urlfilter.txt in the classpath but can be overridden using the:X_POINT_ID
Constructor and Description |
---|
DomainDenylistURLFilter() |
Modifier and Type | Method and Description |
---|---|
String |
filter(String url) |
Configuration |
getConf() |
void |
setConf(Configuration conf)
Sets the configuration.
|
public void setConf(Configuration conf)
setConf
in interface Configurable
public Configuration getConf()
getConf
in interface Configurable
Copyright © 2021 The Apache Software Foundation