public class CSVIndexWriter extends Object implements IndexWriter
describe()
.
Note: works only in local mode, to be used with index option
-noCommit
.
Modifier and Type | Class and Description |
---|---|
protected class |
CSVIndexWriter.Separator
represent separators (also quote and escape characters) as char(s) and
byte(s) in the output encoding for efficiency.
|
Modifier and Type | Field and Description |
---|---|
protected FSDataOutputStream |
csvout |
protected Charset |
encoding
encoding of CSV file
|
static org.slf4j.Logger |
LOG |
X_POINT_ID
Constructor and Description |
---|
CSVIndexWriter() |
Modifier and Type | Method and Description |
---|---|
void |
close() |
void |
commit()
(nothing to commit)
|
void |
delete(String key)
(deletion of documents is not supported)
|
Map<String,Map.Entry<String,Object>> |
describe()
Returns
Map with the specific parameters the IndexWriter instance can take. |
Configuration |
getConf() |
static void |
main(String[] args) |
void |
open(Configuration conf,
String name) |
void |
open(IndexWriterParams parameters)
Initializes the internal variables from a given index writer configuration.
|
void |
setConf(Configuration conf) |
void |
update(NutchDocument doc) |
void |
write(NutchDocument doc) |
public static final org.slf4j.Logger LOG
protected Charset encoding
protected FSDataOutputStream csvout
public void open(Configuration conf, String name) throws IOException
open
in interface IndexWriter
IOException
public void open(IndexWriterParams parameters) throws IOException
open
in interface IndexWriter
parameters
- Params from the index writer configuration.IOException
- Some exception thrown by writer.public void write(NutchDocument doc) throws IOException
write
in interface IndexWriter
IOException
public void delete(String key)
delete
in interface IndexWriter
public void update(NutchDocument doc) throws IOException
update
in interface IndexWriter
IOException
public void close() throws IOException
close
in interface IndexWriter
IOException
public void commit()
commit
in interface IndexWriter
public Configuration getConf()
getConf
in interface Configurable
public Map<String,Map.Entry<String,Object>> describe()
Map
with the specific parameters the IndexWriter instance can take.describe
in interface IndexWriter
public void setConf(Configuration conf)
setConf
in interface Configurable
Copyright © 2021 The Apache Software Foundation