org.apache.hadoop.mapred.SequenceFileRecordReader Java Examples
The following examples show how to use
org.apache.hadoop.mapred.SequenceFileRecordReader.
You can vote up the ones you like or vote down the ones you don't like,
and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example #1
Source File: ContentAsTextInputFormat.java From nutch-htmlunit with Apache License 2.0 | 5 votes |
public ContentAsTextRecordReader(Configuration conf, FileSplit split) throws IOException { sequenceFileRecordReader = new SequenceFileRecordReader<Text, Content>( conf, split); innerKey = sequenceFileRecordReader.createKey(); innerValue = sequenceFileRecordReader.createValue(); }
Example #2
Source File: ContentAsTextInputFormat.java From anthelion with Apache License 2.0 | 5 votes |
public ContentAsTextRecordReader(Configuration conf, FileSplit split) throws IOException { sequenceFileRecordReader = new SequenceFileRecordReader<Text, Content>( conf, split); innerKey = (Text)sequenceFileRecordReader.createKey(); innerValue = (Content)sequenceFileRecordReader.createValue(); }
Example #3
Source File: HadoopArchives.java From RDFS with Apache License 2.0 | 4 votes |
public RecordReader<LongWritable, HarEntry> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<LongWritable, HarEntry>(job, (FileSplit)split); }
Example #4
Source File: DistCp.java From hadoop-gpu with Apache License 2.0 | 4 votes |
/** * Returns a reader for this split of the src file list. */ public RecordReader<Text, Text> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, Text>(job, (FileSplit)split); }
Example #5
Source File: DistCh.java From hadoop-gpu with Apache License 2.0 | 4 votes |
/** {@inheritDoc} */ public RecordReader<Text, FileOperation> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, FileOperation>(job, (FileSplit)split); }
Example #6
Source File: HadoopArchives.java From hadoop-gpu with Apache License 2.0 | 4 votes |
public RecordReader<LongWritable, Text> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<LongWritable, Text>(job, (FileSplit)split); }
Example #7
Source File: DistRaid.java From RDFS with Apache License 2.0 | 4 votes |
/** {@inheritDoc} */ public RecordReader<Text, PolicyInfo> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, PolicyInfo>(job, (FileSplit) split); }
Example #8
Source File: DataFsck.java From RDFS with Apache License 2.0 | 4 votes |
/** {@inheritDoc} */ public RecordReader<Text, Text> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, Text>(job, (FileSplit) split); }
Example #9
Source File: DistCp.java From RDFS with Apache License 2.0 | 4 votes |
/** * Returns a reader for this split of the src file list. */ public RecordReader<Text, Text> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, Text>(job, (FileSplit)split); }
Example #10
Source File: DistCh.java From RDFS with Apache License 2.0 | 4 votes |
/** {@inheritDoc} */ public RecordReader<Text, FileOperation> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, FileOperation>(job, (FileSplit)split); }
Example #11
Source File: SequenceFileAccessor.java From pxf with Apache License 2.0 | 4 votes |
/** * Overrides virtual method to create specialized record reader */ @Override protected Object getReader(JobConf jobConf, InputSplit split) throws IOException { return new SequenceFileRecordReader<>(jobConf, (FileSplit) split); }
Example #12
Source File: DistCpV1.java From big-c with Apache License 2.0 | 4 votes |
/** * Returns a reader for this split of the src file list. */ public RecordReader<Text, Text> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, Text>(job, (FileSplit)split); }
Example #13
Source File: DistCh.java From big-c with Apache License 2.0 | 4 votes |
/** {@inheritDoc} */ public RecordReader<Text, FileOperation> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, FileOperation>(job, (FileSplit)split); }
Example #14
Source File: HadoopArchives.java From big-c with Apache License 2.0 | 4 votes |
@Override public RecordReader<LongWritable, HarEntry> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<LongWritable, HarEntry>(job, (FileSplit)split); }
Example #15
Source File: DistCpV1.java From hadoop with Apache License 2.0 | 4 votes |
/** * Returns a reader for this split of the src file list. */ public RecordReader<Text, Text> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, Text>(job, (FileSplit)split); }
Example #16
Source File: DistCh.java From hadoop with Apache License 2.0 | 4 votes |
/** {@inheritDoc} */ public RecordReader<Text, FileOperation> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<Text, FileOperation>(job, (FileSplit)split); }
Example #17
Source File: HadoopArchives.java From hadoop with Apache License 2.0 | 4 votes |
@Override public RecordReader<LongWritable, HarEntry> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException { return new SequenceFileRecordReader<LongWritable, HarEntry>(job, (FileSplit)split); }