Java Code Examples for org.apache.hadoop.mapred.SequenceFileRecordReader

The following examples show how to use org.apache.hadoop.mapred.SequenceFileRecordReader. These examples are extracted from open source projects. You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example 1
Source Project: anthelion   Source File: ContentAsTextInputFormat.java    License: Apache License 2.0 5 votes vote down vote up
public ContentAsTextRecordReader(Configuration conf, FileSplit split)
  throws IOException {
  sequenceFileRecordReader = new SequenceFileRecordReader<Text, Content>(
    conf, split);
  innerKey = (Text)sequenceFileRecordReader.createKey();
  innerValue = (Content)sequenceFileRecordReader.createValue();
}
 
Example 2
Source Project: nutch-htmlunit   Source File: ContentAsTextInputFormat.java    License: Apache License 2.0 5 votes vote down vote up
public ContentAsTextRecordReader(Configuration conf, FileSplit split)
  throws IOException {
  sequenceFileRecordReader = new SequenceFileRecordReader<Text, Content>(
    conf, split);
  innerKey = sequenceFileRecordReader.createKey();
  innerValue = sequenceFileRecordReader.createValue();
}
 
Example 3
Source Project: pxf   Source File: SequenceFileAccessor.java    License: Apache License 2.0 4 votes vote down vote up
/**
 * Overrides virtual method to create specialized record reader
 */
@Override
protected Object getReader(JobConf jobConf, InputSplit split) throws IOException {
    return new SequenceFileRecordReader<>(jobConf, (FileSplit) split);
}
 
Example 4
Source Project: hadoop   Source File: HadoopArchives.java    License: Apache License 2.0 4 votes vote down vote up
@Override
public RecordReader<LongWritable, HarEntry> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<LongWritable, HarEntry>(job,
             (FileSplit)split);
}
 
Example 5
Source Project: hadoop   Source File: DistCh.java    License: Apache License 2.0 4 votes vote down vote up
/** {@inheritDoc} */
public RecordReader<Text, FileOperation> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, FileOperation>(job,
      (FileSplit)split);
}
 
Example 6
Source Project: hadoop   Source File: DistCpV1.java    License: Apache License 2.0 4 votes vote down vote up
/**
 * Returns a reader for this split of the src file list.
 */
public RecordReader<Text, Text> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, Text>(job, (FileSplit)split);
}
 
Example 7
Source Project: big-c   Source File: HadoopArchives.java    License: Apache License 2.0 4 votes vote down vote up
@Override
public RecordReader<LongWritable, HarEntry> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<LongWritable, HarEntry>(job,
             (FileSplit)split);
}
 
Example 8
Source Project: big-c   Source File: DistCh.java    License: Apache License 2.0 4 votes vote down vote up
/** {@inheritDoc} */
public RecordReader<Text, FileOperation> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, FileOperation>(job,
      (FileSplit)split);
}
 
Example 9
Source Project: big-c   Source File: DistCpV1.java    License: Apache License 2.0 4 votes vote down vote up
/**
 * Returns a reader for this split of the src file list.
 */
public RecordReader<Text, Text> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, Text>(job, (FileSplit)split);
}
 
Example 10
Source Project: RDFS   Source File: HadoopArchives.java    License: Apache License 2.0 4 votes vote down vote up
public RecordReader<LongWritable, HarEntry> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<LongWritable, HarEntry>(job,
             (FileSplit)split);
}
 
Example 11
Source Project: RDFS   Source File: DistCh.java    License: Apache License 2.0 4 votes vote down vote up
/** {@inheritDoc} */
public RecordReader<Text, FileOperation> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, FileOperation>(job,
      (FileSplit)split);
}
 
Example 12
Source Project: RDFS   Source File: DistCp.java    License: Apache License 2.0 4 votes vote down vote up
/**
 * Returns a reader for this split of the src file list.
 */
public RecordReader<Text, Text> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, Text>(job, (FileSplit)split);
}
 
Example 13
Source Project: RDFS   Source File: DataFsck.java    License: Apache License 2.0 4 votes vote down vote up
/** {@inheritDoc} */
public RecordReader<Text, Text> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, Text>(job,
      (FileSplit) split);
}
 
Example 14
Source Project: RDFS   Source File: DistRaid.java    License: Apache License 2.0 4 votes vote down vote up
/** {@inheritDoc} */
public RecordReader<Text, PolicyInfo> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, PolicyInfo>(job,
      (FileSplit) split);
}
 
Example 15
Source Project: hadoop-gpu   Source File: HadoopArchives.java    License: Apache License 2.0 4 votes vote down vote up
public RecordReader<LongWritable, Text> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<LongWritable, Text>(job,
             (FileSplit)split);
}
 
Example 16
Source Project: hadoop-gpu   Source File: DistCh.java    License: Apache License 2.0 4 votes vote down vote up
/** {@inheritDoc} */
public RecordReader<Text, FileOperation> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, FileOperation>(job,
      (FileSplit)split);
}
 
Example 17
Source Project: hadoop-gpu   Source File: DistCp.java    License: Apache License 2.0 4 votes vote down vote up
/**
 * Returns a reader for this split of the src file list.
 */
public RecordReader<Text, Text> getRecordReader(InputSplit split,
    JobConf job, Reporter reporter) throws IOException {
  return new SequenceFileRecordReader<Text, Text>(job, (FileSplit)split);
}