Java Code Examples for org.apache.hadoop.mapred.lib.KeyFieldBasedComparator

The following examples show how to use org.apache.hadoop.mapred.lib.KeyFieldBasedComparator. These examples are extracted from open source projects. You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example 1
Source Project: hadoop   Source File: JobConf.java    License: Apache License 2.0 4 votes vote down vote up
/**
 * Get the {@link KeyFieldBasedComparator} options
 */
public String getKeyFieldComparatorOption() {
  return get(KeyFieldBasedComparator.COMPARATOR_OPTIONS);
}
 
Example 2
Source Project: big-c   Source File: JobConf.java    License: Apache License 2.0 4 votes vote down vote up
/**
 * Get the {@link KeyFieldBasedComparator} options
 */
public String getKeyFieldComparatorOption() {
  return get(KeyFieldBasedComparator.COMPARATOR_OPTIONS);
}
 
Example 3
Source Project: hadoop   Source File: JobConf.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Set the {@link KeyFieldBasedComparator} options used to compare keys.
 * 
 * @param keySpec the key specification of the form -k pos1[,pos2], where,
 *  pos is of the form f[.c][opts], where f is the number
 *  of the key field to use, and c is the number of the first character from
 *  the beginning of the field. Fields and character posns are numbered 
 *  starting with 1; a character position of zero in pos2 indicates the
 *  field's last character. If '.c' is omitted from pos1, it defaults to 1
 *  (the beginning of the field); if omitted from pos2, it defaults to 0 
 *  (the end of the field). opts are ordering options. The supported options
 *  are:
 *    -n, (Sort numerically)
 *    -r, (Reverse the result of comparison)                 
 */
public void setKeyFieldComparatorOptions(String keySpec) {
  setOutputKeyComparatorClass(KeyFieldBasedComparator.class);
  set(KeyFieldBasedComparator.COMPARATOR_OPTIONS, keySpec);
}
 
Example 4
Source Project: big-c   Source File: JobConf.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Set the {@link KeyFieldBasedComparator} options used to compare keys.
 * 
 * @param keySpec the key specification of the form -k pos1[,pos2], where,
 *  pos is of the form f[.c][opts], where f is the number
 *  of the key field to use, and c is the number of the first character from
 *  the beginning of the field. Fields and character posns are numbered 
 *  starting with 1; a character position of zero in pos2 indicates the
 *  field's last character. If '.c' is omitted from pos1, it defaults to 1
 *  (the beginning of the field); if omitted from pos2, it defaults to 0 
 *  (the end of the field). opts are ordering options. The supported options
 *  are:
 *    -n, (Sort numerically)
 *    -r, (Reverse the result of comparison)                 
 */
public void setKeyFieldComparatorOptions(String keySpec) {
  setOutputKeyComparatorClass(KeyFieldBasedComparator.class);
  set(KeyFieldBasedComparator.COMPARATOR_OPTIONS, keySpec);
}
 
Example 5
Source Project: RDFS   Source File: JobConf.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Set the {@link KeyFieldBasedComparator} options used to compare keys.
 *
 * @param keySpec the key specification of the form -k pos1[,pos2], where,
 *  pos is of the form f[.c][opts], where f is the number
 *  of the key field to use, and c is the number of the first character from
 *  the beginning of the field. Fields and character posns are numbered
 *  starting with 1; a character position of zero in pos2 indicates the
 *  field's last character. If '.c' is omitted from pos1, it defaults to 1
 *  (the beginning of the field); if omitted from pos2, it defaults to 0
 *  (the end of the field). opts are ordering options. The supported options
 *  are:
 *    -n, (Sort numerically)
 *    -r, (Reverse the result of comparison)
 */
public void setKeyFieldComparatorOptions(String keySpec) {
  setOutputKeyComparatorClass(KeyFieldBasedComparator.class);
  set("mapred.text.key.comparator.options", keySpec);
}
 
Example 6
Source Project: hadoop-gpu   Source File: JobConf.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Set the {@link KeyFieldBasedComparator} options used to compare keys.
 * 
 * @param keySpec the key specification of the form -k pos1[,pos2], where,
 *  pos is of the form f[.c][opts], where f is the number
 *  of the key field to use, and c is the number of the first character from
 *  the beginning of the field. Fields and character posns are numbered 
 *  starting with 1; a character position of zero in pos2 indicates the
 *  field's last character. If '.c' is omitted from pos1, it defaults to 1
 *  (the beginning of the field); if omitted from pos2, it defaults to 0 
 *  (the end of the field). opts are ordering options. The supported options
 *  are:
 *    -n, (Sort numerically)
 *    -r, (Reverse the result of comparison)                 
 */
public void setKeyFieldComparatorOptions(String keySpec) {
  setOutputKeyComparatorClass(KeyFieldBasedComparator.class);
  set("mapred.text.key.comparator.options", keySpec);
}