Java Code Examples for org.apache.hadoop.classification.InterfaceAudience.LimitedPrivate

The following examples show how to use org.apache.hadoop.classification.InterfaceAudience.LimitedPrivate. These examples are extracted from open source projects. You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example 1
Source Project: dremio-oss   Source File: HadoopFileSystemWrapper.java    License: Apache License 2.0 5 votes vote down vote up
@Override
@LimitedPrivate({"HDFS", "MapReduce"})
public Token<?>[] addDelegationTokens(String renewer, Credentials credentials) throws IOException {
  try (WaitRecorder recorder = OperatorStats.getWaitRecorder(operatorStats)) {
    return underlyingFs.addDelegationTokens(renewer, credentials);
  } catch(FSError e) {
    throw propagateFSError(e);
  }
}
 
Example 2
Source Project: Bats   Source File: DrillFileSystem.java    License: Apache License 2.0 4 votes vote down vote up
@Override
@LimitedPrivate({"HDFS", "MapReduce"})
public String getCanonicalServiceName() {
  return underlyingFs.getCanonicalServiceName();
}
 
Example 3
Source Project: Bats   Source File: DrillFileSystem.java    License: Apache License 2.0 4 votes vote down vote up
@Override
@LimitedPrivate({"HDFS", "MapReduce"})
public Token<?>[] addDelegationTokens(String renewer, Credentials credentials) throws IOException {
  return underlyingFs.addDelegationTokens(renewer, credentials);
}
 
Example 4
Source Project: Bats   Source File: DrillFileSystem.java    License: Apache License 2.0 4 votes vote down vote up
@Override
@LimitedPrivate({"HDFS"})
@VisibleForTesting
public FileSystem[] getChildFileSystems() {
  return underlyingFs.getChildFileSystems();
}
 
Example 5
Source Project: Bats   Source File: DrillFSDataInputStream.java    License: Apache License 2.0 4 votes vote down vote up
@Override
@LimitedPrivate({"HDFS"})
public InputStream getWrappedStream() {
  return underlyingIs.getWrappedStream();
}
 
Example 6
Source Project: hadoop   Source File: YarnScheduler.java    License: Apache License 2.0 4 votes vote down vote up
@LimitedPrivate("yarn")
@Evolving
ResourceCalculator getResourceCalculator();
 
Example 7
Source Project: hadoop   Source File: ApplicationSubmissionContext.java    License: Apache License 2.0 4 votes vote down vote up
/**
 * @return true if tokens should be canceled when the app completes.
 */
@LimitedPrivate("mapreduce")
@Unstable
public abstract boolean getCancelTokensWhenComplete();
 
Example 8
Source Project: hadoop   Source File: ResourceSchedulerWrapper.java    License: Apache License 2.0 4 votes vote down vote up
@Override
@LimitedPrivate("yarn")
@Unstable
public Resource getClusterResource() {
  return null;
}
 
Example 9
Source Project: dremio-oss   Source File: HadoopFileSystemWrapper.java    License: Apache License 2.0 4 votes vote down vote up
@Override
@LimitedPrivate({"HDFS", "MapReduce"})
public String getCanonicalServiceName() {
  return underlyingFs.getCanonicalServiceName();
}
 
Example 10
Source Project: dremio-oss   Source File: HadoopFileSystemWrapper.java    License: Apache License 2.0 4 votes vote down vote up
@Override
@LimitedPrivate({"HDFS"})
@VisibleForTesting
public FileSystem[] getChildFileSystems() {
  return underlyingFs.getChildFileSystems();
}
 
Example 11
Source Project: dremio-oss   Source File: FSDataInputStreamWrapper.java    License: Apache License 2.0 4 votes vote down vote up
@Override
@LimitedPrivate({"HDFS"})
public InputStream getWrappedStream() {
  return underlyingIs.getWrappedStream();
}
 
Example 12
Source Project: big-c   Source File: YarnScheduler.java    License: Apache License 2.0 4 votes vote down vote up
@LimitedPrivate("yarn")
@Evolving
ResourceCalculator getResourceCalculator();
 
Example 13
Source Project: big-c   Source File: ApplicationSubmissionContext.java    License: Apache License 2.0 4 votes vote down vote up
/**
 * @return true if tokens should be canceled when the app completes.
 */
@LimitedPrivate("mapreduce")
@Unstable
public abstract boolean getCancelTokensWhenComplete();
 
Example 14
Source Project: big-c   Source File: ResourceSchedulerWrapper.java    License: Apache License 2.0 4 votes vote down vote up
@Override
@LimitedPrivate("yarn")
@Unstable
public Resource getClusterResource() {
  return null;
}
 
Example 15
Source Project: incubator-tez   Source File: MRHelpers.java    License: Apache License 2.0 4 votes vote down vote up
@LimitedPrivate("Hive, Pig")
@Unstable
public static byte[] createUserPayloadFromConf(Configuration conf)
    throws IOException {
  return TezUtils.createUserPayloadFromConf(conf);
}
 
Example 16
Source Project: incubator-tez   Source File: MRHelpers.java    License: Apache License 2.0 4 votes vote down vote up
@LimitedPrivate("Hive, Pig")
public static ByteString createByteStringFromConf(Configuration conf)
    throws IOException {
  return TezUtils.createByteStringFromConf(conf);
}
 
Example 17
Source Project: incubator-tez   Source File: MRHelpers.java    License: Apache License 2.0 4 votes vote down vote up
@LimitedPrivate("Hive, Pig")
@Unstable
public static Configuration createConfFromUserPayload(byte[] bb)
    throws IOException {
  return TezUtils.createConfFromUserPayload(bb);
}
 
Example 18
Source Project: incubator-tez   Source File: MRHelpers.java    License: Apache License 2.0 4 votes vote down vote up
@LimitedPrivate("Hive, Pig")
public static Configuration createConfFromByteString(ByteString bs)
    throws IOException {
  return TezUtils.createConfFromByteString(bs);
}
 
Example 19
Source Project: incubator-tez   Source File: MRInputLegacy.java    License: Apache License 2.0 4 votes vote down vote up
@LimitedPrivate("hive")
public void init() throws IOException {
  super.initializeInternal();
  checkAndAwaitRecordReaderInitialization();
}
 
Example 20
Source Project: tez   Source File: MRInputLegacy.java    License: Apache License 2.0 4 votes vote down vote up
@LimitedPrivate("hive")
public void init() throws IOException {
  super.initializeInternal();
  checkAndAwaitRecordReaderInitialization();
}
 
Example 21
Source Project: hadoop   Source File: RMAppAttempt.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * The master key for client-to-AM tokens for this app attempt. This is only
 * used for RMStateStore. Normal operation must invoke the secret manager to
 * get the key and not use the local key directly.
 * @return The master key for client-to-AM tokens for this app attempt
 */
@LimitedPrivate("RMStateStore")
SecretKey getClientTokenMasterKey();
 
Example 22
Source Project: hadoop   Source File: YarnScheduler.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Get the whole resource capacity of the cluster.
 * @return the whole resource capacity of the cluster.
 */
@LimitedPrivate("yarn")
@Unstable
public Resource getClusterResource();
 
Example 23
Source Project: hadoop   Source File: YarnScheduler.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Get node resource usage report.
 * @param nodeId
 * @return the {@link SchedulerNodeReport} for the node or null
 * if nodeId does not point to a defined node.
 */
@LimitedPrivate("yarn")
@Stable
public SchedulerNodeReport getNodeReport(NodeId nodeId);
 
Example 24
Source Project: hadoop   Source File: YarnScheduler.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Get the Scheduler app for a given app attempt Id.
 * @param appAttemptId the id of the application attempt
 * @return SchedulerApp for this given attempt.
 */
@LimitedPrivate("yarn")
@Stable
SchedulerAppReport getSchedulerAppInfo(ApplicationAttemptId appAttemptId);
 
Example 25
Source Project: hadoop   Source File: YarnScheduler.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Get a resource usage report from a given app attempt ID.
 * @param appAttemptId the id of the application attempt
 * @return resource usage report for this given attempt
 */
@LimitedPrivate("yarn")
@Evolving
ApplicationResourceUsageReport getAppResourceUsageReport(
    ApplicationAttemptId appAttemptId);
 
Example 26
Source Project: hadoop   Source File: YarnScheduler.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Get the root queue for the scheduler.
 * @return the root queue for the scheduler.
 */
@LimitedPrivate("yarn")
@Evolving
QueueMetrics getRootQueueMetrics();
 
Example 27
Source Project: hadoop   Source File: YarnScheduler.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Gets the apps under a given queue
 * @param queueName the name of the queue.
 * @return a collection of app attempt ids in the given queue.
 */
@LimitedPrivate("yarn")
@Stable
public List<ApplicationAttemptId> getAppsInQueue(String queueName);
 
Example 28
Source Project: hadoop   Source File: YarnScheduler.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Get the container for the given containerId.
 * @param containerId
 * @return the container for the given containerId.
 */
@LimitedPrivate("yarn")
@Unstable
public RMContainer getRMContainer(ContainerId containerId);
 
Example 29
Source Project: hadoop   Source File: YarnScheduler.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Moves the given application to the given queue
 * @param appId
 * @param newQueue
 * @return the name of the queue the application was placed into
 * @throws YarnException if the move cannot be carried out
 */
@LimitedPrivate("yarn")
@Evolving
public String moveApplication(ApplicationId appId, String newQueue)
    throws YarnException;
 
Example 30
Source Project: hadoop   Source File: ApplicationSubmissionContext.java    License: Apache License 2.0 2 votes vote down vote up
/**
 * Set to false if tokens should not be canceled when the app finished else
 * false.  WARNING: this is not recommended unless you want your single job
 * tokens to be reused by others jobs.
 * @param cancel true if tokens should be canceled when the app finishes. 
 */
@LimitedPrivate("mapreduce")
@Unstable
public abstract void setCancelTokensWhenComplete(boolean cancel);