com.google.cloud.dataflow.sdk.PipelineResult Java Examples

The following examples show how to use com.google.cloud.dataflow.sdk.PipelineResult. You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example #1
Source File: TaskRunner.java    From dockerflow with Apache License 2.0 6 votes vote down vote up 
/** Run a Docker workflow on Dataflow. */
public static void run(Workflow w, Map<String, WorkflowArgs> a, DataflowPipelineOptions o)
    throws IOException {
  LOG.info("Running workflow graph");
  if (w.getArgs().getProjectId() == null) {
    throw new IllegalArgumentException("Project id is required");
  }

  Pipeline p = DataflowFactory.dataflow(w, a, o);

  LOG.info("Created Dataflow pipeline");
  LOG.debug(w.toString());

  PipelineResult r = p.run();

  LOG.info("Dataflow pipeline completed");
  LOG.info("Result state: " + r.getState());
}
Example #2
Source File: DesiredStateEnforcer.java    From policyscanner with Apache License 2.0 5 votes vote down vote up 
/**
 * Run the pipeline.
 * @throws AggregatorRetrievalException
 */
public DesiredStateEnforcer run() throws AggregatorRetrievalException {
  PipelineResult result = this.pipeline.run();

  AggregatorValues<Long> aggregatorValues = result.getAggregatorValues(
          discrepancyAutoFixMessenger.getTotalEnforcedStatesAggregator());
  this.enforcedStates =
      aggregatorValues.getTotalValue(
          discrepancyAutoFixMessenger.getTotalEnforcedStatesAggregator().getCombineFn());
  return this;
}
Example #3
Source File: FlinkTestPipeline.java    From flink-dataflow with Apache License 2.0 4 votes vote down vote up 
private FlinkTestPipeline(PipelineRunner<? extends PipelineResult> runner,
						PipelineOptions options) {
	super(runner, options);
}