spark-avro-compactor

Spark job for compacting avro files together

Running locally

  1. local=true sbt
  2. runMain ie.ianduffy.spark.avro.compactor.Runner -i inputPath --output outputPath --schema-registry-url https://confluent-schema-registry --schema-registry-subject schema-subject

Contributors

  1. Kevin Eid
  2. Peter Barron
  3. Ian Duffy