• Search by APIs
• Search by Words
• Search Projects

• Java
• Python
• JavaScript
• TypeScript
• C++
• Scala
• Blog

Projects Related with hadoop

• 1. elasticsearch-hadoop
  under Apache License 2.0 license
• :elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
• 2. dr-elephant
  under Apache License 2.0 license
• Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark
• 3. EasyReport
  under Apache License 2.0 license
• A simple and easy to use Web Report System for java.EasyReport是一个简单易用的Web报表工具(支持Hadoop,HBase及各种关系型数据库),它的主要功能是把SQL语句查询出的行列结构转换成HTML表格(Table)，并支持表格的跨行(RowSpan)与跨列(ColSpan)。同时它还支持报表Excel导出、图表显示及固定表头与左边列的功能。
• 4. incubator-gobblin
  under Apache License 2.0 license
• Gobblin is a distributed big data integration framework (ingestion, replication, compliance, retention) for batch and streaming systems. Gobblin features integrations with Apache Hadoop, Apache Kafka, Salesforce, S3, MySQL, Google etc.
• 5. XLearning
  under Apache License 2.0 license
• AI on Hadoop
• 6. geometry-api-java
  under Apache License 2.0 license
• The Esri Geometry API for Java enables developers to write custom applications for analysis of spatial data. This API is used in the Esri GIS Tools for Hadoop and other 3rd-party data processing solutions.
• 7. learning-hadoop
  under Apache License 2.0 license
• Learning to write Hadoop examples
• 8. cloudbreak
  under Apache License 2.0 license
• A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.
• 9. pentaho-hadoop-shims
  under Apache License 2.0 license
• Hadoop Configurations
• 10. hadoop-connectors
  under Apache License 2.0 license
• Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
• 11. spatial-framework-for-hadoop
  under Apache License 2.0 license
• The Spatial Framework for Hadoop allows developers and data scientists to use the Hadoop data processing system for spatial data analysis.
• 12. emr-dynamodb-connector
  under Apache License 2.0 license
• Implementations of open source Apache Hadoop/Hive interfaces which allow for ingesting data from Amazon DynamoDB
• 13. hadoop-ozone
  under Apache License 2.0 license
• Scalable, redundant, and distributed object store for Apache Hadoop
• 14. hadoop-arch-book
  under Apache License 2.0 license
• Code repository for O'Reilly Hadoop Application Architectures book
• 15. hadoop-mini-clusters
  under Apache License 2.0 license
• hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE
• 16. BigData-In-Practice
  under Apache License 2.0 license
• 大数据实践项目 Hadoop、Spark、Kafka、Hbase、Flink.....
• 17. opensoc-streaming
  under Apache License 2.0 license
• Extensible set of Storm topologies and topology attributes for streaming, enriching, indexing, and storing telemetry in Hadoop.
• 18. IntroToHadoopAndMR__Udacity_Course
  under Apache License 2.0 license
• :elephant: Source code for assignments of Udacity course "Introduction to Hadoop and MapReduce"
• 19. hadoop-book
  under Apache License 2.0 license
• 'Hadoop illuminated' hadoop book
• 20. hiped2
  under Apache License 2.0 license
• Source code that accompanies the book "Hadoop in Practice, Second Edition".
• 21. Play-Videos-In-HDFS
  under Apache License 2.0 license
• This project realizes playing videos storing in HDFS(Hadoop) in the web page online.在线播放HDFS中视频文件
• 22. searchanalytics-bigdata
  under MIT License license
• Customer Product search clicks analytics using big data Hadoop, Hive, Oozie, ElasticSearch, Akka, Spring Data
• 23. Cubert
  under Apache License 2.0 license
• Fast and efficient batch computation engine for complex analysis and reporting of massive datasets on Hadoop
• 24. mrgeo
  under Apache License 2.0 license
• MrGeo is a geospatial toolkit designed to provide raster-based geospatial capabilities that can be performed at scale. MrGeo is built upon Apache Spark and the Hadoop ecosystem to leverage the storage and processing of hundreds of commodity computers. See the wiki for more details.
• 25. zongtui-webcrawler
  under GNU General Public License v2.0 license
• 基于hadoop思维的分布式网络爬虫。
• 26. hadoop-map-reduce-patterns
  under Apache License 2.0 license
• Hadoop Map-Reduce Design Patterns
• 27. sequenceiq-samples
  under Apache License 2.0 license
• SequenceIQ Hadoop examples
• 28. Hadoop-BAM
  under MIT License license
• Hadoop-BAM is a Java library for the manipulation of files in common bioinformatics formats using the Hadoop MapReduce framework
• 29. s3committer
  under Apache License 2.0 license
• Hadoop output committers for S3
• 30. cc-warc-examples
  under MIT License license
• CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
• 31. hadoopcryptoledger
  under Apache License 2.0 license
• Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive
• 32. cephfs-hadoop
  under GNU Lesser General Public License v2.1 license
• cephfs-hadoop
• 33. clickstream-tutorial
  under Apache License 2.0 license
• Code for Tutorial on designing clickstream analytics application using Hadoop
• 34. kangaroo
  under Apache License 2.0 license
• Hadoop utilities for Kafka, S3, and more
• 35. fraud-detection-tutorial
  under Apache License 2.0 license
• 36. aws-glue-data-catalog-client-for-apache-hive-metastore
  under Apache License 2.0 license
• The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog as a central repository to store structural and operational metadata for their data. AWS Glue provides out-of-box integration with Amazon EMR that enables customers to use the AWS Glue Data Catalog as an external Hive Metastore. This is an open-source implementation of the Apache Hive Metastore client on Amazon EMR clusters that uses the AWS Glue Data Catalog as an external Hive Metastore. It serves as a reference implementation for building a Hive Metastore-compatible client that connects to the AWS Glue Data Catalog. It may be ported to other Hive Metastore-compatible platforms such as other Hadoop and Apache Spark distributions
• 37. hadoop-solr
  under Apache License 2.0 license
• Code to index HDFS to Solr using MapReduce
• 38. jsr203-hadoop
  under Apache License 2.0 license
• A Java NIO file system provider for HDFS
• 39. spydra
  under Apache License 2.0 license
• Ephemeral Hadoop clusters using Google Compute Platform
• 40. MLHadoop
  under Apache License 2.0 license
• This repository contains Machine-Learning MapReduce codes for Hadoop which are written from scratch (without using any package or library). E.g. Prediction (Linear and Logistic Regression), Clustering (K-Means), Classification (KNN) etc.
• 41. ES-Fastloader
  under Apache License 2.0 license
• Quickly build large-scale ElasticSearch indices by using the fault tolerance and parallelism of Hadoop
• 42. logparser
  under Apache License 2.0 license
• Easy parsing of Apache HTTPD and NGINX access logs with Java, Hadoop, Hive, Pig, Flink, Beam, Storm, Drill, ...
• 43. dk-fitting
  under Apache License 2.0 license
• Fitting是一个面向大数据的统一的开发框架，由大快搜索主导并完全开源，克服了大数据技术开发涉及技术面广,各组件间缺乏统一规范等问题，能有效降低大数据的学习难度，并提高大数据项目的开发效率并可与开源项目混用。 Fitting遵循Apache2.0开源协议，采用类黑箱框架模式，将大数据生态圈内各组件底层API根据应用组合封装为Fitting API服务。用户编程时直接引用Fitting框架，即可使用功能丰富的Fitting API，完成过去复杂的编码工作。 Fitting框架由数据处理（dataprocess）、数据源（datasource）、ElasticSQL引擎（elasticsql）、图计算（graphx）、机器学习（ml）、自然语言处理（nlp）、搜索(search)、SQL工具类、（sqlutils）、流计算（stream）九大部分组成，可以单独部署，也可整体部署。 Fitting支持C、C++、C#、Cocoa、Common Lisp、Dlang、Dart、Delphi、Erlang、Go、Haskell、Haxe、Java (SE)、Java (ME)、Lua、node.js、OCaml、Perl、PHP、Python、Ruby、Rust、Smalltalk等二十多种编程语言。
• 44. MapReduce-Demo
  under MIT License license
• Hadoop，MapReduce编程学习练手实例
• 45. hdfs-shell
  under Apache License 2.0 license
• HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS
• 46. hdfs2cass
  under Apache License 2.0 license
• Hadoop mapreduce job to bulk load data into Cassandra
• 47. hadoop-hdfs-fsimage-exporter
  under Apache License 2.0 license
• Exports Hadoop HDFS content statistics to Prometheus
• 48. hadoopoffice
  under Apache License 2.0 license
• HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)
• 49. yarn-beginners-examples
  under Apache License 2.0 license
• Yarn example source code accompanying wikibooks "Beginning Hadoop Programming" by Jaehwa Jung
• 50. bigdata-tutorial
  under Apache License 2.0 license
• study demos for hadoop、hbase、hive、spark、storm .......
• 51. ratis
  under Apache License 2.0 license
• A java implementation of Raft protocol for Hadoop ecosystem
• 52. aerospike-hadoop
  under Apache License 2.0 license
• Aerospike Hadoop Connector
• 53. marklogic-contentpump
  under Apache License 2.0 license
• MarkLogic Connector for Hadoop and MarkLogic Contentpump (mlcp)
• 54. chimera
  under Apache License 2.0 license
• Cryptographic library optimized with AES-NI
• 55. Intro-to-Spring-Hadoop
  under Apache License 2.0 license
• Examples and Slides for "Introduction to Spring for Apache Hadoop" at SpringOne2GX 2014
• 56. garmadon
  under Apache License 2.0 license
• Java event logs collector for hadoop and frameworks
• 57. azure-tables-hadoop
  under Apache License 2.0 license
• A Hadoop input format and a Hive storage handler so that you can access data stored in Windows Azure Storage tables from within a Hadoop (or HdInsight) cluster.
• 58. titan1withtp3.1
  under Apache License 2.0 license
• Titan 1.0 with TP3.1 (Master Branch), HBase 1.1.1 and Hadoop 2.7.1 support
• 59. hadoop-gpu
  under Apache License 2.0 license
• 60. hive
  under Apache License 2.0 license
• Apache Hive / Hadoop Spring Boot Microservice
• 61. mongodb-hadoop-workshop
  under Apache License 2.0 license
• MongoDB-Hadoop Workshop Exercises
• 62. zephyr
  under Apache License 2.0 license
• Zephyr is a big data, platform agnostic ETL API, with Hadoop MapReduce, Storm, and other big data bindings.
• 63. HadoopCV
  under Apache License 2.0 license
• HadoopCV Hadoop,Spark Reader Video!
• 64. Scribengin
  under GNU Affero General Public License v3.0 license
• HA Distributed System to transactionally move data from Sources (eg Kafka) to Sinks ( eg Hadoop HDFS )
• 65. arvo2parquet
  under MIT License license
• Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.
• 66. warc-hadoop
  under MIT License license
• WARC (Web Archive) Input and Output Formats for Hadoop
• 67. hadoop-sstable
  under Apache License 2.0 license
• Splittable Input Format for Reading Cassandra SSTables Directly
• 68. hadoop-louvain-community
  under Apache License 2.0 license
• Map Reduce Implementation of a community detection algorithm extending Louvain method for community detection.
• 69. wikireverse
  under MIT License license
• Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
• 70. hello-kafka-stream-testing
  under MIT License license
• The most simple way to test Kafka based applications or micro-services e.g. Read/Write during HBase/Hadoop or other Data Ingestion Pipe Lines
• 71. pattern-matching
  under Apache License 2.0 license
• Hadoop MapReduce over Hive based implementation of attributed network pattern matching.
• 72. hadoop-etl-udfs
  under MIT License license
• The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL
• 73. xxhadoop
  under Apache License 2.0 license
• Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/ML etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !
• 74. celos
  under Apache License 2.0 license
• Scriptable scheduler for periodical Hadoop workflows
• 75. hadoop
  under Apache License 2.0 license
• Public hadoop release repository
• 76. iow-hadoop-streaming
  under Apache License 2.0 license
• Set of hadoop input/output formats for use in combination with hadoop streaming