国内Hadoop相关的开源项目

肯定不是完整的List,列出我知道的,欢迎补充Smile

1、BC-Hadoop:中国移动Hadoop工具链打包

https://github.com/cmri/bc-hadoop2.0

孵化阶段,将成为一个通用的开源Hadoop平台

2、BC-BSP:中国移动图计算平台

https://github.com/cmri/BC-BSP

孵化阶段,将成为通用的开源BSP平台

3、小米Minos:部署和管理Hadoop生态链工具

Minos is a distributed deployment and monitoring system. It was initially developed and used at Xiaomi to deploy and manage the Hadoop, HBase and ZooKeeper clusters used in the company. Minos can be easily extended to support other systems, among which HDFS, YARN and Impala have been supported in the current release.

源文档 <https://github.com/XiaoMi/minos>

4、阿里Zeus:宙斯是一个完整的Hadoop的作业平台

从Hadoop任务的调试运行到生产任务的周期调度 宙斯支持任务的整个生命周期

源文档 <https://github.com/alibaba/zeus>

5、华为HIndex:Secondary Index for HBase

The solution is 100% Java, compatible with Apache HBase 0.94.8, and is open sourced under ASL,Following capabilities are supported currently.

  • multiple indexes on table,
  • multi column index,
  • index based on part of a column value,
  • equals and range condition scans using index, and
  • bulk loading data to indexed table (Indexing done with bulk load).

6、EasyHadoop/Xadoop

It’s open source hadoop installing , management , monitoring platform which is lightweight, and easy to use.

Xadoop written in php (CodeIgniter) and python, focus on readability and user friendly toward quick installation and management your HADOOP cluster.

It’s easy to use A collection HADOOP cluster manager simplifies development and makes deploying a cinch. You can admin or install your HADOOP Ecosystem cluster very quickly with just one mouse click on Management pages.

源文档 <https://github.com/xianglei/easyhadoop>

发表评论

电子邮件地址不会被公开。 必填项已用*标注