- work in progress.
NOTE: All evaluation include the load time and save time on HDFS/Hbase.
Hama 0.19
Matrix Multiplication
Node | Size | Density | Blocking Job | Multiplication |
5 | 5,000 * 5,000 | 100% | 21mins, 32sec | 13mins, 17sec |
Node | Size | Density | Blocking Job | Multiplication |
10 | 5,000 * 5,000 | 100% | 13mins, 31sec | 5mins, 25sec |
Matrix Transpose
Node | Size | Density | Running for |
5 | 5,000 * 5,000 | 100% | 19mins, 48sec |
Node | Size | Density | Running for |
10 | 5,000 * 5,000 | 100% | 12mins, 24sec |
Matrix Norm
Node | Type | Size | Density | Running for |
5 | One | 5,000 * 5,000 | 100% | 9mins, 32sec |
5 | Infinity | 5,000 * 5,000 | 100% | 8mins, 11sec |
5 | Maxvalue | 5,000 * 5,000 | 100% | 8mins, 58sec |
5 | Frobenius | 5,000 * 5,000 | 100% | 8mins, 42sec |
Node | Type | Size | Density | Running for |
10 | One | 5,000 * 5,000 | 100% | 2mins, 35sec |
10 | Infinity | 5,000 * 5,000 | 100% | 2mins, 19sec |
10 | Maxvalue | 5,000 * 5,000 | 100% | 2mins, 22sec |
10 | Frobenius | 5,000 * 5,000 | 100% | 2mins, 25sec |
Benchmarks
This performance contains data load and export operations.
Dependencies Information :
- Hadoop 0.18.2
- Hbase 0.18.1
Hardware Information :
- 4 Intel(R) Xeon(R) CPU 2.33GHz, SATA hard disk, Physical Memory 16,626,844 KB
- Dense matrix add
- Dense matrix multiply
Version | Operation | Cluster Size | Rows | Columns | Total Maps | Total Reduces | Time (seconds) | Bytes Written |
Trunk 712655 | Add | 2 node | 1,000 | 1,000 | 2 | 2 | 17 seconds | 66,326,104 |
Trunk 712658 | Mult | 2 node | 300 | 300 | 2 | 2 | 181 seconds | 5,929,512 |
Version | Operation | Cluster Size | Rows | Columns | Total Maps | Total Reduces | Time (seconds) | Bytes Read | Bytes Written |
Trunk 718158 | Mult | 2 node | 300 | 300 | 2 | 2 | 12 seconds | 1,464,484 | 2,929,092 |
Trunk 720735 | Mult | 2 node | 1,000 | 1,000 | 2 | 2 | 20 seconds | 16,166,452 | 32,333,028 |
...