Like

Welcome On Mobius

Mobius was created by professionnal coders and passionate people.

We made all the best only for you, to enjoy great features and design quality. Mobius was build in order to reach a pixel perfect layout.

Mobius includes exclusive features such as the Themeone Slider, Themeone Shorcode Generator and Mobius Grid Generator.

Our Skills

WordPress90%
Design/Graphics75%
HTML/CSS/jQuery100%
Support/Updates80%

A Comparison of Big Data Processing Platforms

By Abdul Basit 10 months agoNo Comments

 

Cluster Expected Volume Benchmark hardware Project Hardware requirements
Cores RAM # nodes Disk
Source 6 Million records / month

~ 3 records per second

HDFS 6 million/month 1 namenode, 20 datanodes, 2 CPU/node, 64GB RAM/node

 

1 6G 1 : Master

3: Slaves

120% of 6G

=7.2GB/month

Kafka 4 topics

6 million/month per topic

1 nodes @ 4 GB RAM, 1 CPU,200 GB disk each

16,000 Msg/sec

1 4G 1 24 GB/month
Kafka Connector for HBASE N/A
Kafka Connector for HDFS N/A
Logstash 6 million/month 1 node, 3.75GB RAM, 1 CPU Cores

180 Events/sec

1 4G 1
Hbase 6GB/month 7 nodes, 32gb RAM, 8 CPU cores

60240 req/sec – 200 req/sec

1 8G 1 4GB/month
Category:
  Big Data
this post was shared 0 times
 000
About

 Abdul Basit

  (11 articles)

Leave a Reply

Your email address will not be published.