The following diagram shows a typical Big Data Infrastructure Design. This is from one of Allied Consultant’s Big Data [...]
Cluster Expected Volume Benchmark hardware Project Hardware requirements Cores RAM # nodes Disk Source 6 Million records / month ~ 3 records per second HDFS 6 million/month 1 namenode, 20 datanodes, 2 CPU/node, 64GB RAM/node 1 6G 1 : Master 3: Slaves 120% of 6G =7.2GB/month Kafka 4 [...]
With the help of Big data, Small Businesses can gain the competitive edge they require to stay ahead of the curve. For beginners, Big data includes large data sets of information which can reveal insights about your customers to help you make valuable business decisions. Data can help you to [...]
In this Tutorial we will be creating a window application that would monitor the SQL jobs by logging its statuses on the application and alert a pop up notification on any action of the job e.g. “Job start”, “Job completed” and “Job Failed”. Create a new Project. File >New [...]
Data Scientists are known for having a knack for statistics, data analysis etc. in order to understand and obtain insights from a given dataset, usually quite enormous in quantity. Here are some fundamentally important data science skills that are absolutely necessary for a Data Scientist. This [...]
What is a Dashboard? A dashboard is a visual display of the most important information needed to achieve one or more objectives; consolidated and arranged on a single screen so the information can be monitored at a glance. A user interface that organizes, integrates, and presents mission critical [...]
I have been involved in consulting for about 20 years now, and I think one of the biggest challenges (in the long term) for consulting firms is building a sense of ownership and fairness within the company. One of the biggest problems with people in general is that they overvalue what they [...]
Resource Management in Information Technology There is a whole host of technology available now a days to ensure that your IT hardware resources are managed efficiently. You may have a data center in house, a few cloud nodes/services/apps which together may constitute your investment in hardware. [...]
1- Download Docker for windows. 2- Install Docker for windows.exe 3- Check whether docker is running 4- View/update docker settings 5- Now Lets start using docker…. – docker #displays docker help – docker version #check docker version – docker images #check all images [...]
This is a brief guide on a Multi Node Kafka Cluster Setup using Windows Docker: —————————————– Setting Up a Three Node Kafka Cluster [...]
Recent Comments