Big data described as bulk information. Hadoop is an open source, Java-based programming framework that supports the processing and storage of Big Data. A computer cluster is a set of connected computers that can work together as single system. Hadoop Clusters are such type of computer clusters that can store, analyse big data which are structured and unstructured. Azure HDInsight deploys these Azure Hadoop clusters in the cloud using the Hortonworks Data Platform (HDP) Hadoop distribution. It also consists of Apache HBase which is a tabular NoSQL database that provides a real-time access to data in HDFS. Apache Storm is a stream analytics platform for processing real-time events like sensors.
It is a general purpose storage system connected to computer nodes. By storing the data in Azure Storage one has the benefits of data sharing, data achieving, geo replication and elastic scaling capabilities. These enables data recovery and redundancy. The scale-out file system automatically scaled depending upon number of nodes connected to the cluster. Every time when a cluster is generated, there is no need to reload the data. Even after the original HDInsight cluster is deleted, you can still use the default storage container.
Let us consider a healthcare monitoring development and operational cycle.
The above is a health care monitoring process that happens in any hospital. Using Azure HDInsights , you can have a time-to-time monitoring on each process, status of servers and finally, depicts faults and errors if occurred. Azure Insight is deployed in the healthcare product.
After registering the hospital application in the Azure portal and when you start running it, you get the overall performance of healthcare application as given in the below figure.
Fig: Overall Application Performance Metrics
It shows Browser metrics like page views, page load time, request on each page, each session etc
The failures and errors occured while performing a task in the application like server exceptions, page faults, data dependency failures etc
Fig: Failures Metrics
Get Updates on Tech posts, Interview & Certification questions and training schedules