Big Data Is A Hot Research Topic Today 's World Essay

Every day, we produce 2.5 quintillion bytes of data. 90% of all data in the world was produced in the past two years. Data has been around forever; we have always gathered information. Paleolithic cavemen recorded their activities by carving them in stone or notching them in sticks. Egyptians used hieroglyphics to record significant events in history. The Library of Alexandria was home to half-a-million scrolls of the ancient world. Less than hundred years ago, we used punch cards to record and store information. As technology continues to evolve, the amount of data we store continues to grow. We’ve come a long way since stone tablets, scrolls, and punch cards. It’s important to understand the concept of big data and the impact is has created. This paper will define the classifications of data, explain the challenges of big data, and describe how big data analytics is being used in today’s data driven world.

The big data analytics deals with a large amount of data to work with and also the processing techniques to handle and manage large number of records with many attributes. The combination of big data and computing power with statistical analysis allows the designers to explore new behavioral data throughout the day at various websites. It represents a database that can’t be processed and managed by current data mining techniques due to large size and complexity of data. Big data analytic includes the representation of data in a suitable form and make use of data mining to extract useful information from these large dataset or stream of data. As stated above the big data analytics has recently emerged as a very popular research and practical-oriented framework that implements i) data mining, ii) predictive analysis forecasting, iii) text mining, iv) virtualization, v) optimization, vi) data security, vii) virtualization tools for processing very large data sets. In the implementation of big data applications, new data mining techniques and virtualization are required to be implemented due to the volume, variability, forms and velocity of the data to be processed. A set of machine learning techniques based on statistical analysis and neural networking technology for big data is still evolving but it shows a great potential for solving a big data business problems. Further, a new concept of in-memory database for enhancing the speed for analytic processing is further helping

The author points out that although there are existing algorithms and tools available to handle Big Data, they are not sufficient as the volume of data is exponentially increasing every day. To show the usefulness of Big Data mining, the author highlighted the work done by United Nations. In order to further enhance the reader’s perspective, the author provided research work of various professionals to educate its readers about the most recent updates in Big Data mining field. The author further describes the controversies surrounding Big Data. The author has first provided the context and exigence by elaborating on why we need new algorithm and tools to explore the Big Data. The author used the strategy of highlighting the logos by mentioning the research work of different industry professionals, workshops conducted on Big Data and was able to appeal to connect to the reader’s ethos. The author also used pathos by urging the budding Big Data researchers to further dig deep into the topic and explore this area

Today, the data consumption rate is tremendously expanding, the amount of data generated and stored is nearly imperceivable and highly growing. Big data that is nothing but a large volume of unstructured or structured data that runs in and out in to a business on daily basis. This big data is analyzed in order to achieve prominent business growth and improved business strategies [1]. Every year there is at least 40% increase in the amount of data growth on global level, leading to which companies have started adopting new data analytic techniques and tools and also have stepped ahead moving their data towards the cloud for their big data analytic requirements and for better analysis.[3][2] In big data analysis it is not the amount of data that is essential but how efficiently we handle, process and analyze it is the key factor. Big data analysis doesn’t revolve around how much data we occupy, it deals with how well you make use

With 3.2 billion internet users [1] and 6.4 billion internet-connected devices in 2016 alone [2], unprecedented amount of data is being generated and processed daily and increasingly every year. With the advent of web 2.0, the growth and creation of new and more complex types of data has created a natural demand for analysis of new data sources in order to gain knowledge. This new data volume and complexity is being called Big Data, famously characterised by Volume, Variety and Velocity and has created data management and processing challenges due to technological limitations, efficiency or cost to store and process in a timely fashion. The large volume and complexity of data cannot be handled and/or processed by most current information systems in a timely manner, while traditional data mining and analytics methods developed for a centralized data system may not be practical for Big Data.

The aim is to review the current ways of storing and obtaining data and compare them and determine the methodology used. Look into future methodologies and new developments in the industry. It is also crucial to assess how big data is already used and implemented into certain organisations. How the organisations improve their own businesses with this data and how it could help their clients with similar interests.

Due to the rapid growth in the use of Internet and its connected tools, an enormous amount of data are being produced on a daily basis. The concept of big data arrives when we were unable to manage this huge data with traditional methods. Big data is a mechanism of capturing, storing and analyzing the big datasets and also an idea of extracting some value from it. It is very handful while determining the root causes of failures, issues and defects in near-real time, creating coupons and other sales offers according to the customers shopping patterns, detecting any suspicious and fraudulent activities in real-time. As it is very advantageous, it also has some issues. Some of the common issues can be characterized into heterogeneity, complexity, timeless, scalability and privacy. The most important and significant challenge in the big data is to preserve privacy information of the customers, employees, and the organizations. It is very sensitive and includes conceptual, technical as well as legal significance.

Big data is certainly one of the biggest buzz phrases in it today. The term ’Big Data’ appeared for first time in 1998 in a Silicon Graphics (SGI) slide deck by John Mashey with the title of ”Big Data and the Next Wave of InfraStress” [9]. -Combined with virtualization and cloud computing, big data is a technological capability that will force data centers to significantly transform and evolve within the next five years. Similar to virtualization, big data infrastructure is unique and can create an architectural upheaval in the way systems, storage, and software infrastructure are connected and managed. Big data is an amalgam of large and varieties of data sets including structured data, semi structured data and unstructured data so it’s beyond the capability of traditional tools to capture, store, process and analysis of big data. It is true that big data have capability of unlocking new sources of development in many fields but at the same time researchers are being confronted challenges with big data. This paper reveals the various challenges faced with big data and opportunities realized with big data. Keywords: Big data, Challenges, Opportunities, Security Issues.

Additionally, the objective here is to inform the reader about the technical makeup of big data and breaking it down through data analysis, for the purpose of realizing that this can be advantageous not just for big enterprises

Abstract— Big data is a significant subject in modern times with the rapid advancement of new technologies for example, smartphones, pc/laptops, game consoles, that all in some way store information. Big companies require a place to not only store all the data that is coming in but to also analyze it for specific purposes and at the fastest speed manageable. There are many different providers out there who provide this service, this paper will talk about one way the company Google handles data using their own special made platform.

Big data is not a hype, but it is the future. The big data industry continues to advance, and big data service providers are making it easier for companies to work with big data in driving their businesses. Progressively, greater volumes and varieties of data will be incorporated with more business processes to support better decision making and greater insight. Moreover,

With 3.2 billion internet users [1] and 6.4 billion internet connected devices by 2016 [2], unprecedented amount of data is being generated and process daily and increasing every year. The advent of web 2.0 has fueled the growth and creation of new and more complex types of data which creates a natural demand to analyze new data sources in order to gain knowledge. This new data volume and complexity of the data is being called Big Data, famously characterised by Volume, Variety and Velocity; has created data management and processing challenges due to technological limitations, efficiency or cost to store and process in a timely fashion. The large volume and complex data is unable to be handled and/or processed by most current information systems in a timely manner and the traditional data mining and analytics methods developed for a centralized data systems may not be practical for big data.

There are many fundamental issue areas that need to be addressed in dealing with big data: data acquisition, data storage, data transfer, data management, and data processing. Each of these issues represents a large set of technical research problems and challenges in its own right.

International data Corporation (IdC) predicts that the market for big data technology and services will reach $16.9 billion by 2015 with 40% growth over the prediction horizon. Not only will this technology and services influence big data technology providers for related SQL database technologies, Hadoop or Mapreduce file systems, and related software and analytics software solutions, but it also will impact new server, storage, and networking infrastructure that is purposely designed to leverage and optimize the new analytical solutions. Major attributes of Big Data are:

Computer-based technologies have lot of impact on the way we live, work, and play and socialize. The methods of analytics and datamining had changed over the past few decades. In 1970s datamining played an important role in scientific fields such as physics, biology, and climate science. In mid-1990s and into the first decade of the new millennium, data mining and analytics played important role in business practices.