What does big data mean and how to understand the concept of big data?

Big data (big? Data, mega? Data), or massive data, refers to massive, high-growth and diversified information assets, which need new processing modes to have stronger decision-making, insight and process optimization capabilities.

In the era of big data written by Victor Mayer-Schoenberg and Kenneth Cookeye? Cuhk data refers to the use of all data for analysis and processing without the shortcut of random analysis (sampling survey). 4V characteristics of big data: volume (mass), speed (high speed), diversity (diversity) and value (value).

For "big data" (big? Gartner, a data research organization, gives such a definition. "Big data" is a massive, high-growth and diversified information asset, which needs a new processing mode to have stronger decision-making, insight and discovery, and process optimization capabilities.

Technically, the relationship between big data and cloud computing is as inseparable as the front and back of a coin. Big data cannot be processed by a single computer, and it must adopt a distributed architecture. It is characterized by distributed data mining of massive data, but it must rely on distributed processing of cloud computing, distributed database, cloud storage and virtualization technology.

With the advent of the cloud era, Big data (big? Data) has also attracted more and more attention. Zhucloud's team of analysts believes that Big data (big? Data) is usually used to describe a large number of unstructured data and semi-structured data created by a company. It will take too much time and money to download it to a relational database for analysis. Big data analysis is often associated with cloud computing, because real-time analysis of large data sets requires a framework such as MapReduce to distribute work to dozens, hundreds or even thousands of computers.

?

Big data needs special technology to effectively process a large amount of data within the tolerance time. Technologies suitable for big data include MPP database, data mining power grid, distributed file system, distributed database, cloud computing platform, Internet and scalable storage system. ?

?

The characteristics of big data. There are a lot of data, many kinds of data, strong real-time performance and great data value. There are big data in all walks of life, but a lot of information and consultation are complex, which requires us to search, process, analyze, summarize and summarize its deep-seated laws. ?

?

Big? Data collection. The development of science and technology and the Internet has promoted the arrival of the era of big data. Every industry produces a huge amount of data fragments every day, and the unit of data measurement has changed from bytes, KB and MB to? GB and TB are measured by PB, EB, ZB, YB and even BB, NB and DB. Data collection in the era of big data is no longer a technical problem, but how can we find so much data? Its inherent law.

?

Mining and processing of big data. Big data cannot be calculated and estimated by the human brain, nor can it be processed by a single computer. It must adopt distributed computing architecture, relying on distributed processing, distributed database, cloud storage and cloud computing virtualization technology. Therefore, the mining and processing of big data must use cloud technology.

The Internet is a magical big network, and the development of big data is also a model. If you really want to know about big data, you can come here. The starting number of this rooster is 187, the middle number is the zero of three children, and the last number is 14250. You can find it by combining them in order. What I want to say is, unless you want to do or understand this, if you just join in the fun, don't come.

The application of big data?

Big data applications can help us gain useful value in life.

With the application of big data becoming more and more extensive, the application industry is getting lower and lower, and some novel big data applications can be seen every day, thus helping people get really useful value from them. Many organizations or individuals will be affected by big data analysis, but how does big data help people mine valuable information? Let's take a look at nine highly valuable applications of big data, which are the key areas of big data in analytical applications:

1. Know your customers and meet their service needs.

The application of big data is now the most widely known in this field. The focus is on how to use big data to better understand customers, their preferences and behaviors. Enterprises like to collect social data, browser logs, analyze text and sensor data in order to understand customers more comprehensively. Under normal circumstances, data models are created for forecasting. For example, Target, a famous American retailer, obtains valuable information through the analysis of big data and accurately predicts when customers want children. In addition, through the application of big data, telecom companies can better predict the lost customers, Wal-Mart can more accurately predict which products will sell well, the auto insurance industry will understand the needs and driving level of customers, and the government can also understand the preferences of voters.

2. Business process optimization

Big data also helps to optimize business processes. Social media data, online search and weather forecast can be used to mine valuable data, among which the most widely used is the optimization of supply chain and distribution route. In these two aspects, geographic positioning and radio frequency identification track goods and delivery vehicles, and use real-time traffic route data to make more optimized routes. The human resources business is also improved through the analysis of big data, including the optimization of talent recruitment.

3. Big data is improving our lives

Big data applies not only to enterprises and governments, but also to everyone in our lives. We can use the devices we wear (such as smart watches or smart bracelets) to generate the latest data, which allows us to track according to our calorie consumption and sleep patterns. Moreover, we also use big data analysis to find our love. Many times, dating websites are big data application tools to help people in need match the right objects.

4. Improve health care and research and development

The computing power of big data analysis applications enables us to decode the entire DNA in a few minutes. It also allows us to work out the latest treatment plan. At the same time, it can better understand and predict diseases. Just like data that can be formed when people wear smart watches, big data can also help patients to better treat diseases. Big data technology has been applied to hospitals to monitor the situation of premature and sick babies. By recording and analyzing the baby's heartbeat, the doctor can predict the possible discomfort of the baby. This can help doctors help babies better.

Structure of big data concept

Big data is just a representation or feature of the development of the Internet at this stage. There is no need to myth it or keep it in awe. Under the background of technological innovation represented by cloud computing, these data, which were originally difficult to collect and use, have become easy to use. Through continuous innovation in all walks of life, big data will gradually create more value for mankind.

Secondly, if we want to understand big data systematically, we must decompose it comprehensively and meticulously. I will start from three levels:

The first level is theory, which is the only way of cognition and the baseline that is widely recognized and spread. Here, we can understand the overall description and characterization of big data by the industry from the definition of its characteristics; From the discussion of the value of big data, deeply analyze the preciousness of big data; Insight into the development trend of big data; This paper examines the long-term game between people and data from the special and important perspective of big data privacy. ?

The second level is technology, which is the means to reflect the value of big data and the cornerstone of progress. From the development of cloud computing, distributed processing technology, storage technology and sensing technology, this paper expounds the whole process of big data from collection, processing and storage to the formation of results.

The third level is practice, and practice is the ultimate value embodiment of big data. Here, we describe the beautiful scenes that big data has shown and the blueprint that will be realized from four aspects: Internet big data, government big data, enterprise big data and personal big data.

?

The Significance, Uses and Disadvantages of the Concept of Big Data

1. The power to change value?

In the next decade, the core significance standard ("thinker") that determines whether China has great wisdom is national happiness. One is in people's livelihood, making things clear through big data, and seeing if what we do in interpersonal relationships is more meaningful than before; The second is reflected in ecology, to see if we have done more meaningful things in the relationship between heaven and man than before. In a word, let's move from the chaotic era 10 years ago to the bright era 10 years in the future.

2. Power to change the economy

Producers are valuable, and consumers are the meaning of value. What is meaningful is valuable, and what consumers don't agree with can't be sold and can't realize value; Only what consumers agree with can be sold and value can be realized. Big data helps us identify meaning from the source of consumers, thus helping producers realize value. This is the principle of starting domestic demand.

3. Change organizational strength

With the development of data infrastructure and data resources with the characteristics of semantic web, organizational change becomes more and more inevitable. Big data will prompt the network structure to produce unorganized organizational power. The first embodiment of this structural feature is various decentralized WEB2.0 applications, such as RSS, wiki, blog and so on. ? Big data has become the transformative force of the times because it gains wisdom by following meaning.

What's the use of big data?

Big data can be divided into big data technology, big data engineering, big data science and big data applications. At present, people talk most about big data technology and big data applications. Engineering and scientific issues have not been taken seriously. Big data engineering refers to the systematic engineering of planning, construction, operation and management of big data; Big data science focuses on discovering and verifying the laws of big data and its relationship with natural and social activities during the development and operation of big data networks.

Internet of Things, cloud computing, mobile Internet, car networking, mobile phones, tablet computers, PCs, and various sensors all over the world are all data sources or bearing methods.

Some examples include weblogs, RFID, sensor networks, social networks, social data (due to the society of data revolution), Internet texts and files; Internet search index; Call detailed records, astronomy, atmospheric science, genomics, biogeochemistry, biology and other complex and/or interdisciplinary scientific research, military reconnaissance and medical records; Video files of photographic archives; There are also large e-commerce? .

What are the disadvantages of big data applications?

Although advocates of big data see the great potential of using big data, some privacy advocates are worried, because more and more people are beginning to collect relevant data, whether they will intentionally disclose these data or publish them through social media, or even unconsciously publish some specific digital details by sharing their lives.

Analyzing these huge data sets will make our prediction ability produce false information, which will lead to many important and harmful wrong decisions. In addition, data is abused by powerful people or institutions, and agendas are selfishly manipulated to achieve their desired results.