What is the development prospect of big data?

20 19 China's data industry market analysis: the development process is remarkable, and four suggestions are made to solve five development challenges. How is China's big data industry developing? What are the opportunities and challenges for future development?

With the integration of information technology and human production and life, global data is characterized by explosive growth and massive aggregation. No matter the country, enterprises or the public, they are increasingly aware of the value of data. Therefore, in recent years, big data development bureaus have been established in various places to promote data asset governance. The industry radiated by big data has gradually expanded from traditional telecommunications and finance to industry, medical care and education. For a time, it seems that all walks of life are talking about big data, and everyone is talking about big data. However, there are also voices that big data has ushered in the "seven-year itch" and needs some "cold thinking" in the face of the big data boom. What is the development of big data in China? What are the opportunities and challenges for China's big data development in the future?

I. China's big data industry has made remarkable progress.

In the past few years, the concept of big data has been deeply rooted in people's hearts. "Speaking with data" has become everyone's knowledge, and data has become a strategic resource comparable to oil, gold and diamonds. In the past five years, China's big data industry policy has been gradually improved, and remarkable progress has been made in technology, application and industry.

1. In terms of policy, China's big data policy system from the central to the local level has been basically improved and has now entered the implementation stage. Since the word "big data" was written into the government work report in 20 14, the policy environment for the development of big data in China has opened a new chapter. In the top-level design, the State Council's "Action Plan for Promoting Big Data Development" has made overall arrangements for government data opening, industrial development and security. Documents such as "Interim Measures for the Management of Government Information Resources" and "Big Data Industry Development Plan (20 16-2020)" have also been issued. In the report of the 19th National Congress of the Communist Party of China, "promoting the deep integration of big data and the real economy" was put forward, and "implementing the national big data strategy" was put forward in the 13th Five-Year Plan.

Health, agriculture, environmental protection, procuratorial, taxation and other departments have also introduced specific policies for the development of big data in the field. By the beginning of 20 19, all provincial administrative regions had issued big data-related development plans, more than a dozen provinces and cities had established big data management bureaus, and eight national big data comprehensive experimental zones and 1 1 national engineering laboratories started construction. It can be said that the policy system of big data has been basically completed, and it has now entered the stage of implementation and even evaluation and inspection.

2. In terms of technology, China's big data technology development belongs to the "world's first echelon", but the domestic core technology capability is seriously insufficient. China's unique large-scale application scenarios and multi-type practice modes have promoted the speed and ability of technological innovation in the field of big data, and it is in a leading position in the world. In terms of technical comprehensiveness, there are large-scale cases and studies on China's platform, management and application technology;

In terms of application scale, China has completed the largest cluster open test in the field of big data, reaching 10000 nodes; In terms of efficiency capability, China's big data products have also achieved the best results on the international big data technology capability competition platform; In terms of intellectual property rights, in 20 18, China's patent disclosure in the field of big data accounted for about 40% of the world, ranking second in the world. However, most of China's big data technologies are based on the secondary transformation of foreign open source products, and the core technical capabilities need to be strengthened. For example, in the domestic mainstream big data platform technology, the proportion of self-research does not exceed 10%.

3. In terms of industry, China's big data industry has maintained steady and rapid growth for many years, but it faces a key transformation of improving quality and efficiency. In 20 18, China's big data industry continued to grow for many years and continued to maintain a high growth rate.

According to the statistical data of "China's Big Data Industry Development Prospect and Investment Strategic Planning Analysis Report" released by Forward-looking Industry Research Institute, the scale of China's big data industry has reached 280 billion yuan in 20 15. By 20 17, the scale of China's big data industry has grown to 470 billion, a year-on-year increase of 30.6%. It is preliminarily estimated that the scale of China's big data industry will reach about 540 billion yuan in 20 18, a year-on-year increase of 15%. It is predicted that the scale of China's big data industry will exceed one trillion yuan in 2020. However, due to various factors such as the domestic and international environment and the development of emerging technologies, the growth rate of the big data industry has declined. China's big data industry is also facing a critical transition period from high-speed development to high-quality development.

20 15-2020 Statistics and Forecast of China's Big Data Industry Scale

Data source: compiled by Prospective Industry Research Institute.

4. In terms of application, big data is more widely used in the industry and is accelerating its penetration into all aspects of the economy and society. With the lowering of the threshold of big data tools and the continuous improvement of enterprise data awareness, more and more industries are beginning to taste the "sweetness" brought by big data. Regardless of the number of new enterprises, financing scale or application popularity, the industries closely integrated with big data are expanding from the traditional telecom industry and financial industry to government affairs, medical and health care, industry, transportation and logistics, energy industry, education and culture. And the industry application trend is obvious, and it is more deeply integrated with the real economy.

Second, China's Big Data Industry Five Development Challenges Analysis

Although the overall development situation of big data in China is good, it also faces rare development opportunities, but there are still some difficulties and problems.

1, the development of industries involving core technologies is weak, which fails to effectively enhance the competitiveness of China's core technologies.

The influence of core technologies is very important in the big data industry. Because big data enterprises can replicate almost at zero cost and without restriction after completing product development, large enterprises with core technologies can easily turn their technological advantages into market advantages, that is, win a large number of users and gain a monopoly position with specific information products. At present, from the supply side of big data technology and products, although China has achieved a single breakthrough in local technologies, systematic and platform-level core technological innovations in the field of big data are still rare. Big data processing tools are "stones from other mountains", and most enterprises use foreign data collection, data processing, data analysis and data visualization technologies. It will take some time for the breakthrough of independent core technology. Especially in the technical standards of open source products, China's influence needs to be improved.

2. Data islands and barriers reduce the efficiency of resource allocation in the big data industry.

The development of big data industry must realize the free flow and enjoyment of data information. If the data is not open * * *, data integration cannot be realized, and the value of data will be greatly reduced. Whether it is government data, internet data or other data, data owners are often reluctant to open their circulation. Constrained by the previous information infrastructure construction, there are still many "data islands" and "data chimneys" in China's government data, and the data value is difficult to play.

3. Weak data security management increases the development risk of the big data industry.

While bringing innovation vitality to economic and social development, big data technology also brings new threats and risks to data security, personal information protection and even big data platform security. Big data platform gathers massive multi-source data, and data from multiple users may be stored in the same data pool and used by different users, which may easily lead to the risk of data leakage. Using big data technology to analyze massive data (2 1.90

-5. 19%, clinical unit), the results may contain sensitive information related to national economy, society and other aspects, and it is necessary to strengthen the safety management of sharing and publicizing the analysis results.

4. Industry monopoly and vicious competition are frequent, and the phenomenon of "bad money drives out good money" is obvious.

Due to the low threshold and high profits of resource-based industries, emerging big data companies often focus on obtaining data resources first. The birth of a large number of enterprises relying on the advantages of data resources has brought a monopoly economic model with low added value to the big data industry, which makes enterprises relying on technical barriers have to face cruel market competition and slow down the pace of technology research and development. At the same time, the problem of data monopoly is becoming more and more obvious. A few Internet giants have huge data, which is not only not conducive to industrial development, but also has huge hidden dangers of data aggregation.

5. The homogenization of development in various places is serious, and there is a widespread phenomenon of heavy storage and light application.

Due to the lack of a unified big data industry classification statistical system and industrial operation monitoring means, the positioning of big data industries in various places is similar, and homogenization competition is intensified. Blind redundant construction may even lead to a surplus of big data industry. At the same time, due to the limited development of informatization in some areas and the lack of rich application scenarios of big data, the construction of big data storage facilities such as data centers is the key to the development of big data industry, with a huge scale and millions of targets. If it cannot be used effectively in the later period, it will cause huge waste of resources.

Third, China's big data industry will present four development characteristics in the next three years.

The next three years will be an important opportunity period for China's big data development and transformation. The development of big data itself also shows some trends. In my opinion, the big data industry may present the following characteristics in the next three years:

1. New technologies of big data are developing rapidly.

In the future, big data technology will make breakthroughs in the direction of cloud deployment of tool platforms, unified processing of multi-service scenarios, and adaptation of proprietary high-performance hardware. At present, the main application mode of big data technology tools is the independent deployment of application enterprises in self-built computer rooms, which has some shortcomings such as waste of resources, insufficient flexibility and complicated management. These shortcomings can be solved by cloud deployment scheme based on cloud computing technology, which is helpful for the rapid landing and application of big data technology tools; At the same time, big data technology tools are mainly aimed at analytical business scenarios, but with the explosive development of e-commerce and intelligent terminals, transactional business scenarios such as transfer and billing also need big data processing capabilities, so the unified processing technology of multi-business scenarios will be fully developed in the future; Finally, due to the development of special hardware such as GPU/TPU, this special hardware can help some big data technologies to make a breakthrough upgrade, so the adaptation of new hardware has become the focus of many big data companies' future research and development plans.

2. Data circulation will usher in a key breakthrough.

In recent years, policies and measures to promote data openness have been strengthened, but there is still a gap between the results and expectations. It can be said that technical means will be the key to break through the bottleneck of data circulation. In the next three years, with the performance improvement and threshold reduction of key technologies such as homomorphic encryption, differential privacy, zero-knowledge proof and quantum ledger, and the further close integration of tools such as blockchain and secure multi-party computing with data circulation scenarios, data sharing and circulation will be expected to take another big step forward.

3. Data service compliance will become the focus of the industry.

In recent two years, with the promulgation and formal implementation of the EU General Data Protection Regulation (GDPR), the importance of personal information protection has been promoted to an unprecedented height. GDPR stipulates the rights of data subjects in detail, and its provisions on "data portability right" and "forgotten right" may bring some reference to China's data legislation. For enterprises in China, the further enhancement of the importance of data service compliance will have a great impact on the business development of enterprises. At present, the "Trusted Data Service" plan promoted by China Information and Communication Research Institute also meets this demand of the industry.

4. The importance of data asset management will be further enhanced.

With the application of big data entering the deep water area, enterprises will pay more and more attention to the construction of data asset management methodology system-that is, the unification of architecture, standards, research and development, quality, security, analysis and application, so as to realize the transformation and realization of technology to commercial value. In the next three years, data asset management will remain a difficulty and challenge for enterprise data departments. Even the leading scientific and technological enterprises are still exploring new methods of data asset management, such as full-link intelligent management system, data asset contribution, data baseline measurement and tool and visualization of quality specification.

Fourth, four suggestions to meet the challenges.

As an emerging industry with national strategic significance, big data industry should not only give full play to the main role of enterprises and the leading role of effective markets in the early stage of development, but also give better play to the guiding role of the government.

1, strengthen the research and industrialization of core technologies.

Independent research and innovation is the main engine to improve the competitiveness of big data industry. In order to completely change the current situation that China's data industry is not strong in innovation ability and its key core technologies are highly dependent on foreign countries, we must seize key areas, key links and core issues, identify key points and breakthroughs, and increase the guidance and support of government financial funds. Therefore, it is suggested to set up special national financial funds for R&D and key technology innovation in key areas of big data at the national level, support R&D breakthrough and a number of key core technology innovation applications, build a big data industrial chain with independent core technologies, form an independent and controllable big data technology architecture, improve the independent R&D and innovation capability of key core technologies, and effectively break the bottleneck restricting industrial development.

2. Improve the big data security policy

It is necessary to carry out research on major issues of data governance such as data confirmation, asset management, market supervision and cross-border flow, coordinate relevant departments to promote the legalization of data governance, and strengthen the protection of sensitive government data, business secrets and personal data. At the same time, we will promote the improvement of the information security level protection system applicable to the big data environment, establish a data management and guarantee system that takes both security and development into consideration, and strengthen the construction of relevant mechanisms such as data security assessment, security prevention and emergency response. In addition, it is necessary to strengthen cyberspace security information sharing and dynamic awareness, and improve the level of major risk identification and analysis.

3. Encourage local governments to develop big data industry according to local conditions.

The development of big data industry should focus on differentiated development and form a differentiated industrial layout. All localities need differentiated development. The development focus of big data should be to promote application innovation according to local conditions, create a perfect development environment, and let the market play a decisive role in the allocation of big data development factors. All localities should combine the industrial base and advantages, focus on developing the application of big data characteristic scenarios, and promote the accelerated integration of big data with important local real economy industries.

4. Promote the industry to accelerate the construction of big data standards.

At present, applications in the big data industry are emerging one after another. The government should standardize the industry and integrate resources in a standardized way, promote all parties to reach a consensus, and provide the cornerstone for the healthy development of the big data industry. In particular, it is of great significance to strengthen the formulation of industry/group standards with fast iteration speed and high market recognition, provide guidance for users and enterprises to choose big data products, ensure data security, and promote the standardized development of emerging service models such as big data transactions.