What job opportunities are there in the big data industry and what job skills are there in recruitment?

Big data mainly has the following locations:

1) data analyst: refers to the analysis opinions that are familiar with related businesses, skillfully construct data analysis frameworks, master and use relevant commonly used analysis tools and basic analysis methods, collect, sort out and analyze data, and provide guidance for sales operation management according to data analysis conclusions.

2) Data architect: guiding the whole life cycle of Hadoop solution, including requirements analysis, platform selection, technical architecture design, application design and development, testing and deployment. In-depth understanding of how to write MapReduce jobs and manage workflows to complete data calculation, and be able to master important components of Hadoop ecosystem, such as Yarn, HBase, Hive, Pig, etc., by using general algorithms provided by Hadoop. So as to realize the development of platform monitoring and auxiliary operation and maintenance system.

3) Big Data Engineer: Collect and process large-scale raw data (including script writing, webpage acquisition, API calling, SQL query writing, etc. ); Processing unstructured data into a form suitable for analysis, and then analyzing; Analyze business decisions according to requirements and projects.

4) Data warehouse administrator: specify and implement information management strategy; Information management solutions for coordination and management; The scope, plans and priorities of multiple projects; Manage all aspects of the warehouse such as data outsourcing, mobility, quality, design and implementation.

5) Database manager: improve the effectiveness of database tools and services; Ensure that all data comply with the law; Ensure that information is protected and backed up; Make regular reports; Monitor database performance; Improve the technology used; Establish a new database; Test data input program; Troubleshooting.

6) Businessintelligence analyst: disseminate information about tools, reports or metadata enhancements; Conduct or coordinate testing to ensure that the definition of information meets the requirements; Use business intelligence tools to identify or monitor existing and potential customers; Integrate current business data and trend data to support action recommendations; Maintain or update business intelligence tools, databases, dashboards, systems or methods; Business intelligence to manage user traffic in a timely manner.

7) Databasedeveloper: design, develop and implement a database system according to customer requirements; Optimize the performance efficiency of database system; Prepare the distribution database project of design specifications and functional documents; Spatial management and capacity planning of database system; Establish database tables and dictionaries; Participate in database design and architecture to support application development projects; Regular data backup and archiving; Test the database and correct errors; Solve database related problems in time; Formulate security procedures to prevent the database from being illegally used; Evaluate the existing database and put forward suggestions to improve the implementation efficiency; Best practices in developing database design and development activities.