Analyze how to become a big data development engineer

1. To know big data

Big data development engineers, you must first be familiar with relational databases, such as Oracle or MySQL, which is conducive to the development of data warehouses; Once again, I am familiar with Hadoop, which is the most used technology in the field of big data. Its HDFS can realize distributed storage. Yarn is an excellent resource scheduling framework

2. Skills required for big data require

skills that must be mastered:

Java Advanced (Virtual Machine, Concurrent), Linux Basic Operation, Hadoop(HDFS+MapReduce+Yarn), HBase(JavaAPI Operation +Phoenix), Hive(Hql Basic Operation and Principle Understanding), Kafka, Storm/JStorm, Scala, Python, Spark (Core+Spark SQL+Spark Streaming), auxiliary gadgets (SQOOP/Flueme/Oozie/Hue, etc.).